Ministral 8B
Ministral 8B.
21
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Oct 2024 Ministral 8B
Open weights
No Epoch Capabilities Index score yet
- GPQA Diamond 27.1% #216 /229
- SimpleQA Verified 6.82% #51 /56
- KoBALT 17% #11 /12
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vectara Hallucination Leaderboard (2025 dataset) | 7.40% | #35 of 104 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 7.50% | #115 of 148 | Official leaderboard | |
| FaithJudge | 30.9% | #29 of 37 | Official leaderboard | |
| MMLU-Pro | 37.9% | #168 of 212 | Official leaderboard | |
| LMArena (Elo) | 1,238 | #267 of 335 | Official leaderboard | |
| BuzzBench | 32.3 | #17 of 20 | Official leaderboard | |
| AraGen | 17.6% | #37 of 42 | Official leaderboard | |
| SimpleQA Verified | 6.82% | #51 of 56 | Official leaderboard | |
| ECLeKTic | 3.98% | #32 of 35 | Official leaderboard | |
| KoBALT | 17% | #11 of 12 | Official leaderboard | |
| FACTS Grounding | 56.1% | #33 of 34 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH Level 5 | 14.9% | #81 of 94 | Epoch AI run | |
| GPQA Diamond | 27.1% | #216 of 229 | Epoch AI run | |
| U-MATH | 23.1% | #29 of 30 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Berkeley Function Calling Leaderboard (BFCL) | 51.5% | #47 of 67 | Official leaderboard | |
| SnakeBench | 19 | #146 of 188 | Official leaderboard | |
| LLM-WikiRace | 0% | #17 of 21 | Official leaderboard | |
| Galileo Agent Leaderboard | 0.69 | #27 of 29 | Official leaderboard | |
| BFCL V4 | 11.1% | #61 of 65 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LEXam | 14.9% | #29 of 30 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BaxBench | 1.89% | #32 of 34 | Official leaderboard |