Benchmark Almanac

Ministral 3B

Ministral 3B.

Mistral AI Released October 16th, 2024 Compare with others
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Oct 2024

Ministral 3B

Closed weights

No Epoch Capabilities Index score yet
  • GPQA Diamond 25.3% #220 /229
  • SimpleQA Verified 5.43% #55 /56
  • LMCA 5.48% #140 /147

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (2025 dataset) 7.30% #34 of 104 Official leaderboard
Vectara Hallucination Leaderboard (HHEM) 8.30% #123 of 148 Official leaderboard
SimpleQA Verified 5.43% #55 of 56 Official leaderboard
ECLeKTic 0.64% #35 of 35 Official leaderboard
FACTS Grounding 52.2% #34 of 34 Official leaderboard

Math and science

BenchmarkScoreRankSource
MATH Level 5 14.4% #83 of 94 Epoch AI run
DTBench 51.7% #160 of 180 Official leaderboard
GPQA Diamond 25.3% #220 of 229 Epoch AI run

Agents and tools

BenchmarkScoreRankSource
SnakeBench 9 #184 of 188 Official leaderboard

Other

BenchmarkScoreRankSource
LMCA 5.48% #140 of 147 Official leaderboard
Conceptual Reasoning Index 10.1 #149 of 151 Official leaderboard
ACCoRD 14.6 #150 of 152 Official leaderboard