Benchmark Almanac

Pixtral Large

Pixtral Large places in the top three on Vibe-Eval.

Mistral AI Released November 18th, 2024 Compare with others
7
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Mistral AI Nov 2024

Pixtral Large

Open weights

No Epoch Capabilities Index score yet
  • ZeroBench 3.00% #56 /76
  • MicroVQA 49.8% #7 /19
  • HumanEval-V 21.3% #6 /24

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Creative Writing v3 51.7 #102 of 120 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval-V 21.3% #6 of 24 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MathVista 69.4% #9 of 43 Official leaderboard
MicroVQA 49.8% #7 of 19 Official leaderboard
Vibe-Eval 55.1% #3 of 5 Official leaderboard
ZeroBench 3.00% #56 of 76 Official leaderboard
VISTA 33.9% #44 of 54 Official leaderboard