Benchmark Almanac

Qwen2.5-Math-72B-Instruct

Qwen2.5-Math-72B-Instruct places in the top three on 2 benchmarks.

Qwen Released September 19th, 2024 Family Qwen2.5-Math The lab's model card Compare with others
7
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
Qwen Sep 2024

Qwen2.5-Math-72B-Instruct

Open weights Flagship

No Epoch Capabilities Index score yet
  • Open Arabic LLM Leaderboard v1 53.1% #11 /55
  • Omni-MATH 36.2% #3 /9
  • LiveMathBench 42.3% #2 /5

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MuSR 44.7% #18 of 98 Official leaderboard
Open Arabic LLM Leaderboard v1 53.1% #11 of 55 Official leaderboard

Math and science

BenchmarkScoreRankSource
U-MATH 59.5% #10 of 30 Official leaderboard
Omni-MATH 36.2% #3 of 9 Official leaderboard
LiveMathBench 42.3% #2 of 5 Official leaderboard
PolyMath 21% #30 of 38 Official leaderboard

Other

BenchmarkScoreRankSource
Open LLM Leaderboard v2 36.8 #11 of 99 Official leaderboard