Benchmark Almanac

Qwen2.5-Turbo

Qwen2.5-Turbo.

Qwen Released November 15th, 2024 Family Qwen2.5 The lab's model card Compare with others
3
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Nov 2024

Qwen2.5-Turbo

Closed weights Mid-size

No Epoch Capabilities Index score yet
  • ResearchCodeBench 8.02% #22 /22

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 55.6% #125 of 212 Official leaderboard

Coding

BenchmarkScoreRankSource
ResearchCodeBench 8.02% #22 of 22 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
Dubesor AI Chess Leaderboard 574 #216 of 250 Official leaderboard

What does it cost to run?

On the one leaderboard that publishes a price, its best run costs about 1/42 of the median model's. There, another model comes close to its score for less.

Benchmark Score Price From cheapest to priciest Against the median Close to its score for less Close for less
Dubesor AI Chess Leaderboard 574 $0.005 0.0× the median 0.0× Gemini 1.5 Flash Sep 2024 594 for $0.003

Who measured it?

Independent runs cover all 3 of its benchmarks.

  • An independent run only 3
Official leaderboards scored it on 3.

Sources: Official leaderboards, Epoch AI (CC BY 4.0) and labs’ model cards