Benchmark Almanac

Hunyuan-TurboS

Hunyuan-TurboS ranks first on CMMLU.

Tencent Released February 27th, 2025 Family Hunyuan The lab's model card Compare with others
20
Benchmarks with a score
1
Ranked first, out of five or more models
2
In the top three
Tencent Feb 2025

Hunyuan-TurboS

Closed weights Flagship

127.0 #301 of 404
Self-Reported Index, from the lab's own numbers. No Epoch Capabilities Index score yet.
  • AutoCodeBench 43.8% #18 /34
  • ArtifactsBench (Gemini 2.5 Pro 0506 judge) 51% #3 /18
  • MMLU-Pro 79% #87 /167

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BIG-Bench Hard 92.2% #4 of 73 Lab model card
CMMLU 90.8% #1 of 17 Lab model card
DROP 91.5% #5 of 41 Lab model card
MMLU 89.5% #18 of 131 Lab model card
C-Eval 90.9% #14 of 46 Lab model card
Arena-Hard-Auto 88.6% #12 of 39 Lab model card
IFEval 88.6% #50 of 135 Lab model card
LMArena (Elo) 1,383 #151 of 335 Official leaderboard
MMLU-Pro 79% #87 of 167 Lab model card
Chinese SimpleQA 70.8% #7 of 13 Lab model card
SimpleQA 22.8% #36 of 60 Lab model card

Math and science

BenchmarkScoreRankSource
MATH 89.7% #11 of 99 Lab model card
GPQA Diamond 57.5% #226 of 302 Lab model card
AIME 2024 43.3% #77 of 88 Lab model card
ZebraLogic 46% #23 of 23 Lab model card

Coding

BenchmarkScoreRankSource
HumanEval 91% #11 of 101 Lab model card
ArtifactsBench (Gemini 2.5 Pro 0506 judge) 51% #3 of 18 Official leaderboard
AutoCodeBench 43.8% #18 of 34 Official leaderboard
LiveCodeBench 32% #42 of 54 Lab model card

Other

BenchmarkScoreRankSource
LiveBench 61% #16 of 27 Lab model card

Its lab's numbers put it at 127.0, number 301 of 404

The Self-Reported Index fits one score to the 16 capability results Tencent reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 124.1 to 130.0. How we compute it.

Its lab's number next to a leaderboard

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
MMLU-Pro 79% MMLU-pro 79% Leaderboard Same

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.