- MMLU 89.5
- MMLU-pro 79
- GPQA-diamond 57.5
- SimpleQA 22.8
- Chinese-SimpleQA 70.8
- BBH 92.2
- DROP 91.5
- ZebraLogic 46
- MATH 89.7
- AIME2024 43.3
- HumanEval 91
- LiveCodeBench 32
- C-Eval 90.9
- CMMLU 90.8
- LiveBench 61
- ArenaHard 88.6
- IF-Eval 88.6
Hunyuan-TurboS
Hunyuan-TurboS ranks first on CMMLU.
Hunyuan-TurboS
Closed weights Flagship
- AutoCodeBench 43.8% #18 /34
- ArtifactsBench (Gemini 2.5 Pro 0506 judge) 51% #3 /18
- MMLU-Pro 79% #87 /167
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BIG-Bench Hard | 92.2% | #4 of 73 | Lab model card | |
| CMMLU | 90.8% | #1 of 17 | Lab model card | |
| DROP | 91.5% | #5 of 41 | Lab model card | |
| MMLU | 89.5% | #18 of 131 | Lab model card | |
| C-Eval | 90.9% | #14 of 46 | Lab model card | |
| Arena-Hard-Auto | 88.6% | #12 of 39 | Lab model card | |
| IFEval | 88.6% | #50 of 135 | Lab model card | |
| LMArena (Elo) | 1,383 | #151 of 335 | Official leaderboard | |
| MMLU-Pro | 79% | #87 of 167 | Lab model card | |
| Chinese SimpleQA | 70.8% | #7 of 13 | Lab model card | |
| SimpleQA | 22.8% | #36 of 60 | Lab model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MATH | 89.7% | #11 of 99 | Lab model card | |
| GPQA Diamond | 57.5% | #226 of 302 | Lab model card | |
| AIME 2024 | 43.3% | #77 of 88 | Lab model card | |
| ZebraLogic | 46% | #23 of 23 | Lab model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval | 91% | #11 of 101 | Lab model card | |
| ArtifactsBench (Gemini 2.5 Pro 0506 judge) | 51% | #3 of 18 | Official leaderboard | |
| AutoCodeBench | 43.8% | #18 of 34 | Official leaderboard | |
| LiveCodeBench | 32% | #42 of 54 | Lab model card |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveBench | 61% | #16 of 27 | Lab model card |
Its lab's numbers put it at 127.0, number 301 of 404
The Self-Reported Index fits one score to the 16 capability results Tencent reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 124.1 to 130.0. How we compute it.
- BIG-Bench Hard 92.2
- DROP 91.5
- HumanEval 91
- C-Eval 90.9
- CMMLU 90.8
- MATH 89.7
- MMLU 89.5
- Arena-Hard-Auto 88.6
- IFEval 88.6
- MMLU-Pro 79
- Chinese SimpleQA 70.8
- GPQA Diamond 57.5
- ZebraLogic 46
- AIME 2024 43.3
- LiveCodeBench 32
- SimpleQA 22.8
Its lab's number next to a leaderboard
Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.