QwQ-32B-Preview
QwQ-32B-Preview ranks first on LiveMathBench.
20
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
Qwen Nov 2024 QwQ-32B-Preview
Open weights
No Epoch Capabilities Index score yet
- BigCodeBench-Hard 26.7% #33 /96
- IneqMath 2.00% #25 /34
- PHYSICS 12.1% #13 /20
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU-Pro | 71% | #84 of 212 | Official leaderboard | |
| MuSR | 41.1% | #51 of 98 | Official leaderboard | |
| SuperGPQA | 43.6% | #32 of 59 | Official leaderboard | |
| LLM-AggreFact | 71.8% | #8 of 10 | Official leaderboard | |
| LMArena (Elo) | 1,154 | #305 of 335 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 16.1% | #141 of 148 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| U-MATH | 73.1% | #6 of 30 | Official leaderboard | |
| LiveMathBench | 61.2% | #1 of 5 | Official leaderboard | |
| PHYSICS | 12.1% | #13 of 20 | Official leaderboard | |
| ForecastBench | 0.14 | #55 of 82 | Official leaderboard | |
| IneqMath | 2.00% | #25 of 34 | Official leaderboard | |
| AIME 2025 | 33.3% | #48 of 53 | Official leaderboard | |
| HMMT 2025 | 18.3% | #48 of 53 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 49.5% | #23 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 26.7% | #33 of 96 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Step Race | 1 | #44 of 59 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BRIDGE | 48.4 | #13 of 39 | Official leaderboard | |
| FinanceReasoning | 76% | #6 of 6 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| VRBench | 35.9% | #18 of 19 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 34.1 | #15 of 99 | Official leaderboard |