Qwen1.5-32B
Qwen1.5-32B.
22
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Feb 2024 Qwen1.5-32B
Open weights
No Epoch Capabilities Index score yet
- GPQA Diamond 30.7% #206 /229
- Open Arabic LLM Leaderboard v1 45.8% #25 /55
- Political Science LLM Benchmark 61.9% #40 /42
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MadinahQA | 53% | #11 of 39 | Official leaderboard | |
| Open Arabic LLM Leaderboard v2 | 56.2% | #14 of 39 | Official leaderboard | |
| MuSR | 42.8% | #36 of 98 | Official leaderboard | |
| AlGhafa | 66.4% | #15 of 39 | Official leaderboard | |
| EQ-Bench v2 | 75.6 | #36 of 85 | Official leaderboard | |
| ArbMMLU-HT | 45.3% | #17 of 39 | Official leaderboard | |
| Open Arabic LLM Leaderboard v1 | 45.8% | #25 of 55 | Official leaderboard | |
| CMMLU | 82.3% | #5 of 11 | Official leaderboard | |
| ArabicMMLU | 48.8% | #20 of 39 | Official leaderboard | |
| MixEval | 81% | #19 of 34 | Official leaderboard | |
| ALRAGE | 67% | #23 of 39 | Official leaderboard | |
| CFBench | 31.6% | #12 of 19 | Official leaderboard | |
| LMArena (Elo) | 1,204 | #283 of 335 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OlympicArena | 24.4% | #11 of 25 | Official leaderboard | |
| GPQA Diamond | 30.7% | #206 of 229 | Epoch AI run |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MedQA | 65.6% | #37 of 71 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SGP-Bench | 49.4% | #12 of 22 | Official leaderboard |
Safety and security
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 27.3 | #33 of 99 | Official leaderboard | |
| HELM Lite | 54.6 | #33 of 71 | Official leaderboard | |
| Political Science LLM Benchmark | 61.9% | #40 of 42 | Official leaderboard |