Qwen1.5-110B
Qwen1.5-110B places in the top three on CMMLU.
13
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Qwen Apr 2024 Qwen1.5-110B
Open weights
No Epoch Capabilities Index score yet
- Open Arabic LLM Leaderboard v1 50.6% #14 /55
- SGP-Bench 49.9% #11 /22
- MathBench 58.4% #6 /21
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 83.7 | #8 of 85 | Official leaderboard | |
| CMMLU | 88.3% | #2 of 11 | Official leaderboard | |
| MuSR | 44.1% | #24 of 98 | Official leaderboard | |
| Open Arabic LLM Leaderboard v1 | 50.6% | #14 of 55 | Official leaderboard | |
| MMLU-Pro | 49.9% | #134 of 212 | Official leaderboard | |
| LMArena (Elo) | 1,234 | #269 of 335 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MathBench | 58.4% | #6 of 21 | Official leaderboard | |
| ForecastBench | 0.17 | #72 of 82 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| NaturalCodeBench | 32.2% | #5 of 5 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MedQA | 64% | #42 of 71 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SGP-Bench | 49.9% | #11 of 22 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 29.8 | #26 of 99 | Official leaderboard | |
| HELM Lite | 55.0 | #32 of 71 | Official leaderboard |