CodeQwen1.5-7B
CodeQwen1.5-7B.
Released April 15th, 2024 Compare with others
11
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Apr 2024
CodeQwen1.5-7B
75.2
#242 of 256
Epoch Capabilities Index
- SGP-Bench 30.1% #22 /22
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMLU | 40.5% | #68 of 85 | Claim in Qwen2.5-Coder Technical Report, via Epoch AI | |
| WinoGrande | 59.8% | #68 of 76 | Claim in Qwen2.5-Coder Technical Report, via Epoch AI | |
| ARC-Challenge | 35.7% | #68 of 75 | Claim in Qwen2.5-Coder Technical Report, via Epoch AI |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GSM8K | 37.7% | #45 of 70 | Claim in Qwen2.5-Coder Technical Report, via Epoch AI |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MultiPL-E | 40.5% | #4 of 9 | Official leaderboard | |
| MBPP | 73.5% | #20 of 35 | Official leaderboard | |
| MBPP+ | 60.8% | #21 of 35 | Official leaderboard | |
| HumanEval | 51.8% | #32 of 46 | Official leaderboard | |
| HumanEval+ | 45.7% | #32 of 46 | Official leaderboard | |
| FullStackBench | 40.5% | #9 of 10 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SGP-Bench | 30.1% | #22 of 22 | Official leaderboard |
The lab's models over time
's models in color, against every other model on the Epoch Capabilities Index, by release date.
Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)