- SWE-Bench Verified 61.6
Devstral Medium
Devstral Medium.
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Devstral Medium
Closed weights Mid-size
No Epoch Capabilities Index score yet
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SWE-bench Verified | 61.6% | #107 of 155 | Lab model card | |
| DesignArena Website | 1,012 | #130 of 151 | Official leaderboard | |
| DesignArena 3D Design | 1,015 | #118 of 136 | Official leaderboard | |
| DesignArena Code | 1,003 | #127 of 143 | Official leaderboard | |
| DesignArena UI Component | 970 | #125 of 139 | Official leaderboard | |
| DesignArena Game Dev | 976 | #129 of 143 | Official leaderboard | |
| DesignArena Data Visualization | 933 | #115 of 118 | Official leaderboard | |
| Code Arena | 1,072 | #128 of 128 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LisanBench | 180.3 | #93 of 133 | Official leaderboard |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.