- SWE-Bench Verified 53.6
Devstral Small 1.1
Devstral Small 1.1.
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Devstral Small 1.1
Open weights Small
No Epoch Capabilities Index score yet
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SWE-bench Verified | 38% | #47 of 60 | Official leaderboard | |
| DesignArena Website | 795 | #148 of 151 | Official leaderboard | |
| DesignArena UI Component | 830 | #138 of 139 | Official leaderboard | |
| DesignArena Code | 798 | #142 of 143 | Official leaderboard | |
| DesignArena Game Dev | 771 | #142 of 143 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 25 | #76 of 188 | Official leaderboard |
Its lab's number next to a leaderboard
Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.
| Benchmark | Lab says | Board says | Gap | What differs |
|---|---|---|---|---|
| SWE-bench Verified | 53.6% SWE-Bench Verified | 38% Leaderboard, SWE-agent | +16 pts | Mistral evaluates Devstral Small 1.1 with OpenHands, while the board uses SWE-agent. |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it.