Magistral-Small-2507 model card (Hugging Face) Jul 24, 2025
- AIME24 pass@1 72
- AIME25 pass@1 61
- GPQA Diamond 71.5
- Livecodebench (v5) 59.4
Magistral Medium 1.1.
Closed weights
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Diamond | 71.5% | #171 of 302 | Lab model card | |
| AIME 2024 | 72% | #59 of 88 | Lab model card | |
| AIME 2025 | 61% | #127 of 143 | Lab model card | |
| ARC-AGI | 5.91% | #29 of 30 | Collected by Epoch AI, source not named | |
| ARC-AGI-2 | 0% | #96 of 97 | Collected by Epoch AI, source not named |
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveCodeBench v5 | 59.4% | #28 of 47 | Lab model card |
The benchmarks the lab chose to headline, with the scores it gave.