- Artificial Analysis Intelligence Index v4.3.2 24.1
- AutomationBench-AA (Artificial Analysis score quoted by Upstage) 22.3
- τ³-Banking (a separate evaluation, printed as 47.2) 47.2
- AA-LCR (Artificial Analysis score quoted by Upstage) 83.3
- SciCode (Artificial Analysis score quoted by Upstage) 47.6
- Humanity’s Last Exam (Artificial Analysis score quoted by Upstage) 25.8
Solar Mini 4
Solar Mini 4 places in the top three on 2 benchmarks.
12
Benchmarks with a score
0
Ranked first, out of five or more models
2
In the top three
Solar Mini 4
Closed weights Small
No Epoch Capabilities Index score yet
- SciCode 47.6% #15 /49
- AA-LCR 1.1 83.3% #2 /6
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| AA-LCR 1.1 | 83.3% | #2 of 6 | Lab model card | |
| Humanity's Last Exam | 25.8% | #90 of 154 | Lab model card |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SciCode | 47.6% | #15 of 49 | Lab model card | |
| DesignArena Website | 1,141 | #103 of 151 | Official leaderboard | |
| DesignArena 3D Design | 1,092 | #97 of 136 | Official leaderboard | |
| DesignArena Game Dev | 1,098 | #102 of 143 | Official leaderboard | |
| DesignArena Code | 1,127 | #106 of 143 | Official leaderboard | |
| DesignArena UI Component | 1,093 | #104 of 139 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| τ³-bench Banking | 47.2% | #2 of 22 | Lab model card | |
| AutomationBench | 22.3% | #40 of 47 | Lab model card | |
| DuelLab GameBench 2 | 13.1 | #52 of 57 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Artificial Analysis Intelligence Index v4.3 | 24.1 | #4 of 4 | Lab model card |
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.