mistral-small-2402
mistral-small-2402.
Released February 26th, 2024 Compare with others
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Feb 2024
mistral-small-2402
No Epoch Capabilities Index score yet
- TaxEval v2 49.1% #124 /129
- BigCodeBench-Hard 13.9% #73 /96
- MedQA 61.6% #49 /71
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| EQ-Bench v2 | 80.4 | #24 of 85 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 36.7% | #52 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 13.9% | #73 of 96 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MedQA | 61.6% | #49 of 71 | Official leaderboard | |
| TaxEval v2 | 49.1% | #124 of 129 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OR-Bench | 13.3% | #7 of 28 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 28.8 | #62 of 71 | Official leaderboard |