Mistral-7B-Instruct-v0.1
Mistral-7B-Instruct-v0.1.
17
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Mistral AI Sep 2023 Mistral-7B-Instruct-v0.1
Open weights Small
No Epoch Capabilities Index score yet
- LiveSQLBench 2.83% #35 /36
- GTA 7.37% #12 /15
- TableBench 11% #9 /10
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MuSR | 38.5% | #71 of 98 | Official leaderboard | |
| MMLU-Pro | 25.8% | #187 of 212 | Official leaderboard | |
| EQ-Bench v2 | 52.1 | #76 of 85 | Official leaderboard | |
| TableBench | 11% | #9 of 10 | Official leaderboard | |
| Global PIQA | 53.6% | #40 of 44 | Official leaderboard | |
| RepoQA | 11% | #21 of 22 | Official leaderboard | |
| LMArena (Elo) | 1,111 | #323 of 335 | Official leaderboard | |
| INCLUDE | 44.3% | #3 of 3 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LiveSQLBench | 2.83% | #35 of 36 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 21 | #113 of 188 | Official leaderboard | |
| GTA | 7.37% | #12 of 15 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Anthropic Red Team | 71% | #75 of 75 | Official leaderboard | |
| HELM Safety | 52.5 | #75 of 75 | Official leaderboard | |
| SimpleSafetyTests | 43.3% | #75 of 75 | Official leaderboard | |
| SORRY-Bench | 90.2% | #23 of 23 | Official leaderboard | |
| SALAD-Bench | 54.1% | #13 of 13 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 12.8 | #81 of 99 | Official leaderboard |