Jamba 1.5 Mini
Jamba 1.5 Mini places in the top three on HELMET.
8
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
AI21 Labs Aug 2024
Jamba 1.5 Mini
Open weights Mid-size
No Epoch Capabilities Index score yet
- CorpFin v2 33.9% #117 /119
- TaxEval v2 41.9% #127 /129
- HELMET 46.9% #2 /16
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELMET | 46.9% | #2 of 16 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 2.90% | #40 of 148 | Official leaderboard | |
| LMArena (Elo) | 1,240 | #266 of 335 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MedQA | 63.2% | #43 of 71 | Official leaderboard | |
| LegalBench | 66.6% | #125 of 138 | Official leaderboard | |
| CorpFin v2 | 33.9% | #117 of 119 | Official leaderboard | |
| TaxEval v2 | 41.9% | #127 of 129 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HELM Lite | 41.4 | #49 of 71 | Official leaderboard |