Granite-3.0-8B-Instruct
Granite-3.0-8B-Instruct.
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
IBM Oct 2024
Granite-3.0-8B-Instruct
Open weights Small
No Epoch Capabilities Index score yet
- BigCodeBench-Hard 8.40% #87 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MuSR | 39% | #68 of 98 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 6.50% | #107 of 148 | Official leaderboard | |
| LMArena (Elo) | 1,183 | #292 of 335 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 32.4% | #59 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 8.40% | #87 of 96 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 24.0 | #43 of 99 | Official leaderboard |