Yi-1.5-9B-Chat
Yi-1.5-9B-Chat.
17
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
01.AI May 2024 Yi-1.5-9B-Chat
Open weights Small
No Epoch Capabilities Index score yet
- KOR-Bench 35.2% #24 /33
- Encyclo-K 17.4% #20 /23
- BigCodeBench-Hard 11.1% #81 /96
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MuSR | 42.6% | #37 of 98 | Official leaderboard | |
| Ko-IFEval (Upstage) | 36.5% | #11 of 21 | Official leaderboard | |
| WildBench | 39.8 | #28 of 47 | Official leaderboard | |
| EQ-Bench v2 | 70.4 | #52 of 85 | Official leaderboard | |
| Open Arabic LLM Leaderboard v1 | 41.9% | #35 of 55 | Official leaderboard | |
| Vectara Hallucination Leaderboard (HHEM) | 4.90% | #95 of 148 | Official leaderboard | |
| MMLU-Pro | 46% | #142 of 212 | Official leaderboard | |
| MixEval | 74.2% | #27 of 34 | Official leaderboard | |
| SuperGPQA | 23.2% | #50 of 59 | Official leaderboard | |
| Encyclo-K | 17.4% | #20 of 23 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MathBench | 51.1% | #11 of 21 | Official leaderboard | |
| KOR-Bench | 35.2% | #24 of 33 | Official leaderboard | |
| ZebraLogic | 2.30% | #46 of 46 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| BigCodeBench | 38.5% | #49 of 69 | Official leaderboard | |
| BigCodeBench-Hard | 11.1% | #81 of 96 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| FinEval | 56.9% | #5 of 7 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Open LLM Leaderboard v2 | 29.5 | #28 of 99 | Official leaderboard |