Benchmark Almanac

Yi-1.5-6B-Chat

Yi-1.5-6B-Chat.

01.AI Released May 13th, 2024 Family Yi-1.5 The lab's model card Compare with others
13
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
01.AI May 2024

Yi-1.5-6B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • KOR-Bench 32.5% #27 /33
  • Encyclo-K 15.5% #22 /23
  • BigCodeBench-Hard 5.40% #91 /96

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MuSR 43.9% #27 of 98 Official leaderboard
MMLU-CF 52.8% #28 of 37 Official leaderboard
MMLU-Pro 38.2% #166 of 212 Official leaderboard
EQ-Bench v2 59.5 #67 of 85 Official leaderboard
Vectara Hallucination Leaderboard (HHEM) 7.90% #118 of 148 Official leaderboard
SuperGPQA 19.2% #54 of 59 Official leaderboard
WildBench 25.3 #44 of 47 Official leaderboard
Encyclo-K 15.5% #22 of 23 Official leaderboard

Math and science

BenchmarkScoreRankSource
KOR-Bench 32.5% #27 of 33 Official leaderboard

Coding

BenchmarkScoreRankSource
BigCodeBench 29.8% #62 of 69 Official leaderboard
BigCodeBench-Hard 5.40% #91 of 96 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
SuperCLUE-Agent 62.2 #5 of 7 Official leaderboard

Other

BenchmarkScoreRankSource
Open LLM Leaderboard v2 22.8 #48 of 99 Official leaderboard