Benchmark Almanac

Yi-9B

Yi-9B.

Released March 1st, 2024 Compare with others
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Mar 2024

Yi-9B

102.3 #212 of 256
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU 68.4% #30 of 85 Claim in Yi: Open Foundation Models by 01.AI, via Epoch AI
ARC-Challenge 55.6% #37 of 75 Claim in Yi: Open Foundation Models by 01.AI, via Epoch AI
WinoGrande 73% #40 of 76 Claim in Yi: Open Foundation Models by 01.AI, via Epoch AI
MuSR 40.5% #56 of 98 Official leaderboard
HellaSwag 76.4% #38 of 63 Claim in Yi: Open Foundation Models by 01.AI, via Epoch AI

Other

BenchmarkScoreRankSource
Open LLM Leaderboard v2 17.8 #61 of 99 Official leaderboard

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B Qwen-1_8B internlm-20b internlm-7b chatglm2-6b 50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)