Benchmark Almanac

internlm-20b

internlm-20b.

Released September 18th, 2023
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Sep 2023

internlm-20b

99.1 #218 of 256
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 87.5% #12 of 61 Claim in Qwen Technical Report, via Epoch AI
ARC-Challenge 81.7% #16 of 75 Claim in Qwen Technical Report, via Epoch AI
BIG-Bench Hard 52.5% #22 of 45 Claim in Qwen Technical Report, via Epoch AI
HellaSwag 78.1% #31 of 63 Claim in Qwen Technical Report, via Epoch AI
PIQA 80.3% #35 of 58 Claim in Qwen Technical Report, via Epoch AI
LAMBADA 71.8% #19 of 26 Claim in Qwen Technical Report, via Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 62.9% #27 of 70 Claim in Yi: Open Foundation Models by 01.AI, via Epoch AI

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B Qwen-1_8B internlm-20b internlm-7b chatglm2-6b 50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)