Benchmark Almanac

internlm-7b

internlm-7b.

Released July 5th, 2023 Compare with others
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Jul 2023

internlm-7b

84.8 #234 of 256
Epoch Capabilities Index
  • T-Eval 45.8% #10 /12

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
ARC-Challenge 69.5% #24 of 75 Claim in Qwen Technical Report, via Epoch AI
MMLU 51% #57 of 85 Claim in Qwen Technical Report, via Epoch AI
PIQA 77.9% #41 of 58 Claim in Qwen Technical Report, via Epoch AI
HellaSwag 70.6% #48 of 63 Claim in Qwen Technical Report, via Epoch AI
BIG-Bench Hard 37% #37 of 45 Claim in Qwen Technical Report, via Epoch AI
BoolQ 64.1% #55 of 61 Claim in Qwen Technical Report, via Epoch AI
LAMBADA 67% #24 of 26 Claim in Qwen Technical Report, via Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 31.2% #53 of 70 Claim in Qwen Technical Report, via Epoch AI

Agents and tools

BenchmarkScoreRankSource
T-Eval 45.8% #10 of 12 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MVBench 41.7% #5 of 5 Official leaderboard

The lab's models over time

's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B Qwen2.5-Coder-3B Qwen-1_8B internlm-20b internlm-7b chatglm2-6b 50 100 150 2023 2024 2025 2026 2027 Qwen2.5-Coder-0.5B Qwen2.5-Coder-14B

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)