Benchmark Almanac

Cerebras-GPT-13B

Cerebras-GPT-13B.

Cerebras Systems Released March 20th, 2023
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Cerebras Systems Mar 2023

Cerebras-GPT-13B

Open weights

49.3 #256 of 256
Epoch Capabilities Index

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
WinoGrande 60.8% #66 of 76 Claim in XGen-7B Technical Report, via Epoch AI
HellaSwag 59.4% #55 of 63 Claim in XGen-7B Technical Report, via Epoch AI
OpenBookQA 35.8% #37 of 41 Claim in XGen-7B Technical Report, via Epoch AI
PIQA 73.5% #53 of 58 Claim in XGen-7B Technical Report, via Epoch AI
MMLU 26.2% #81 of 85 Claim in XGen-7B Technical Report, via Epoch AI
ARC-Challenge 32.4% #72 of 75 Claim in XGen-7B Technical Report, via Epoch AI
BoolQ 61.1% #59 of 61 Claim in XGen-7B Technical Report, via Epoch AI

Cerebras Systems's models over time

Cerebras Systems's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Cerebras-GPT-13B 50 100 150 2023 2024 2025 2026 2027 Cerebras-GPT-13B

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)