Benchmark Almanac

Chinchilla

Chinchilla.

Google DeepMind Released March 29th, 2022
6
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Google DeepMind Mar 2022

Chinchilla

Closed weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
LAMBADA 77.4% #8 of 26 Claim in The Falcon Series of Open Language Models, via Epoch AI
BoolQ 83.7% #22 of 61 Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI
MMLU 67.5% #32 of 85 Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI
PIQA 81.8% #27 of 58 Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI
WinoGrande 74.9% #36 of 76 Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI
TriviaQA 64.6% #31 of 38 Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI