Gopher (280B)
Gopher (280B).
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Google DeepMind Dec 2021 Gopher (280B)
Closed weights
No Epoch Capabilities Index score yet
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HellaSwag | 79.2% | #28 of 63 | Claim in Using DeepSpeed and Megatron to Train Megatron-Turing NLG…, via Epoch AI | |
| PIQA | 81.8% | #26 of 58 | Claim in Using DeepSpeed and Megatron to Train Megatron-Turing NLG…, via Epoch AI | |
| MMLU | 60% | #1 of 2 | Official leaderboard | |
| LAMBADA | 74.5% | #14 of 26 | Claim in Using DeepSpeed and Megatron to Train Megatron-Turing NLG…, via Epoch AI | |
| BoolQ | 79.4% | #33 of 61 | Claim in The Falcon Series of Open Language Models, via Epoch AI | |
| WinoGrande | 70.2% | #48 of 76 | Claim in Using DeepSpeed and Megatron to Train Megatron-Turing NLG…, via Epoch AI | |
| TriviaQA | 57.2% | #36 of 38 | Claim in LLaMA: Open and Efficient Foundation Language Models, via Epoch AI |