Benchmark Almanac

GPT-NeoX-20B

GPT-NeoX-20B.

EleutherAI Released April 7th, 2022 Compare with others
8
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
EleutherAI Apr 2022

GPT-NeoX-20B

Open weights

No Epoch Capabilities Index score yet
  • Ko-IFEval (Upstage) 13.4% #21 /21

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
WinoGrande 66.1% #56 of 76 Claim in XGen-7B Technical Report, via Epoch AI
HellaSwag 70.5% #49 of 63 Claim in XGen-7B Technical Report, via Epoch AI
ARC-Challenge 41.1% #59 of 75 Claim in XGen-7B Technical Report, via Epoch AI
PIQA 76.7% #46 of 58 Claim in XGen-7B Technical Report, via Epoch AI
OpenBookQA 38.8% #34 of 41 Claim in XGen-7B Technical Report, via Epoch AI
BoolQ 64.9% #54 of 61 Claim in XGen-7B Technical Report, via Epoch AI
Ko-IFEval (Upstage) 13.4% #21 of 21 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Classic 35.1 #15 of 17 Official leaderboard