Benchmark Almanac

GPT-3 Medium

GPT-3 Medium.

OpenAI Released June 22nd, 2020 Compare with others
3
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenAI Jun 2020

GPT-3 Medium

No Epoch Capabilities Index score yet
  • LMentry 15.4% #9 /9

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
LMentry 15.4% #9 of 9 Official leaderboard
BIG-bench English Proverbs 35.3% #2 of 2 Official leaderboard
BIG-bench Understanding Fables 20.1% #2 of 2 Official leaderboard

Who measured it?

Independent runs cover all 3 of its benchmarks.

  • An independent run only 3
Official leaderboards scored it on 3.

Sources: Official leaderboards, Epoch AI (CC BY 4.0) and labs’ model cards