Benchmark Almanac

OPT-175B

OPT-175B places in the top three on HellaSwag.

Meta Released May 2nd, 2022 Compare with others
3
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Meta May 2022

OPT-175B

Open weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
HellaSwag 79.1% #3 of 12 Stanford HELM, via Epoch AI

Math and science

BenchmarkScoreRankSource
GSM8K 4.00% #16 of 24 Stanford HELM, via Epoch AI

Other

BenchmarkScoreRankSource
HELM Classic 61.0 #8 of 17 Official leaderboard