Benchmark Almanac

OPT-1.3B

OPT-1.3B.

Meta Released May 11th, 2022
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta May 2022

OPT-1.3B

Open weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
OpenBookQA 39.8% #31 of 41 Claim in XGen-7B Technical Report, via Epoch AI
WinoGrande 64.7% #60 of 76 Claim in XGen-7B Technical Report, via Epoch AI
HellaSwag 69.9% #51 of 63 Claim in XGen-7B Technical Report, via Epoch AI
PIQA 75.7% #49 of 58 Claim in XGen-7B Technical Report, via Epoch AI
BoolQ 65% #53 of 61 Claim in XGen-7B Technical Report, via Epoch AI
ARC-Challenge 35.8% #67 of 75 Claim in XGen-7B Technical Report, via Epoch AI
MMLU 25.1% #85 of 85 Claim in XGen-7B Technical Report, via Epoch AI