Benchmark Almanac

stablelm-tuned-alpha-7b

stablelm-tuned-alpha-7b.

Released April 19th, 2023 Compare with others
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Apr 2023

stablelm-tuned-alpha-7b

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MT-Bench 2.75 #4 of 5 Official leaderboard
OpenBookQA 32.4% #39 of 41 Claim in XGen-7B Technical Report, via Epoch AI
ARC-Challenge 27% #73 of 75 Claim in XGen-7B Technical Report, via Epoch AI
BoolQ 59% #60 of 61 Claim in XGen-7B Technical Report, via Epoch AI
HellaSwag 40.7% #62 of 63 Claim in XGen-7B Technical Report, via Epoch AI
LMArena (Elo) 953 #335 of 335 Official leaderboard
WinoGrande 51.5% #76 of 76 Claim in XGen-7B Technical Report, via Epoch AI
PIQA 65.8% #58 of 58 Claim in XGen-7B Technical Report, via Epoch AI
FActScore precision 17.3% #2 of 2 Official leaderboard