Benchmark Almanac

SOLAR-10.7B-Instruct-v1.0

SOLAR-10.7B-Instruct-v1.0.

Upstage Released December 12th, 2023 Family SOLAR The lab's model card Compare with others
7
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Upstage Dec 2023

SOLAR-10.7B-Instruct-v1.0

Open weights Small

No Epoch Capabilities Index score yet
  • RewardBench 73.9% #37 /48

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
EQ-Bench v2 73.5 #43 of 85 Official leaderboard
RewardBench 73.9% #37 of 48 Official leaderboard
LMArena (Elo) 1,153 #306 of 335 Official leaderboard

Coding

BenchmarkScoreRankSource
HumanEval 43.3% #36 of 46 Official leaderboard
HumanEval+ 37.2% #36 of 46 Official leaderboard
MBPP 43.9% #33 of 35 Official leaderboard
MBPP+ 36.2% #33 of 35 Official leaderboard