Benchmark Almanac

Qwen1.5-7B-Chat

Qwen1.5-7B-Chat.

Qwen Released February 4th, 2024 Family Qwen1.5 The lab's model card Compare with others
15
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Feb 2024

Qwen1.5-7B-Chat

Open weights Small

No Epoch Capabilities Index score yet
  • Open Arabic LLM Leaderboard v1 43.1% #31 /55
  • ThaiExam 41.6% #16 /24
  • CFBench 46.5% #10 /19

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
CFBench 46.5% #10 of 19 Official leaderboard
Open Arabic LLM Leaderboard v1 43.1% #31 of 55 Official leaderboard
ThaiExam 41.6% #16 of 24 Official leaderboard
AlpacaEval 2.0 14.8% #33 of 47 Official leaderboard
MuSR 37.8% #73 of 98 Official leaderboard
MixEval 71.4% #28 of 34 Official leaderboard
MMLU-Pro 29.1% #184 of 212 Official leaderboard
WildBench 27.4 #41 of 47 Official leaderboard
EQ-Bench v2 54.4 #75 of 85 Official leaderboard
RewardBench 67.5% #44 of 48 Official leaderboard
RepoQA 2.80% #22 of 22 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
GTA 10.6% #8 of 15 Official leaderboard

Safety and security

BenchmarkScoreRankSource
SALAD-Bench 93% #6 of 13 Official leaderboard
SORRY-Bench 39.8% #19 of 23 Official leaderboard

Other

BenchmarkScoreRankSource
Open LLM Leaderboard v2 17.6 #63 of 99 Official leaderboard