Benchmark Almanac

Qwen1.5-14B

Qwen1.5-14B.

Qwen Released February 4th, 2024 Compare with others
15
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Qwen Feb 2024

Qwen1.5-14B

Open weights

No Epoch Capabilities Index score yet
  • Open Arabic LLM Leaderboard v1 41.9% #34 /55
  • AlGhafa 65.7% #16 /39
  • ALRAGE 62.9% #25 /39

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MadinahQA 51.4% #15 of 39 Official leaderboard
AlGhafa 65.7% #16 of 39 Official leaderboard
ArabicMMLU 49.7% #16 of 39 Official leaderboard
MuSR 41.9% #43 of 98 Official leaderboard
Open Arabic LLM Leaderboard v2 52.5% #21 of 39 Official leaderboard
ArbMMLU-HT 38% #22 of 39 Official leaderboard
Open Arabic LLM Leaderboard v1 41.9% #34 of 55 Official leaderboard
ALRAGE 62.9% #25 of 39 Official leaderboard
LMArena (Elo) 1,191 #288 of 335 Official leaderboard
CFBench 22.8% #17 of 19 Official leaderboard
Ko-IFEval (Upstage) 25.8% #19 of 21 Official leaderboard

Professional work

BenchmarkScoreRankSource
MedQA 51.5% #59 of 71 Official leaderboard

Safety and security

BenchmarkScoreRankSource
AraTrust 64.3% #26 of 39 Official leaderboard

Other

BenchmarkScoreRankSource
Open LLM Leaderboard v2 20.9 #54 of 99 Official leaderboard
HELM Lite 42.5 #47 of 71 Official leaderboard