Benchmark Almanac

Command R+

Command R+.

Cohere Released August 30th, 2024 Compare with others
30
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Cohere Aug 2024

Command R+

Open weights

No Epoch Capabilities Index score yet
  • KOR-Bench 32.7% #26 /33
  • LMCA 5.01% #143 /147
  • BigCodeBench-Hard 13.2% #78 /96

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (2025 dataset) 6.90% #30 of 104 Official leaderboard
WildBench 41.6 #24 of 47 Official leaderboard
MixEval 81.5% #18 of 34 Official leaderboard
Vectara Hallucination Leaderboard (HHEM) 5.40% #100 of 148 Official leaderboard
LMArena (Elo) 1,276 #250 of 335 Official leaderboard
ThaiExam 37.9% #18 of 24 Official leaderboard
SnorkelSpatial 14.2% #21 of 27 Official leaderboard
RewardBench 70.6% #41 of 48 Official leaderboard
LongBench v2 31.6% #31 of 33 Official leaderboard
ChatRAG Bench 50.9 #3 of 3 Official leaderboard

Math and science

BenchmarkScoreRankSource
KOR-Bench 32.7% #26 of 33 Official leaderboard
DTBench 54.9% #152 of 180 Official leaderboard
ChemBench 44.8% #22 of 24 Official leaderboard
SimpleBench 17.4% #104 of 106 Official leaderboard
SnorkelGraph 15% #24 of 24 Official leaderboard

Coding

BenchmarkScoreRankSource
BigCodeBench-Hard 13.2% #78 of 96 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
Berkeley Function Calling Leaderboard (BFCL) 48% #53 of 67 Official leaderboard
ToolComp 30.2% #30 of 32 Official leaderboard

Professional work

BenchmarkScoreRankSource
MedQA 56.7% #54 of 71 Official leaderboard
LegalBench 68.3% #121 of 138 Official leaderboard
SnorkelUnderwrite 25.7% #25 of 27 Official leaderboard

Safety and security

BenchmarkScoreRankSource
SimpleSafetyTests 100% #5 of 75 Official leaderboard
AgentDojo 4.45% #5 of 20 Official leaderboard
Anthropic Red Team 98% #56 of 75 Official leaderboard
HELM Safety 86.0 #62 of 75 Official leaderboard
AIR-Bench 2024 29.3% #81 of 82 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Lite 44.0 #45 of 71 Official leaderboard
LMCA 5.01% #143 of 147 Official leaderboard
Conceptual Reasoning Index 11.6 #147 of 151 Official leaderboard
ACCoRD 18.0 #148 of 152 Official leaderboard