Cohere enterprise human evaluation

Dropped

Labs’ own numbers All independent runs

Trained annotators blindly compare two models' answers on enterprise tasks such as HR FAQs, technical FAQs and workplace assistants. They judge accuracy, instruction following and style. Results are win, tie and loss rates.

The Command A post reports six task groups and an average against GPT-4o (November 2024).

Made by: Cohere
Released: March 2025
Kind: Running a business
Level: Everyday
Scored: Ranked by votes
Answers: Open-ended
Tasks: Kept private

Strongest model tested: GPT-4o Nov 2024 #160 on the capability index
Last in a launch post: March 2025, dropped before it saturated
Last model added: April 2025
Scores refreshed: November 12th, 2026

cohere.com

Model scored in lab cards

Launch post lists it, from 1 lab

System card reports it, from 1 lab

Only Cohere Command A has a rating here, from its lab’s own post

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs. A rating ranks a model only against others rated in the same arena at the same time, so these don’t show who leads.

Cohere Command A leads with 51.7% across all independent runs

Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.

Bars Table

51.7 Cohere Command A

1 Cohere Command A 51.7%

Source: Labs’ model cards

1 Cohere Command A 51.7%
2 GPT-4o Nov 2024 33%

Source: Official Cohere enterprise human evaluation leaderboard

#	Model	Score	Setting	Date	Source
1	Cohere Command A	51.7%		Mar 2025	Lab model card

#	Model	Score	Setting	Date	Source
1	Cohere Command A	51.7%		Mar 2025	Official leaderboard
2	GPT-4o Nov 2024	33%		Nov 2024	Official leaderboard

The benchmark's own leaderboard has 2 models. Switch the scores above to rank them together.

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Reported by the lab in its model card Best so far

Sources: Official Cohere enterprise human evaluation leaderboard and labs’ model cards

No launch post has listed it since March 2025

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Cohere

Date	Launch post	Score	As the post writes it
Mar 13, 2025	Cohere Command A	51.7	Head-to-head human evaluation win rate vs GPT-4o (Nov), average of six enterprise task groups (tie 15.3)

One system card reports it

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

Date	Document	Score	As the document writes it	Section
Apr 1, 2025	Cohere Command A technical report		Human pairwise win rate vs GPT-4o, three subsets with no overall (Table 23, Figure 1): General 50.4, Reasoning 51.4, Code 46.8	Capabilities

One lab claim next to the leaderboard

Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 1 of them match, which usually means one side copied the other. Every benchmark.

Model	Lab says	Board says	Gap
Cohere Command A	51.7% Head-to-head human evaluation win rate vs GPT-4o (Nov), average of six enterprise task groups (tie 15.3)	51.7% Leaderboard	Same