Benchmark Almanac

Qodo AI Code Review Benchmark

Qodo (code review system, backbone unspecified) 55.4% tops its leaderboard
Not in model cards

Models review real merged pull requests with planted functional bugs and best-practice violations. Findings are matched to the planted issues and scored by F1.

Qodo publishes F1 for seven code review systems. The page does not name their backbone model snapshots.

Made by
Qodo
Released
February 2026
Kind
Fixing real repositories
Level
Expert
Scored
Checked automatically
Answers
Open-ended
Tasks
Kept private
7
Entries on its own leaderboard, 0 models we track

Qodo (code review system, backbone unspecified) tops the leaderboard with 55.4%

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 55.4 Qodo (code review system, backbone unspecified)
  2. 44.1 Augment (code review system, backbone unspecified)
  3. 42.8 Copilot (code review system, backbone unspecified)
  4. 39.3 Cursor (code review system, backbone unspecified)
  5. 39.0 Greptile (code review system, backbone unspecified)
  6. 37.6 Codex (code review system, backbone unspecified)
  7. 28.0 CodeRabbit (code review system, backbone unspecified)
  1. 1 Qodo (code review system, backbone unspecified) 55.4%
  2. 2 Augment (code review system, backbone unspecified) 44.1%
  3. 3 Copilot (code review system, backbone unspecified) 42.8%
  4. 4 Cursor (code review system, backbone unspecified) 39.3%
  5. 5 Greptile (code review system, backbone unspecified) 39%
  6. 6 Codex (code review system, backbone unspecified) 37.6%
  7. 7 CodeRabbit (code review system, backbone unspecified) 28%

Source: Official Qodo AI Code Review Benchmark leaderboard

#EntryScoreSettingDateSource
1 Qodo (code review system, backbone unspecified) 55.4% Official leaderboard
2 Augment (code review system, backbone unspecified) 44.1% Official leaderboard
3 Copilot (code review system, backbone unspecified) 42.8% Official leaderboard
4 Cursor (code review system, backbone unspecified) 39.3% Official leaderboard
5 Greptile (code review system, backbone unspecified) 39% Official leaderboard
6 Codex (code review system, backbone unspecified) 37.6% Official leaderboard
7 CodeRabbit (code review system, backbone unspecified) 28% Official leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Coding

All 282 in Coding
  • SWE-bench Verified In use 500 human-validated GitHub issues from 12 Python repos. Agent writes a patch that must pass hidden tests. Claude Opus 4.7 83.5%
  • LiveCodeBench v6 In use Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. DeepSeek-V4-Pro 93.5%
  • SWE-bench Multilingual In use 300 GitHub-issue tasks across nine programming languages in SWE-bench format. Patch graded by repository tests. Claude Fable 5.2 96.6%
  • DeepSWE In use 113 original long-horizon engineering tasks across 91 repos and five languages, written from scratch. Hand-written verifiers accept alternative solutions. GPT-6 Astra 74.1%
  • SciCode In use Scientist-curated research coding problems split into subproblems across natural sciences. Code checked against test cases. Seed2.1 Pro 59.8%
  • Codeforces rating In use Model solves recent Codeforces contest problems. An Elo-style rating is computed from simulated contest performance. DeepSeek V4.1 Flash 3,471