Benchmark Almanac

Harvey

We track 6 benchmarks that Harvey made or helped make.

2 in use 4 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Harvey LAB (Legal Agent Benchmark) Agent works through legal matter files across 24+ practice areas and produces work product. Expert rubric, task passes only if every criterion passes. Law May 2026 25.4% In use
BigLaw Bench Models review legal documents and receive rubric scores for substantive accuracy and editing quality. Law Apr 2026 91% Fading
Harvey LAB v1.1 (HLAB-Vals-1.1) Agents produce legal work product from matter files with file tools and docx, pptx and xlsx skills. A task passes only if every expert rubric criterion passes. Law Oct 2026 27.1% In use
LAB: Contracts 500 in-house contracting tasks (drafting, redlines, issues lists, escalation memos) across 10 contract categories. All-pass expert-rubric grading. Law Jun 2026 Not in cards
LAB: Diligence Agent researches a synthetic M&A virtual data room (thousands of documents, up to ~80M tokens) and drafts a diligence memo scored against planted-issue rubric criteria. Law Jul 2026 Not in cards
LAB: US Case Law Agents draft a litigation brief for the same party and motion as a real filed federal brief, from the case record. Model judges compare briefs pairwise and wins become Elo ratings. Law Oct 2026 Not in cards