Benchmark Almanac

Claude Fable 5.1

Claude Fable 5.1 ranks first on 31 of the 334 benchmarks with five or more models scored.

Anthropic Released September 1st, 2026 Family Claude 5.1 The lab's model card Compare with others
342
Benchmarks with a score
31
Ranked first, out of five or more models
113
In the top three
Anthropic Sep 2026

Claude Fable 5.1

Closed weights Flagship

167.0 #7 of 256
Epoch Capabilities Index
Self-Reported Index 167.9 #8 of 404
  • Humanity's Last Exam 46.5% #2 /47
  • AutomationBench 22.4% #15 /42
  • Terminal-Bench 4.0 57.9% #6 /40

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Longform Creative Writing (EQ-Bench) 85.3 #2 of 119 Official leaderboard
Lech Mazur Creative Writing 3.75 #1 of 50 Official leaderboard
LMArena (Elo) 1,503 #7 of 335 Official leaderboard
Creative Writing v3 81.3 #5 of 120 Official leaderboard
Humanity's Last Exam 46.5% #2 of 47 Official leaderboard
BullshitBench V2 86.5% #6 of 129 Official leaderboard
Document Arena 1,498 #2 of 39 Official leaderboard
Hemingway-bench 1,095 #3 of 42 Official leaderboard
DesignArena ASCII Art 1,318 #6 of 77 Official leaderboard
BullshitBench 71.7% #9 of 107 Official leaderboard
SimpleQA Verified 70.8% #8 of 94 Epoch AI run
HANDBOOK.md 47.1% #3 of 16 Official leaderboard
Last Translation Benchmark 32.9 #7 of 36 Official leaderboard
AA-LCR Extended 73% #10 of 49 Official leaderboard
Global MMLU 94% #3 of 14 Lab model card
StudyArena Text 1,263 #19 of 85 Official leaderboard
Extended NYT Connections 90% #24 of 103 Official leaderboard
Joke Arena 1,545 #6 of 25 Official leaderboard
Antidote 1,065 #9 of 36 Official leaderboard
MILU 93% #3 of 11 Lab model card
HLE-Diamond 55.1% #7 of 20 Official leaderboard
ELI5 Arena 1,567 #7 of 18 Official leaderboard
Corp Speak Arena 1,541 #10 of 22 Official leaderboard
ComplexConstraints 60.4% #9 of 15 Official leaderboard
Kimi Hallu Bench 11.4% #4 of 6 Official leaderboard

Math and science

BenchmarkScoreRankSource
ProofBench v1.1 100% #1 of 52 Official leaderboard
OTIS Mock AIME 2024-2025 100% #5 of 212 Epoch AI run
DTBench 97.6% #5 of 180 Official leaderboard
SimpleBench 86.6% #5 of 106 Official leaderboard
FrontierMath Tiers 1-3 v2 90.2% #7 of 86 Official leaderboard
ARC-AGI-2 90% #9 of 98 Official leaderboard
BixBench3 51.5 #2 of 20 Official leaderboard
BioMysteryBench 90.3% #1 of 10 Lab model card
LatchBio Capabilities v1.0 53% #3 of 27 Official leaderboard
ArXivMath 91.3% #1 of 9 Lab model card
ARC-AGI 97.5% #12 of 95 Official leaderboard
FrontierMath Tier 4 v2 87.8% #9 of 68 Official leaderboard
EurekaBench 29.8 #1 of 7 Official leaderboard
SpatialBench (LatchBio) 77.6% #1 of 7 Lab model card
ForecastBench 0.12 #13 of 82 Official leaderboard
MysteryMechanism 47.8% #5 of 31 Official leaderboard
SciUniverse 45.3% #1 of 6 Official leaderboard
Terminal-Bench-Science 40% #3 of 17 Official leaderboard
scBench (LatchBio SingleCellBench) 60.5% #5 of 26 Official leaderboard
PaperBenchX 12.9% #2 of 10 Official leaderboard
Prophet Arena 86.0 #5 of 24 Official leaderboard
FrontierPhysics 11.3% #6 of 22 Official leaderboard
ScholarCatalyst 53% #1 of 3 Official leaderboard
Leipzig Benchmark 79% #7 of 19 Official leaderboard
Riemann-bench 71.2% #8 of 20 Official leaderboard
Organic Chemistry V2 (Anthropic) 69.2% #1 of 2 Lab model card
CritPt 72% #7 of 11 Official leaderboard
CritPt v2 72% #7 of 11 Official leaderboard
FrontierMath Erdős 0% #13 of 15 Official leaderboard

Coding

BenchmarkScoreRankSource
WeirdML 92.9% #3 of 112 Official leaderboard
GSO-Bench 88.2% #1 of 30 Official leaderboard
DesignArena Data Visualization 1,346 #4 of 118 Official leaderboard
SWE Atlas Test Writing 67% #1 of 22 Official leaderboard
SWE-Together 69.3% #1 of 22 Official leaderboard
ALE-Bench 2,849 #6 of 126 Official leaderboard
WebDev Arena 1,758 #5 of 105 arena.ai, via Epoch AI
PostTrainBench 1.2 44.6% #1 of 21 Official leaderboard
SWE-Bench Pro 81.2% #4 of 81 Lab model card
Image-to-WebDev Arena 1,724 #3 of 55 Official leaderboard
Code Arena 1,742 #7 of 128 Official leaderboard
DesignArena Frontend Web App 1,315 #3 of 53 Official leaderboard
Vibe Code Bench 90.3% #7 of 120 Official leaderboard
APEX-SWE 63.6% #4 of 65 Official leaderboard
MLS-Bench 50.3% #1 of 15 Official leaderboard
DesignArena Agentic Overall 1,327 #5 of 74 Official leaderboard
SWE-bench Multilingual 89.1% #5 of 73 Lab model card
DesignArena Game Dev 1,365 #10 of 143 Official leaderboard
ReactBench 49.2% #2 of 28 Official leaderboard
Next.js Agent Evals 100% #1 of 14 Official leaderboard
DesignArena 3D Design 1,391 #10 of 136 Official leaderboard
MirrorCode 93.3% #3 of 39 Epoch AI run
ProgramBench 9.00% #2 of 25 Official leaderboard
DesignArena Full Stack 1,304 #4 of 49 Official leaderboard
DesignArena Godot Game Dev 1,307 #2 of 24 Official leaderboard
DesignArena Code 1,331 #13 of 143 Official leaderboard
SWE Atlas 60% #2 of 22 Official leaderboard
TasteVal 171.6× #2 of 20 Official leaderboard
SWE Atlas Codebase QnA Extended 38% #4 of 38 Official leaderboard
SWE Atlas v1.1 76.4% #3 of 28 Official leaderboard
DesignArena UI Component 1,333 #15 of 139 Official leaderboard
Vals RSI Index 0.36 #3 of 27 Official leaderboard
SWE-Bench Pro V2 Hard 92.2% #2 of 18 Official leaderboard
DesignArena Website 1,306 #17 of 151 Official leaderboard
DesignArena SVG 1,294 #12 of 103 Official leaderboard
SWE Atlas Refactoring 56.7% #2 of 17 Official leaderboard
ProgramBench almost solved 55.5% #3 of 25 Official leaderboard
DesignArena Image to Frontend 1,260 #4 of 31 Official leaderboard
IOI v2 (Vals) 90.8% #6 of 45 Official leaderboard
Code Migration 54.6% #11 of 78 Official leaderboard
DesignArena React Native 1,256 #8 of 56 Official leaderboard
DAXBench v2 90.7% #7 of 47 Official leaderboard
Vibe Code Bench 1-100 28% #4 of 26 Official leaderboard
SWE-Bench Pro V2 99.1% #3 of 18 Official leaderboard
AutoResearchExam 0.60 #2 of 12 Official leaderboard
TestPrism 28% #1 of 6 Official leaderboard
SWE-bench CLI 14.5% #3 of 16 Official leaderboard
ProgramBench tests passed 82.5% #5 of 25 Official leaderboard
DAYJOB: Data Science 26% #3 of 15 Official leaderboard
WeirdML v3 26% #6 of 27 Official leaderboard
RSI-Exam 48.1% #4 of 18 Official leaderboard
MiMo Visual Coding 74.4% #2 of 9 Official leaderboard
FrontierSWE 56.3% #6 of 25 Official leaderboard
DeepRSI 1,548 #2 of 8 Official leaderboard
LibraryDesignBench 47.5 #2 of 8 Official leaderboard
Senior SWE-Bench 34.7% #6 of 23 Official leaderboard
Chart Arena 1,598 #4 of 15 Official leaderboard
Floorplan Arena 1,713 #3 of 11 Official leaderboard
sudo L7 32.2% #5 of 18 Official leaderboard
FrontierCode 2.0 34% #9 of 32 Official leaderboard
CursorBench 51.8% #6 of 21 cursor.com, via Epoch AI
SlopCodeBench 27.6% #7 of 22 Official leaderboard
CursorBench 4.0 51.8% #7 of 21 Official leaderboard
Real-SWE 1.1 45.6% #5 of 15 Official leaderboard
SWE-Clar 60% #3 of 9 Official leaderboard
SWE-bench Verified Extended 61.3% #16 of 44 Official leaderboard
Snorkel Agentic Coding 2.0 39.6% #6 of 16 Official leaderboard
SWE-sweep 2.90% #4 of 10 Official leaderboard
Web Clone Bench 13.3% #4 of 10 Official leaderboard
SWE-bench Multimodal 54.7% #5 of 12 Lab model card
FrontierCS 2 35.4% #8 of 19 Official leaderboard
Landing Page Arena 1,556 #6 of 14 Official leaderboard
DesignArena Image to HTML 1,213 #22 of 51 Official leaderboard
FrontierCode 1.1 50.9% #6 of 13 Lab model card
DeepSWE 67.4% #26 of 56 Lab model card
Android Bench 2.0 22.7% #8 of 17 Official leaderboard
SWE-Marathon v1.1 45.6% #10 of 20 Official leaderboard
OWE-Bench 29.1% #7 of 14 Official leaderboard
Kimi Code Bench 3.0 Long-horizon 58.8% #3 of 6 Official leaderboard
CursorBench 3.2 73.4% #1 of 2 Lab model card
OpenDesign Arena 80.3 #14 of 21 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
LisanBench 15100.3 #6 of 133 Official leaderboard
OSWorld 2.0 77.9% #1 of 19 Lab model card
ApprenticeBench 72% #1 of 18 Official leaderboard
DuelLab GameBench 2 94.0 #4 of 57 Official leaderboard
MCP Atlas 87.2% #3 of 37 Official leaderboard
Agent Arena 14.8% #5 of 56 Official leaderboard
OSWorld-Science 73.7% #1 of 11 Official leaderboard
BrowseComp Extended 63.3% #4 of 42 Official leaderboard
Game Arena Nine Men's Morris 1,001 #4 of 39 Official leaderboard
Game Arena Go 1,601 #5 of 39 Official leaderboard
Game Arena Poker 17.9 #4 of 31 Official leaderboard
Mystery Game Puzzles 58% #11 of 84 Epoch AI run
RuneBench 6.14 #10 of 76 Official leaderboard
Toolathlon-Verified 77.8% #3 of 21 Lab model card
Game Arena Dots and Boxes 1,096 #6 of 40 Official leaderboard
Terminal-Bench 4.0 57.9% #6 of 40 Official leaderboard
Game Arena Four in a Row 608 #7 of 43 Official leaderboard
Terminal-Bench 4.1 57.6% #7 of 43 Official leaderboard
DRACO 87.7% #2 of 12 Lab model card
Game Arena Clobber 519 #7 of 39 Official leaderboard
Game Arena Lines of Action 655 #7 of 39 Official leaderboard
BabaIsBench 100% #6 of 32 Official leaderboard
LMArena Search Arena 1,227 #7 of 37 Official leaderboard
Kaggle Game Arena 417 #8 of 42 Official leaderboard
EBR-bench 57.1% #7 of 31 Epoch AI run
Game Arena Bargaining 224 #9 of 39 Official leaderboard
Time Horizon Index: KSP 63.3% #3 of 13 Official leaderboard
Chess Puzzles 48% #22 of 93 Epoch AI run
Game Arena Checkers 1,086 #10 of 41 Official leaderboard
Game Arena Word Art 1,196 #10 of 39 Official leaderboard
Clocktower Bench 1,595 #3 of 11 Official leaderboard
Game Arena Reversi 743 #11 of 39 Official leaderboard
Game Arena Ultimate Tic-Tac-Toe 439 #11 of 39 Official leaderboard
Collaborative Intelligence Benchmark 65.3% #6 of 18 Official leaderboard
CUA-bench 13.2% #3 of 9 Official leaderboard
AutomationBench 22.4% #15 of 42 Official leaderboard
Realtime-Bench 16.7% #4 of 8 Official leaderboard
Game Arena Dark Hex 252 #22 of 41 Official leaderboard
Game Arena Chess 761 #23 of 42 Official leaderboard
StarSkirmish Bench 37.2% #5 of 9 Official leaderboard
Game Arena Coin Game 330 #22 of 39 Official leaderboard
BU Bench V2.1 72.0 #10 of 16 Official leaderboard
SpireClimb 2.00% #7 of 9 Epoch AI run
SpireClimb StS1 A20 Heart 0% #7 of 9 Official leaderboard
SpireClimb StS2 A10 4.00% #7 of 9 Official leaderboard
Terminal-Bench 2.1 Extended 19.5% #37 of 44 Official leaderboard
FocusBench (Meta) 36.6% #5 of 5 Official leaderboard
OSWorld 2.0 (Aug 2026) 77.9% #1 of 1 Lab model card

Professional work

BenchmarkScoreRankSource
Excel Modeling Benchmark 76.7% #1 of 76 Official leaderboard
LegalBench 88.5% #2 of 138 Official leaderboard
EnterpriseBench: CoreCraft 77.4% #1 of 51 Official leaderboard
MedScribe 91.3% #2 of 97 Official leaderboard
MortgageTax 70.8% #2 of 87 Official leaderboard
DesignArena Spreadsheet 1,400 #1 of 35 Official leaderboard
Legal Research Bench 55.3% #3 of 93 Official leaderboard
Tax Agent Bench 50.8% #3 of 84 Official leaderboard
Public Benefits Bench 74.9% #2 of 50 Official leaderboard
Immigration Bench 75.4% #1 of 25 Official leaderboard
Vals Index v2 68.8% #3 of 65 Official leaderboard
Excel Modeling Benchmark v1.1 76.7% #2 of 42 Official leaderboard
YC-Bench $3,199,375 #3 of 59 Official leaderboard
FrontierFinance 55.9% #1 of 17 Official leaderboard
Tuesday Work Index 72.4 #3 of 44 Official leaderboard
TaxEval v2 76% #9 of 129 Official leaderboard
GDPval-AA v2 1,853 #2 of 27 Lab model card
$OneMillion-Bench 42.1% #1 of 13 Official leaderboard
RealmPathology 78% #1 of 13 Official leaderboard
DAYJOB: Healthcare 31.2% #3 of 37 Official leaderboard
Vals Index v2.1 65.8% #4 of 49 Official leaderboard
MedCode 53.5% #8 of 96 Official leaderboard
FoodTruck Bench $62,732 #5 of 59 Official leaderboard
MedXpertQA MM Extended 66% #4 of 41 Official leaderboard
Vals Finance Agent v2 58.9% #8 of 80 Official leaderboard
Genspark Slides Benchmark 83.6% #1 of 10 Official leaderboard
DAYJOB: Finance 36.5% #4 of 39 Official leaderboard
DesignArena Python-PPTX Slides 1,308 #4 of 36 Official leaderboard
LMBuild 65.9% #2 of 18 Official leaderboard
APEX-1 73.8% #8 of 71 Official leaderboard
APEX-Agents 68.6% #7 of 61 Collected by Epoch AI, source not named
APEX-Accounting 66.7% #6 of 49 Official leaderboard
DAYJOB: Tax 9.60% #2 of 15 Official leaderboard
DesignArena HTML Slides 1,395 #4 of 28 Official leaderboard
Holdings-IndividualTaxBench 75.5% #2 of 13 Official leaderboard
PolicyBench 90.8% #8 of 50 Official leaderboard
GDPval Extended 3.80% #7 of 43 Official leaderboard
Epoch Automation Reports 65.3% #1 of 6 Official leaderboard
Legora BAR 104.0 #3 of 17 Official leaderboard
ATLAS-Finance 10.3% #2 of 11 Official leaderboard
ATLAS-Finance v1.1.0 10.3% #2 of 11 Official leaderboard
APEX-Agents 1.1 77.1% #12 of 65 Official leaderboard
PRBench 51.6% #9 of 48 Official leaderboard
Digital Work Index 23.6 #3 of 16 Official leaderboard
GDP.xlsx 23.1% #4 of 20 Official leaderboard
Thrive Holdings helpdesk ticket resolution benchmark 55.8% #3 of 15 Official leaderboard
LegalReasonBench 50.6% #2 of 10 Official leaderboard
Build-A-Chip-Bench 16.6% #1 of 5 Official leaderboard
Remote Labor Index 17.9% #4 of 19 Official leaderboard
OfficeQA 80.2% #3 of 14 Lab model card
OfficeQA Pro 69% #4 of 16 Lab model card
SnorkelFinance 2.0 19.6% #4 of 16 Official leaderboard
SnorkelRevOps 14% #4 of 16 Official leaderboard
Clipping Bench $1,068 #5 of 19 Official leaderboard
Parametric CAD Bench 56.8% #3 of 11 Official leaderboard
WorkplaceAgents 15.8% #4 of 14 Official leaderboard
AA-Briefcase 1,694 #2 of 7 Lab model card
DAYJOB: Accounting 27.2% #5 of 17 Official leaderboard
GDPx 8.53% #6 of 20 Official leaderboard
DeepFinance 45.6% #7 of 23 Official leaderboard
CAD Arena 0.66 #4 of 12 Official leaderboard
FrontierCAD Assemblies 0.62 #2 of 6 Official leaderboard
FrontierCAD Parts 0.58 #2 of 6 Official leaderboard
TaxCalcBench v2 58% #12 of 32 Official leaderboard
DAYJOB: Law 26.5% #6 of 16 Official leaderboard
HealthBench 60% #12 of 31 Lab model card
MBABench 2.0 7.90% #2 of 5 Official leaderboard
Harvey LAB (Legal Agent Benchmark) 6.67% #33 of 80 Official leaderboard
EEBench 56.4% #13 of 30 Official leaderboard
Vending-Bench Arena $5,719 #14 of 32 Official leaderboard
SnorkelLegal 35.9% #7 of 16 Official leaderboard
SnorkelManufacturing 11.3% #7 of 16 Official leaderboard
SnorkelUnderwrite 2.0 24% #7 of 16 Official leaderboard
HealthBench Professional 62.1% #12 of 26 Lab model card
PharmaBench (micro1) 12.8% #6 of 13 Official leaderboard
Vending-Bench 2 $5,422 #31 of 67 Official leaderboard
MissionReport 63.3% #5 of 10 Official leaderboard
HW-Bench 23% #8 of 15 Official leaderboard
RWE-bench 7.00% #8 of 15 Official leaderboard
micro1 Medical Index 68.2% #5 of 8 Official leaderboard
LifeSci Diamond 1.80% #14 of 18 Official leaderboard
BenchCAD 2.0 30% #4 of 5 Official leaderboard
BenchCAD 2.1 44.4% #4 of 5 Official leaderboard
BenchCAD 43.7% #9 of 11 Lab model card

Vision, audio and robotics

BenchmarkScoreRankSource
ParseBench 77.8% #2 of 44 Official leaderboard
InteractiveBench 41.7% #1 of 12 Official leaderboard
ArtifactArena 1,310 #2 of 21 Official leaderboard
Vision Arena 1,289 #13 of 136 Official leaderboard
Chartography 46.2% #5 of 43 Official leaderboard
MineBench 1,909 #11 of 75 Official leaderboard
MMMU-Pro Extended 47.6% #6 of 38 Official leaderboard
Drone-Bench 91.2% #3 of 19 Official leaderboard
4DCodeBench 0.74 #3 of 16 Official leaderboard
GeoBench 84% #10 of 48 Official leaderboard
Blueprint-Bench 2 41.9% #8 of 38 Official leaderboard
ClockBench 59.4% #8 of 37 Official leaderboard
ScienceVision 0.46 #3 of 12 Official leaderboard
Furniture Assembly Benchmark 70% #9 of 35 Official leaderboard
Humanity's Sixth Sense 40.8% #9 of 34 Official leaderboard
GDP.pdf 49.4% #6 of 19 Official leaderboard
Roboharm 20% #1 of 3 Official leaderboard
CharXiv Extended 82.2% #14 of 38 Official leaderboard
Code2Video Benchmark 1,536 #8 of 19 Official leaderboard
Code2Video Arena 1,527 #6 of 13 Official leaderboard
GlobeBench 21.6% #10 of 19 Official leaderboard
Dual-Arm Sim 37.8 #6 of 11 Official leaderboard
Robo-bench 5.83% #5 of 7 Official leaderboard
Pantograph frontier-LLM robot benchmark (Pandroid) 15% #2 of 2 Official leaderboard

Safety and security

BenchmarkScoreRankSource
nocot-bench (NCRI) 128.0 #5 of 185 Official leaderboard
Single-turn benign request evaluations (Anthropic) 0% #1 of 19 Lab model card
OncologyBench 44% #2 of 30 Official leaderboard
EpiBench 31.8% #2 of 27 Official leaderboard
MetagenomicsBench 61.7% #2 of 26 Official leaderboard
TxBench-Oligo-Discovery 54.9% #3 of 30 Official leaderboard
BioSecBench-Function 49% #3 of 27 Official leaderboard
PCT (Polarized Contrastive Pairs) 33.4% #6 of 46 Official leaderboard
TxBench-Antibody-Discovery 63.3% #4 of 30 Official leaderboard
Prompt injection robustness against adaptive attackers, computer use (Anthropic) 0.07% #2 of 14 Lab model card
AI Wellbeing Index percent positive experiences 77.3% #1 of 6 Official leaderboard
FORTRESS 13.7% #13 of 73 Official leaderboard
Gray Swan IPI Arena benchmark 0.10% #2 of 11 Lab model card
BBQ (Bias Benchmark for QA) 89.9% #5 of 25 Lab model card
Cyber harm coverage (Anthropic) 100% #1 of 5 Lab model card
SRE-Bench 22.9% #9 of 35 Official leaderboard
Virology Capabilities Test (VCT) 58% #8 of 31 Lab model card
BioSecBench-Surveillance 49% #7 of 27 Official leaderboard
Anthropic political even-handedness eval 98.3% #4 of 14 Lab model card
Malicious use of Claude Code (Anthropic) 90.3% #5 of 17 Lab model card
Biopharma Bench 57.4% #4 of 13 Official leaderboard
KORA 57.5% #13 of 42 Official leaderboard
TxBench-Preclinical-Pharmacology 59.7% #10 of 30 Official leaderboard
scBench-Long 25.6% #9 of 27 Official leaderboard
VariantBench 40.7% #9 of 27 Official leaderboard
BrowseSafe++ 86.5% #6 of 15 Official leaderboard
CheatBench 45.8% #4 of 10 Official leaderboard
CyberBench v1.1 (Vals) 70.4% #20 of 44 Official leaderboard
SpatialBench-Long 29.8% #13 of 27 Official leaderboard
DistressBench 71.5% #21 of 42 Official leaderboard
CWE-bench 58% #6 of 12 Official leaderboard
Rewind-attacker cyber adversarial robustness (Anthropic) 4.50% #3 of 6 Lab model card
Malicious computer use (Anthropic) 85.7% #9 of 14 Lab model card
Prompt injection robustness against adaptive attackers, browser use (Anthropic) 2.64% #9 of 13 Lab model card
Suicide Memory Bench 0.63 #9 of 12 Official leaderboard
WellnessBench 51% #9 of 12 Official leaderboard
BioSecBench-Refusal 5.60% #17 of 22 Official leaderboard
Perceptual Attacks on Embodied AI (Robocurve) 40% #4 of 5 Official leaderboard
Prompt injection robustness against adaptive attackers, coding (Anthropic) 9.26% #12 of 14 Lab model card
Single-turn harmful request evaluations (Anthropic) 94.7% #17 of 19 Lab model card
Secure and defensive coding (Anthropic) 1.03% #2 of 2 Lab model card
Gray Swan Shade knowledge elicitation through chat 1.00% #1 of 1 Lab model card

Other

BenchmarkScoreRankSource
Conceptual Reasoning Index 74.7 #4 of 151 Official leaderboard
LMCA 65.5% #4 of 147 Official leaderboard
ACCoRD 83.7 #6 of 152 Official leaderboard
CAIS Risk Index 30.3 #4 of 67 Official leaderboard
LiveBench 84% #3 of 31 Official leaderboard
CAIS Text Capabilities Index 55.6 #7 of 68 Official leaderboard
CAIS Vision Capabilities Index 68.9 #7 of 53 Official leaderboard
SAGE (Vals) 48.5% #27 of 81 Official leaderboard
Xbench 24.9 #12 of 17 Official leaderboard

Its lab's numbers put it at 167.9, in line with its ECI

The Self-Reported Index fits one score to the 28 capability results Anthropic reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 164.3 to 171.4. How we compute it.

Its lab's numbers next to 12 leaderboards

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
GDP.pdf 85.4% GDP.pdf mean criteria pass rate, no tools, Claude Opus 4.7 judge; 85.1% with tools (8.14.4) 49.4% Leaderboard, adaptive/max +36 pts
Humanity's Last Exam 65% Multidisciplinary reasoning Humanity's Last Exam (with tools) 46.5% Leaderboard, xhigh +19 pts
Terminal-Bench-Science 52.6% Agentic scientific research Terminal-Bench-Science 0.1 40% Leaderboard, max, Claude Code +13 pts
Harvey LAB (Legal Agent Benchmark) 19.1% Legal Agent Benchmark (Harvey LAB), all-pass rate on 1,235 public problems, max effort, internal harness, mean criterion pass rate 90.81%; held-out set run by Artificial Analysis 16.7% all-pass at xhigh (8.15.2) 6.67% Leaderboard +12 pts
AutomationBench 31.4% Business workflows AutomationBench 22.4% Leaderboard, max +9.0 pts
ProgramBench tests passed 87.6% ProgramBench hidden test pass rate on 166 tasks, single agent, mini-swe-agent harness, no time limit (8.11.1) 82.5% Leaderboard, xhigh, mini-SWE-agent +5.1 pts
Chartography 42.6% Chartography, no tools, adaptive thinking max effort, 5 runs; 86.2% with tools (8.14.1) 46.2% Leaderboard, adaptive/max −3.6 pts
Terminal-Bench 4.0 55.8% Terminal-Bench 4.0, Claude Code --bare mode, max effort, 15 trials per task; Table 8.1.A rounds to 56% (Mythos 5.1 61%) (8.6) 57.9% Leaderboard, max, Claude Code −2.1 pts
scBench (LatchBio SingleCellBench) 61.9% LatchBio SingleCellBench, Mythos 5.1 60.5% Leaderboard, published v1; LSVP, Pi +1.4 pts
FrontierSWE 57% FrontierSWE v2, mean score 0.57 on a 0 to 1 scale, max effort, Proximal harness, 5 trials per task (8.5) 56.3% Leaderboard, mean@5, proximus +0.7 pts
ARC-AGI 97.5% ARC-AGI-1 97.5% Leaderboard, max Same
ARC-AGI-2 90% ARC-AGI-2 90% Leaderboard, max Same

Anthropic's models over time

Anthropic's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Claude Fable 5.2 Claude Haiku 5.5 Claude Sonnet 4.6 Claude Haiku 4.5 Claude 3.7 Sonnet Claude 3.5 Haiku Claude 3.5 Sonnet (October 2024) 50 100 150 2023 2024 2025 2026 2027 Claude Fable 5.2 Claude Haiku 5.5

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 49 of them aren't in the launch post.