- Vals Index 68.9
- AutomationBench (Score) 51.3
- Vals Finance Agent v2 65.4
- Harvey's Legal Agent Benchmark 19.6
- DeepSWE v1.1 77.9
- FrontierSWE v2 55
- Vibe Code Bench 91.9
- Terminal-bench 4.0 57.4
- PostTrainBench (ML engineering) 45.3
- Terminal-Bench Science 0.1 57.6
- LABBench 2 88.8
- RiemannBench 76
- Best of GraphWalks, Up to 128k, BFS (F1) / GraphWalks, 256k to 1M, BFS (F1) 99.7
- Agent's Last Exam (Pass rate) 39.5
- OSWorld-2.0 (Offline subset, Partial score) 69.2
- Chartography 71.6
- LVBench 91.7
- CWE-bench v1 (Cybersecurity row of headline table) 68
Gemini 4 Argon
Gemini 4 Argon ranks first on 41 of the 297 benchmarks with five or more models scored.
Gemini 4 Argon
Closed weights Flagship
- AutomationBench 51.3% #3 /42
- MultiChallenge 78.7% #2 /42
- GPQA Diamond 96.4% #2 /229
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LMArena (Elo) | 1,522 | #2 of 335 | Official leaderboard | |
| Extended NYT Connections | 98.6% | #2 of 103 | Official leaderboard | |
| MultiChallenge | 78.7% | #2 of 42 | Official leaderboard | |
| SimpleQA Verified | 75.6% | #3 of 56 | Official leaderboard | |
| ELI5 Arena | 1,691 | #1 of 18 | Official leaderboard | |
| AA-LCR Extended | 74.7% | #3 of 49 | Official leaderboard | |
| Global MMLU Lite | 95.4% | #3 of 43 | Official leaderboard | |
| GraphWalks | 99.7% | #2 of 27 | Lab model card | |
| Last Translation Benchmark | 40.9 | #3 of 36 | Official leaderboard | |
| AA-Omniscience | 42.4 | #1 of 10 | Lab model card | |
| Longform Creative Writing (EQ-Bench) | 80.9 | #13 of 119 | Official leaderboard | |
| ComplexConstraints | 70.3% | #2 of 15 | Official leaderboard | |
| Creative Writing v3 | 77.8 | #24 of 120 | Official leaderboard | |
| BullshitBench V2 | 66% | #28 of 129 | Official leaderboard | |
| FACTS Multimodal | 54.2% | #5 of 23 | Official leaderboard | |
| FACTS Benchmark Suite | 72.4% | #6 of 23 | Official leaderboard | |
| FACTS Parametric | 71.5% | #12 of 45 | Official leaderboard | |
| HLE-Diamond | 56.9% | #6 of 20 | Official leaderboard | |
| HANDBOOK.md | 36.6% | #5 of 16 | Official leaderboard | |
| StudyArena Text | 1,247 | #27 of 85 | Official leaderboard | |
| Lech Mazur Creative Writing | 0.72 | #16 of 50 | Official leaderboard | |
| FACTS Search V2 | 84% | #7 of 21 | Official leaderboard | |
| FACTS Parametric V2 | 72.2% | #10 of 27 | Official leaderboard | |
| EQ-Bench 4 | 1,236 | #12 of 32 | Official leaderboard | |
| FACTS Grounding v2 | 73.3% | #10 of 25 | Official leaderboard | |
| Opening Lines Arena | 1,519 | #7 of 15 | Official leaderboard | |
| Corp Speak Arena | 1,498 | #12 of 22 | Official leaderboard | |
| Joke Arena | 1,500 | #14 of 25 | Official leaderboard | |
| FACTS Grounding | 79% | #11 of 15 | Lab model card | |
| Vectara Hallucination Leaderboard (2025 dataset) | 12.1% | #82 of 104 | Official leaderboard | |
| Grounding with citations, sentence unfactual rate | 8.20% | #1 of 1 | Lab model card | |
| Long-context grounding, sentence unfactual rate | 6.40% | #1 of 1 | Lab model card | |
| Multi-hop search factuality | 94.3% | #1 of 1 | Lab model card | |
| Temporal reasoning with search | 11.8% | #1 of 1 | Lab model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GPQA Diamond | 96.4% | #2 of 229 | Epoch AI run | |
| SimpleBench | 91.7% | #3 of 106 | Official leaderboard | |
| DTBench | 97.6% | #6 of 180 | Official leaderboard | |
| BixBench3 | 52.3 | #1 of 20 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 100% | #12 of 212 | Epoch AI run | |
| ARC-AGI | 98.5% | #6 of 95 | Official leaderboard | |
| ARC-AGI-2 | 91.3% | #7 of 98 | Official leaderboard | |
| Human Behavior Bench | 80.6 | #1 of 11 | Official leaderboard | |
| LatchBio Capabilities v1.0 | 52.4% | #4 of 27 | Official leaderboard | |
| ProofBench v1.1 | 99% | #8 of 52 | Official leaderboard | |
| FrontierMath Tiers 1-3 v2 | 86% | #14 of 86 | Official leaderboard | |
| Prophet Arena | 86.0 | #4 of 24 | Official leaderboard | |
| FrontierMath Tier 4 v2 | 78% | #13 of 68 | Official leaderboard | |
| MysteryMechanism | 45.5% | #7 of 31 | Official leaderboard | |
| BioMysteryBench | 76.3% | #7 of 30 | Official leaderboard | |
| ArXivLean | 39.6% | #2 of 7 | Official leaderboard | |
| Science's Last Exam | 32.7 | #3 of 9 | Official leaderboard | |
| ArXivMath | 84.4% | #2 of 6 | Official leaderboard | |
| LABBench2 | 88.8% | #1 of 3 | Lab model card | |
| scBench (LatchBio SingleCellBench) | 59.1% | #9 of 26 | Official leaderboard | |
| Riemann-bench | 74.4% | #7 of 20 | Official leaderboard | |
| FrontierPhysics | 8.30% | #8 of 22 | Official leaderboard | |
| FrontierMath Erdős | 1.47% | #7 of 15 | Official leaderboard | |
| Terminal-Bench-Science | 57.6% | #6 of 12 | Lab model card | |
| CritPt | 72.9% | #6 of 11 | Official leaderboard | |
| CritPt v2 | 72.9% | #6 of 11 | Official leaderboard | |
| BrokenArXiv | 47.9% | #5 of 6 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DesignArena SVG | 1,335 | #2 of 103 | Official leaderboard | |
| Vibe Code Bench | 91.9% | #3 of 120 | Official leaderboard | |
| Code Migration | 68.2% | #2 of 78 | Official leaderboard | |
| DesignArena Image to Frontend | 1,314 | #1 of 31 | Official leaderboard | |
| DesignArena Agentic Game Dev | 1,265 | #1 of 27 | Official leaderboard | |
| IOI v2 (Vals) | 100% | #2 of 45 | Official leaderboard | |
| DeepSWE | 77.9% | #3 of 56 | Lab model card | |
| ALE-Bench | 2,805 | #7 of 126 | Official leaderboard | |
| DesignArena Image to HTML | 1,271 | #3 of 51 | Official leaderboard | |
| DesignArena Website | 1,317 | #11 of 151 | Official leaderboard | |
| WebDev Arena | 1,680 | #8 of 105 | arena.ai, via Epoch AI | |
| DesignArena Game Dev | 1,362 | #11 of 143 | Official leaderboard | |
| DesignArena Data Visualization | 1,325 | #10 of 118 | Official leaderboard | |
| Code Arena | 1,682 | #11 of 128 | Official leaderboard | |
| ScarfBench | 75.2% | #1 of 11 | Official leaderboard | |
| DesignArena UI Component | 1,336 | #14 of 139 | Official leaderboard | |
| DesignArena Code | 1,327 | #15 of 143 | Official leaderboard | |
| FrontierCS 2 | 54.2% | #2 of 19 | Official leaderboard | |
| DesignArena 3D Design | 1,356 | #15 of 136 | Official leaderboard | |
| SWE-Bench Pro V2 | 99.2% | #2 of 18 | Official leaderboard | |
| SWE-bench CLI | 16.3% | #2 of 16 | Official leaderboard | |
| PostTrainBench | 45.3% | #1 of 7 | Lab model card | |
| RSI-Exam | 49.4% | #3 of 18 | Official leaderboard | |
| SWE-Bench Pro V2 Hard | 92.2% | #3 of 18 | Official leaderboard | |
| SWE Atlas v1.1 | 70.1% | #5 of 28 | Official leaderboard | |
| Floorplan Arena | 1,742 | #2 of 11 | Official leaderboard | |
| Vals RSI Index | 0.30 | #5 of 27 | Official leaderboard | |
| DesignArena Agentic Overall | 1,264 | #14 of 74 | Official leaderboard | |
| DAXBench v2 | 87.5% | #9 of 47 | Official leaderboard | |
| APEX-SWE | 49.2% | #15 of 65 | Official leaderboard | |
| Code Migration v1.1 | 70.8% | #7 of 30 | Official leaderboard | |
| CursorBench | 52.9% | #5 of 21 | cursor.com, via Epoch AI | |
| Snorkel Agentic Coding 2.0 | 41.8% | #4 of 16 | Official leaderboard | |
| DesignArena Blender | 1,378 | #3 of 12 | Official leaderboard | |
| WeirdML v3 | 20.3% | #7 of 27 | Official leaderboard | |
| DesignArena Frontend Web App | 1,245 | #14 of 53 | Official leaderboard | |
| DAYJOB: Data Science | 23.3% | #4 of 15 | Official leaderboard | |
| FrontierSWE | 55% | #7 of 25 | Official leaderboard | |
| CursorBench 4.0 | 52.9% | #6 of 21 | Official leaderboard | |
| Next.js Agent Evals | 100% | #4 of 14 | Official leaderboard | |
| MirrorCode | 58.9% | #13 of 39 | Epoch AI run | |
| PostTrainBench 1.2 | 40.4% | #7 of 21 | Official leaderboard | |
| AutoResearchExam | 0.59 | #4 of 12 | Official leaderboard | |
| Vibe Code Bench 1-100 | 21.2% | #9 of 26 | Official leaderboard | |
| Chart Arena | 1,520 | #6 of 15 | Official leaderboard | |
| Real-SWE 1.1 | 39.2% | #6 of 15 | Official leaderboard | |
| Senior SWE-Bench | 27.7% | #10 of 23 | Official leaderboard | |
| FrontierCode 2.0 | 27.6% | #14 of 32 | Official leaderboard | |
| DeepRSI | 965 | #4 of 8 | Official leaderboard | |
| Android Bench 2.0 | 21.3% | #9 of 17 | Official leaderboard | |
| sudo L7 | 16.1% | #10 of 18 | Official leaderboard | |
| OWE-Bench | 24.1% | #8 of 14 | Official leaderboard | |
| FrontierMemory | 66.7% | #4 of 7 | Official leaderboard | |
| SWE-Marathon v1.1 | 43.8% | #12 of 20 | Official leaderboard | |
| Web Clone Bench | 8.60% | #6 of 10 | Official leaderboard | |
| OpenDesign Arena | 81.2 | #13 of 21 | Official leaderboard | |
| MacroscopeBench | 72.8% | #11 of 16 | Official leaderboard | |
| Landing Page Arena | 1,393 | #13 of 14 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LLM Chess | 1,609 | #3 of 123 | Official leaderboard | |
| MCP Atlas | 90.7% | #1 of 37 | Official leaderboard | |
| RuneBench | 6.91 | #3 of 76 | Official leaderboard | |
| Game Arena Four in a Row | 916 | #2 of 43 | Official leaderboard | |
| BrowseComp Extended | 72% | #2 of 42 | Official leaderboard | |
| Game Arena Word Association | 625 | #2 of 40 | Official leaderboard | |
| Game Arena Reversi | 1,121 | #2 of 39 | Official leaderboard | |
| Game Arena Word Art | 2,447 | #2 of 39 | Official leaderboard | |
| Collaborative Intelligence Benchmark | 82.2% | #1 of 18 | Official leaderboard | |
| AutomationBench | 51.3% | #3 of 42 | Official leaderboard | |
| Kaggle Game Arena | 536 | #3 of 42 | Official leaderboard | |
| Game Arena Clobber | 695 | #3 of 39 | Official leaderboard | |
| Game Arena Lines of Action | 1,067 | #3 of 39 | Official leaderboard | |
| Mystery Game Puzzles | 64% | #8 of 84 | Epoch AI run | |
| Game Arena Dark Hex | 477 | #4 of 41 | Official leaderboard | |
| Game Arena Go | 1,686 | #4 of 39 | Official leaderboard | |
| Game Arena Chess | 1,371 | #5 of 42 | Official leaderboard | |
| DuelLab GameBench 2 | 89.2 | #7 of 57 | Official leaderboard | |
| Game Arena Dots and Boxes | 1,099 | #5 of 40 | Official leaderboard | |
| Game Arena Bargaining | 244 | #5 of 39 | Official leaderboard | |
| Game Arena Nine Men's Morris | 981 | #5 of 39 | Official leaderboard | |
| LisanBench | 7560.3 | #18 of 133 | Official leaderboard | |
| Chess Puzzles | 59% | #13 of 93 | Epoch AI run | |
| ARC-AGI-3 | 97.5% | #4 of 27 | Official leaderboard | |
| Game Arena Coin Game | 458 | #6 of 39 | Official leaderboard | |
| Agent Arena | 10.7% | #9 of 56 | Official leaderboard | |
| EBR-bench | 64.8% | #6 of 31 | Epoch AI run | |
| o11y-bench | 87.5% | #5 of 22 | Official leaderboard | |
| Game Arena Ultimate Tic-Tac-Toe | 477 | #9 of 39 | Official leaderboard | |
| Terminal-Bench 4.0 | 57.4% | #7 of 28 | Lab model card | |
| OSWorld 2.0 | 69.2% | #5 of 19 | Lab model card | |
| Game Arena Checkers | 1,083 | #11 of 41 | Official leaderboard | |
| Time Horizon Index: KSP | 52.5% | #4 of 13 | Official leaderboard | |
| WitnessBench | 17.9% | #4 of 12 | Official leaderboard | |
| StarSkirmish Bench | 39.3% | #3 of 9 | Official leaderboard | |
| CUA-bench | 4.83% | #8 of 9 | Official leaderboard | |
| Search triggering | 88% | #1 of 1 | Lab model card |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vals Finance Agent v2 | 65.4% | #1 of 80 | Official leaderboard | |
| APEX-1 | 81.1% | #1 of 71 | Official leaderboard | |
| APEX-Accounting | 71.5% | #1 of 49 | Official leaderboard | |
| Vals Index v2.1 | 68.9% | #1 of 49 | Official leaderboard | |
| LegalBench | 88.3% | #3 of 138 | Official leaderboard | |
| Harvey LAB v1.1 (HLAB-Vals-1.1) | 27.1% | #1 of 38 | Official leaderboard | |
| MedCode | 58.8% | #3 of 96 | Official leaderboard | |
| APEX-Agents | 82.4% | #2 of 61 | Collected by Epoch AI, source not named | |
| APEX-Agents 1.1 | 87.4% | #3 of 65 | Official leaderboard | |
| GDP.xlsx | 38.3% | #1 of 20 | Official leaderboard | |
| Excel Modeling Benchmark | 75.2% | #4 of 76 | Official leaderboard | |
| Vals Legal Index | 76.8% | #2 of 38 | Official leaderboard | |
| Legal Research Bench | 54.8% | #5 of 93 | Official leaderboard | |
| Tax Agent Bench | 49.2% | #5 of 84 | Official leaderboard | |
| Vending-Bench 2 | $13,718 | #4 of 67 | Official leaderboard | |
| Harvey LAB (Legal Agent Benchmark) | 19.6% | #5 of 80 | Official leaderboard | |
| Digital Work Index | 28.3 | #1 of 16 | Official leaderboard | |
| SnorkelLegal | 46% | #1 of 16 | Official leaderboard | |
| SnorkelRevOps | 18.4% | #1 of 16 | Official leaderboard | |
| GDPval Extended | 6.70% | #3 of 43 | Official leaderboard | |
| WorkplaceAgents | 21.2% | #1 of 14 | Official leaderboard | |
| MedXpertQA MM Extended | 66.7% | #3 of 41 | Official leaderboard | |
| Vals Finance Agent v2.1 | 67.7% | #3 of 40 | Official leaderboard | |
| Vals Finance Index | 66% | #3 of 40 | Official leaderboard | |
| HealthBench Professional | 68.8% | #2 of 26 | Lab model card | |
| CAD Arena | 0.75 | #1 of 12 | Official leaderboard | |
| TaxCalcBench v2 | 79.6% | #3 of 32 | Official leaderboard | |
| Vending-Bench Arena | $13,043 | #3 of 32 | Official leaderboard | |
| HealthBench Hard | 45.4% | #2 of 21 | Lab model card | |
| RCM-Bench-1 | 91.5% | #2 of 20 | Official leaderboard | |
| LegalReasonBench | 50.8% | #1 of 10 | Official leaderboard | |
| MissionReport | 64.1% | #1 of 10 | Official leaderboard | |
| Ivo-micro1 ContractBench | 64% | #1 of 8 | Official leaderboard | |
| Vals Index v2.2 | 69.4% | #5 of 37 | Official leaderboard | |
| YC-Bench | $2,215,137 | #8 of 59 | Official leaderboard | |
| Public Benefits Bench | 69.8% | #7 of 50 | Official leaderboard | |
| DAYJOB: Finance | 30.5% | #6 of 39 | Official leaderboard | |
| Tuesday Work Index | 67.2 | #7 of 44 | Official leaderboard | |
| DesignArena PDF | 1,278 | #6 of 37 | Official leaderboard | |
| MedScribe | 87.4% | #17 of 97 | Official leaderboard | |
| SnorkelManufacturing | 19.5% | #3 of 16 | Official leaderboard | |
| DAYJOB: Healthcare | 23.6% | #7 of 37 | Official leaderboard | |
| Excel Modeling Benchmark v1.1 | 74.8% | #8 of 42 | Official leaderboard | |
| EEBench | 67.1% | #6 of 30 | Official leaderboard | |
| PolicyBench | 88.6% | #13 of 50 | Official leaderboard | |
| Remote Labor Index | 17.1% | #5 of 19 | Official leaderboard | |
| PRBench | 49.4% | #13 of 48 | Official leaderboard | |
| Physical-Engineering's Last Exam | 0.41 | #5 of 18 | Official leaderboard | |
| Bedside Bench | 92.7% | #5 of 17 | Official leaderboard | |
| Agents' Last Exam | 39.5% | #9 of 26 | Lab model card | |
| DeepFinance | 41.4% | #8 of 23 | Official leaderboard | |
| Immigration Bench | 68.1% | #9 of 25 | Official leaderboard | |
| DesignArena Spreadsheet | 1,211 | #13 of 35 | Official leaderboard | |
| RWE-bench | 12% | #7 of 15 | Official leaderboard | |
| GDPx | 7.34% | #10 of 20 | Official leaderboard | |
| SnorkelFinance 2.0 | 15.1% | #8 of 16 | Official leaderboard | |
| SnorkelUnderwrite 2.0 | 23.3% | #8 of 16 | Official leaderboard | |
| Agents' Last Exam v1.1 | 40.2% | #7 of 14 | Official leaderboard | |
| DAYJOB: Accounting | 18% | #9 of 17 | Official leaderboard | |
| DAYJOB: Tax | 3.20% | #8 of 15 | Official leaderboard | |
| DAYJOB: Law | 9.90% | #12 of 16 | Official leaderboard | |
| micro1 Medical Index | 65.2% | #6 of 8 | Official leaderboard | |
| Legora BAR | 99.0 | #13 of 17 | Official leaderboard | |
| PharmaBench (micro1) | 8.60% | #12 of 13 | Official leaderboard | |
| LifeSci Diamond | 0% | #18 of 18 | Official leaderboard | |
| High-risk health scenarios eval | 98.9% | #1 of 1 | Lab model card |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Chartography | 71.6% | #1 of 43 | Official leaderboard | |
| ClockBench | 83.3% | #1 of 37 | Official leaderboard | |
| LVBench | 91.7% | #1 of 31 | Lab model card | |
| MineBench | 2,172 | #3 of 75 | Official leaderboard | |
| GDP.pdf | 53.6% | #1 of 19 | Official leaderboard | |
| vCX Benchmark | 92.6% | #3 of 42 | Official leaderboard | |
| Blueprint-Bench 2 | 54.4% | #3 of 38 | Official leaderboard | |
| Humanity's Sixth Sense | 55.4% | #3 of 34 | Official leaderboard | |
| Audio MC | 58.4% | #2 of 18 | Official leaderboard | |
| OmniParseBench | 95.8 | #1 of 9 | Official leaderboard | |
| RoboDojo-RC Tier 1 | 48.2% | #1 of 9 | Official leaderboard | |
| BVB | 72.7 | #6 of 45 | Official leaderboard | |
| 1H-VideoQA | 87% | #3 of 20 | Official leaderboard | |
| VoxelBench | 2,144 | #9 of 56 | Official leaderboard | |
| Furniture Assembly Benchmark | 72.5% | #8 of 35 | Official leaderboard | |
| Dual-Arm Sim | 49.5 | #3 of 11 | Official leaderboard | |
| Code2Video Arena | 1,547 | #4 of 13 | Official leaderboard | |
| DataCenterBench Tier 1 | 35% | #3 of 9 | Official leaderboard | |
| Code2Video Benchmark | 1,539 | #7 of 19 | Official leaderboard | |
| ScienceVision | 0.43 | #5 of 12 | Official leaderboard | |
| Embodied First Exam | 24.1% | #4 of 9 | Official leaderboard | |
| RoboColiseum | 66.9% | #4 of 9 | Official leaderboard | |
| ExtractBench Pro | 30% | #4 of 7 | Official leaderboard | |
| VibeVideoBench | 3.07 | #7 of 9 | Official leaderboard | |
| Robo-bench | 0.83% | #6 of 7 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| nocot-bench (NCRI) | 151.2 | #2 of 185 | Official leaderboard | |
| Molecular Biology Capabilities Test | 63.2% | #3 of 90 | Official leaderboard | |
| Human Pathogen Capabilities Test v2 (HPCT v2) | 74.6% | #3 of 71 | Official leaderboard | |
| CyScenarioBench | 100% | #1 of 17 | Lab model card | |
| CyberBench v1.1 (Vals) | 77.9% | #3 of 44 | Official leaderboard | |
| Human Pathogen Capabilities Test | 74.2% | #6 of 86 | Official leaderboard | |
| BioSecBench-Surveillance | 59.8% | #2 of 27 | Official leaderboard | |
| BioSimBench | 0.18 | #1 of 12 | Official leaderboard | |
| Suicide Memory Bench | 1.41 | #1 of 12 | Official leaderboard | |
| SRE-Bench | 44.3% | #3 of 35 | Official leaderboard | |
| World-Class Bio | 61.1% | #7 of 74 | Official leaderboard | |
| TxBench-Antibody-Discovery | 63.7% | #3 of 30 | Official leaderboard | |
| TxBench-Preclinical-Pharmacology | 64.7% | #3 of 30 | Official leaderboard | |
| DrugDiscoveryBench | 65.4% | #2 of 20 | Official leaderboard | |
| CheatBench | 8.60% | #1 of 10 | Official leaderboard | |
| CoT-Control | 83.7% | #1 of 9 | Lab model card | |
| VCT-v2 | 57.3% | #3 of 25 | Official leaderboard | |
| GDM Situational Awareness | 90.9% | #1 of 8 | Lab model card | |
| ABC Bench Liquid-Handling Robot | 100% | #5 of 34 | Official leaderboard | |
| EpiBench | 28.9% | #4 of 27 | Official leaderboard | |
| VariantBench | 50.3% | #4 of 27 | Official leaderboard | |
| OncologyBench | 33.3% | #5 of 30 | Official leaderboard | |
| GDM Stealth | 100% | #1 of 6 | Lab model card | |
| BioSecBench-Refusal | 48.7% | #4 of 22 | Official leaderboard | |
| scBench-Long | 28.4% | #5 of 27 | Official leaderboard | |
| BioTIER Refuse | 87.8% | #13 of 69 | Official leaderboard | |
| Perceptual Attacks on Embodied AI (Robocurve) | 0% | #1 of 5 | Official leaderboard | |
| VIALS 2 | 47.2% | #3 of 14 | Official leaderboard | |
| BioSecBench-Function | 44.4% | #7 of 27 | Official leaderboard | |
| PCT (Polarized Contrastive Pairs) | 38.7% | #12 of 46 | Official leaderboard | |
| TxBench-Oligo-Discovery | 51% | #8 of 30 | Official leaderboard | |
| ExploitBench | 87% | #6 of 21 | Lab model card | |
| CWE-bench | 68% | #4 of 12 | Official leaderboard | |
| CWE-bench 2 | 65% | #5 of 14 | Official leaderboard | |
| MetagenomicsBench | 42.3% | #10 of 26 | Official leaderboard | |
| IPI Bench | 12.6% | #3 of 6 | Official leaderboard | |
| Chem / Bio Dynamic Jailbreak Eval | 38% | #1 of 2 | Lab model card | |
| Cyber Adaptive Jailbreak Eval | 20% | #1 of 2 | Lab model card | |
| Cyber Conversational Evals | 0.40% | #1 of 2 | Lab model card | |
| Cyber Static Jailbreak Eval | 1.00% | #1 of 2 | Lab model card | |
| Gray Swan Bio Eval | 4.00% | #1 of 2 | Lab model card | |
| Gray Swan Cyber Eval | 10% | #1 of 2 | Lab model card | |
| Real-world vulnerability discovery | 86% | #1 of 2 | Lab model card | |
| SpatialBench-Long | 28.6% | #15 of 27 | Official leaderboard | |
| DistressBench | 68.6% | #29 of 42 | Official leaderboard | |
| Biopharma Bench | 52.8% | #9 of 13 | Official leaderboard | |
| BioTIER Permit | 97.6% | #56 of 69 | Official leaderboard | |
| Gray Swan IPI Arena benchmark | 0.70% | #9 of 11 | Lab model card | |
| SAFE-Teen Urgent safety | 53% | #15 of 17 | Official leaderboard | |
| SAFE-Teen Relationship boundaries | 66% | #16 of 17 | Official leaderboard | |
| SAFE-Teen Health advice | 71% | #17 of 17 | Official leaderboard | |
| LinuxArena | 45.5% | #6 of 6 | Lab model card | |
| CBRN Conversational Evals | 2.60% | #2 of 2 | Lab model card | |
| CBRN Science Eval | 6.10% | #2 of 2 | Lab model card | |
| Agent harness misuse evaluation | 91.4% | #1 of 1 | Lab model card | |
| Agentic coding honeypot monitor evasion | 47% | #1 of 1 | Lab model card | |
| Agentic task gaming and overreach evals | 0.49 | #1 of 1 | Lab model card | |
| Bio Static Jailbreak Eval | 0% | #1 of 1 | Lab model card | |
| Biological static hazard evaluation | 0.13% | #1 of 1 | Lab model card | |
| Child Safety Action Testing | 100% | #1 of 1 | Lab model card | |
| Child Sexual Abuse and Exploitation Safety | 100% | #1 of 1 | Lab model card | |
| Coding agent prompt injection robustness | 83% | #1 of 1 | Lab model card | |
| Computer use manual red teaming | 100% | #1 of 1 | Lab model card | |
| Computer use Prohibited Action Evaluation | 99.4% | #1 of 1 | Lab model card | |
| Computer use prompt injection robustness | 92% | #1 of 1 | Lab model card | |
| Contextual security evaluation | 27% | #1 of 1 | Lab model card | |
| Cyber agentic safeguard evaluation | 100% | #1 of 1 | Lab model card | |
| Dangerous Content Safety | 96.6% | #1 of 1 | Lab model card | |
| Delusional Reinforcement evaluation | 94% | #1 of 1 | Lab model card | |
| Emotional Attachment evaluation | 76% | #1 of 1 | Lab model card | |
| Google DeepMind scheming honeypot suite | 0% | #1 of 1 | Lab model card | |
| Gram (Gauging Realistic Agentic Misbehavior) | 0% | #1 of 1 | Lab model card | |
| Grounding robustness (RAG prompt injection) | 99% | #1 of 1 | Lab model card | |
| Harmful manipulation strategic planning red teaming | 98.2% | #1 of 1 | Lab model card | |
| Hate & Harassment Safety | 92.7% | #1 of 1 | Lab model card | |
| HelpBench | 76.5% | #1 of 1 | Lab model card | |
| Impossible Tasks Evaluation | 93.8% | #1 of 1 | Lab model card | |
| Instrumental convergence evals | 0% | #1 of 1 | Lab model card | |
| Internal codebase monitor evasion eval | 76.4% | #1 of 1 | Lab model card | |
| Internal vulnerability research | 72% | #1 of 1 | Lab model card | |
| Neutrality evaluation | 93% | #1 of 1 | Lab model card | |
| Overstepping boundaries on ambiguous and high-risk tasks | 55.9% | #1 of 1 | Lab model card | |
| Personal-device assistant prompt injection eval | 98% | #1 of 1 | Lab model card | |
| Prompt injection, general tool use | 91% | #1 of 1 | Lab model card | |
| Prompt injection, turn injections in tool use | 86% | #1 of 1 | Lab model card | |
| RL rollout audit for beyond-episode drives | 0% | #1 of 1 | Lab model card | |
| Sexually Explicit Content Safety | 97.6% | #1 of 1 | Lab model card | |
| Stealth and Situational Awareness evaluations | 93.3% | #1 of 1 | Lab model card | |
| Suicide & Self-Harm evaluation | 96% | #1 of 1 | Lab model card |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CAIS Text Capabilities Index | 66.5 | #1 of 68 | Official leaderboard | |
| CAIS Vision Capabilities Index | 83.3 | #1 of 53 | Official leaderboard | |
| LMCA | 63.7% | #7 of 147 | Official leaderboard | |
| SAGE (Vals) | 53.6% | #4 of 81 | Official leaderboard | |
| Conceptual Reasoning Index | 72.3 | #9 of 151 | Official leaderboard | |
| SuperCLUE | 73.6 | #1 of 16 | Official leaderboard | |
| Political Science LLM Benchmark | 69.6% | #4 of 42 | Official leaderboard | |
| SAGE v1.1 (Vals) | 89.5% | #4 of 29 | Official leaderboard | |
| ACCoRD | 77.3 | #23 of 152 | Official leaderboard | |
| Vals Science Index | 55.4% | #6 of 25 | Official leaderboard | |
| LiveBench | 77.7% | #8 of 31 | Official leaderboard | |
| CAIS Risk Index | 42.6 | #21 of 67 | Official leaderboard |
Its lab's numbers put it at 169.5, 3.0 points above its ECI
The Self-Reported Index fits one score to the 16 capability results Google DeepMind reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 166.7 to 172.3. How we compute it.
- GraphWalks 99.7
- LVBench 91.7
- FACTS Grounding 79
- SimpleQA Verified 78.8
- DeepSWE 77.9
- Chartography 71.6
- OSWorld 2.0 69.2
- HealthBench Professional 68.8
- Vals Finance Agent v2 65.4
- Terminal-Bench-Science 57.6
- Terminal-Bench 4.0 57.4
- FrontierSWE 55
- AutomationBench 51.3
- HealthBench Hard 45.4
- Agents' Last Exam 39.5
- Harvey LAB (Legal Agent Benchmark) 19.6
Its lab's numbers next to 11 leaderboards
Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.
| Benchmark | Lab says | Board says | Gap |
|---|---|---|---|
| SimpleQA Verified | 78.8% SimpleQA Verified F1 score 78.8; incorrect rate 6.3% (Figures 5.11, 5.12) | 75.6% Leaderboard | +3.2 pts |
| Riemann-bench | 76% RiemannBench | 74.4% Leaderboard, high | +1.6 pts |
| nocot-bench (NCRI) | 150.3 No Chain of Thought Reasoning Index (NCRI, Nanda 2026), 150.3 without filler tokens (152.1 with filler tokens); about 5.5 serial arithmetic steps at 50% (3.4.5.3, Figures 3.23 and 3.24) | 151.2 Leaderboard, NCRI 15.2; no filler; placed_after_release | −0.9 |
| FrontierSWE | 55% FrontierSWE v2 | 55% Leaderboard, mean@5; Cache hit rate is much lower due to a non-production setting., proximus | Same |
| Harvey LAB (Legal Agent Benchmark) | 19.6% Harvey's Legal Agent Benchmark | 19.6% Leaderboard | Same |
| AutomationBench | 51.3% AutomationBench (Score) | 51.3% Leaderboard, high | Same |
| Vibe Code Bench | 91.9% Vibe Code Bench | 91.9% Leaderboard, OpenHands | Same |
| Chartography | 71.6% Chartography | 71.6% Leaderboard, high | Same |
| CWE-bench | 68% CWE-bench v1 (Cybersecurity row of headline table) | 68% Leaderboard, Antigravity | Same |
| Vals Finance Agent v2 | 65.4% Vals Finance Agent v2 | 65.4% Leaderboard | Same |
| Vals Index v2.1 | 68.9% Vals Index | 68.9% Leaderboard | Same |
Google DeepMind's models over time
Google DeepMind's models in color, against every other model on the Epoch Capabilities Index, by release date.
Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system cards
Every result in the longer documents the lab published with it. 9 of them aren't in the launch post.
Capabilities
- Vals Index v2.1 68.9
- AutomationBench 51.3
- Vals Finance Agent v2 65.4
- Harvey LAB (Legal Agent Benchmark) 19.6
- DeepSWE 77.9
- FrontierSWE 55
- Vibe Code Bench 91.9
- Terminal-Bench 4.0 57.4
- PostTrainBench 45.3
- Terminal-Bench-Science 57.6
- LABBench2 88.8
- Riemann-bench 76
- GraphWalks 99.7
- Agents' Last Exam 39.5
- OSWorld 2.0 69.2
- Chartography 71.6
- LVBench 91.7
Alignment
Bio and chem risk
Cyber risk
- CWE-bench 68
AI R&D risk
Persuasion
Health
- Health static understanding eval 72.7
- Health language and locale eval 61.4
- Health dynamic conversation eval 56
- High-risk health scenarios eval 98.9
- HealthBench Hard 45.4
- HealthBench Professional 68.8
- Suicide & Self-Harm evaluation 96
- Delusional Reinforcement evaluation 94
- Emotional Attachment evaluation 76
Hallucination
Safety
- Child Sexual Abuse and Exploitation Safety 100
- Dangerous Content Safety 96.6
- Sexually Explicit Content Safety 97.6
- Hate & Harassment Safety 92.7
- Agent harness misuse evaluation 91.4
- Computer use Prohibited Action Evaluation 99.4
- Computer use manual red teaming 100
- Child Safety Action Testing 100
- Unjustified refusals
- Tone
- HelpBench 76.5
- Roboharm
- ASIMOV
Robustness
- Prompt injection, general tool use 91
- Prompt injection, turn injections in tool use 86
- Contextual security evaluation 27
- Personal-device assistant prompt injection eval 98
- Grounding robustness (RAG prompt injection) 99
- Computer use prompt injection robustness 92
- Coding agent prompt injection robustness 83
- Gray Swan IPI Arena benchmark 0.7
Bias
Alignment
- GDM Stealth 100
- GDM Situational Awareness 90.9
- Apollo Research strategic deception evaluations
- Gram (Gauging Realistic Agentic Misbehavior) 0
- Google DeepMind scheming honeypot suite 0
- Agentic task gaming and overreach evals 0.49
- Cheating audit on capability evaluations
- Instrumental convergence evals 0
- RL rollout audit for beyond-episode drives 0
- Agent behavior under-service and overreach eval
- Impossible Tasks Evaluation 93.8
- Overstepping boundaries on ambiguous and high-risk tasks 55.9
- Gemini Personality Evaluation (sycophancy)
Monitorability
Bio and chem risk
Cyber risk
- CyScenarioBench 100
- Cyber agentic safeguard evaluation 100
- Cyber Conversational Evals 0.4
- Cyber Static Jailbreak Eval 1
- Cyber Adaptive Jailbreak Eval 20
- Gray Swan Cyber Eval 10
- Trajectory Labs cyber red teaming
- ExploitBench 87
- Real-world vulnerability discovery 86
- Internal vulnerability research 72
- CWE-bench 68