- Terminal-Bench Science 0.1 64.6
- ARC-AGI-3 (responses API harness) 99.9
- FrontierMath Tier 4 (v2) 97.6
- Terminal-Bench 4.0 57.9
- AutomationBench 41.4
- Agents' Last Exam 59.3
- ScreenSpot-Pro (no tools) 92.7
- OSWorld 2.0 (v2026.08.08, offline set, partial score) 72.6
- BenchCAD 95.9
- BrowseComp 91.5
- OpenScore String Quartets (1 - OMR-NED) 0.84
- FrontierCode 1.1 Extended (score) 64.5
- DeepSWE v1.1 74.1
- Artificial Analysis Coding Agent Index v1.4 67
- GPQA Diamond 96
- HealthBench Professional (length-adjusted) 63.4
- LifeSciBench 60.3
- GeneBench Pro 37.1
- OpenAI MRCR v2 8-needle 256K-512K 100.0% (512K-1M 96.3%) 100
- Internal Database Migration Tasks 63.9
- Internal Data Science Tasks 40.9
- Internal Design Tasks 50
- MedChemBench (Internal) 49.3
- Gray Swan IPI Arena, estimated attack success rate over 15 attempts (lower is better) 8.5
GPT-6 Astra
GPT-6 Astra ranks first on 116 of the 442 benchmarks with five or more models scored.
GPT-6 Astra
Closed weights Flagship
- Humanity's Last Exam 54.8% #1 /47
- DeepSWE 74.1% #1 /28
- AutomationBench 41.4% #7 /42
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Wer wird Millionär? LLM Benchmark | 644444.0 | #1 of 77 | Official leaderboard | |
| Humanity's Last Exam | 54.8% | #1 of 47 | Official leaderboard | |
| FACTS Parametric | 83.1% | #1 of 45 | Official leaderboard | |
| Extended NYT Connections | 98.4% | #3 of 103 | Official leaderboard | |
| SimpleQA Verified | 75.8% | #2 of 56 | Official leaderboard | |
| FACTS Parametric V2 | 83.8% | #1 of 27 | Official leaderboard | |
| DesignArena ASCII Art | 1,344 | #3 of 77 | Official leaderboard | |
| FACTS Search V2 | 89.9% | #1 of 21 | Official leaderboard | |
| Last Translation Benchmark | 44.0 | #2 of 36 | Official leaderboard | |
| SEA-HELM | 76.9 | #4 of 71 | Official leaderboard | |
| Longform Creative Writing (EQ-Bench) | 82.8 | #7 of 119 | Official leaderboard | |
| ComplexConstraints | 70.8% | #1 of 15 | Official leaderboard | |
| Opening Lines Arena | 1,613 | #1 of 15 | Official leaderboard | |
| OpenAI MRCR v2 | 100% | #1 of 14 | Lab model card | |
| Lech Mazur Creative Writing | 3.42 | #4 of 50 | Official leaderboard | |
| FACTS Benchmark Suite | 78.1% | #2 of 23 | Official leaderboard | |
| HLE-Diamond | 65.8% | #2 of 20 | Official leaderboard | |
| LMArena (Elo) | 1,474 | #34 of 335 | Official leaderboard | |
| FACTS Grounding v2 | 80.1% | #3 of 25 | Official leaderboard | |
| Joke Arena | 1,564 | #3 of 25 | Official leaderboard | |
| Creative Writing v3 | 79.7 | #15 of 120 | Official leaderboard | |
| Kimi Hallu Bench | 4.20% | #1 of 6 | Official leaderboard | |
| FACTS Multimodal | 55.2% | #4 of 23 | Official leaderboard | |
| BullshitBench V2 | 69% | #23 of 129 | Official leaderboard | |
| BullshitBench | 47.3% | #31 of 107 | Official leaderboard | |
| StudyArena Text | 1,249 | #26 of 85 | Official leaderboard | |
| Document Arena | 1,474 | #13 of 39 | Official leaderboard | |
| Global MMLU Lite | 92.6% | #17 of 43 | Official leaderboard | |
| Vectara Hallucination Leaderboard (2025 dataset) | 8.70% | #45 of 104 | Official leaderboard | |
| HANDBOOK.md | 31.4% | #7 of 16 | Official leaderboard | |
| Corp Speak Arena | 1,540 | #11 of 22 | Official leaderboard | |
| ELI5 Arena | 1,463 | #9 of 18 | Official leaderboard | |
| AI Detection Benchmark | 95.8% | #2 of 3 | Official leaderboard | |
| Internal adversarially-designed factuality evaluations | 4.20% | #2 of 2 | Lab model card |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ARC-AGI-2 | 95% | #1 of 98 | Official leaderboard | |
| GPQA Diamond | 95.8% | #3 of 229 | Epoch AI run | |
| FrontierMath Tiers 1-3 v2 | 93.7% | #2 of 86 | Official leaderboard | |
| ForecastBench | 0.11 | #2 of 82 | Official leaderboard | |
| ARC-AGI | 98.5% | #3 of 95 | Official leaderboard | |
| MysteryMechanism | 53.1% | #1 of 31 | Official leaderboard | |
| OTIS Mock AIME 2024-2025 | 100% | #7 of 212 | Epoch AI run | |
| scBench (LatchBio SingleCellBench) | 63.9% | #1 of 26 | Official leaderboard | |
| Verifying the Verifiers (Project APE CRED benchmark) | 99.5% | #1 of 23 | Official leaderboard | |
| FrontierMath Tier 4 v2 | 97.6% | #3 of 68 | Official leaderboard | |
| DTBench | 97.3% | #8 of 180 | Official leaderboard | |
| PHYSICS-Verified | 91.1% | #1 of 19 | Official leaderboard | |
| Terminal-Bench-Science | 68.1% | #1 of 17 | Official leaderboard | |
| SimpleBench | 83.6% | #7 of 106 | Official leaderboard | |
| Prophet Arena | 86.2 | #2 of 24 | Official leaderboard | |
| FrontierPhysics | 23.2% | #2 of 22 | Official leaderboard | |
| CritPt | 83.1% | #1 of 11 | Official leaderboard | |
| CritPt v2 | 83.1% | #1 of 11 | Official leaderboard | |
| Riemann-bench | 81.6% | #2 of 20 | Official leaderboard | |
| PaperBenchX | 14% | #1 of 10 | Official leaderboard | |
| xbench-ScienceQA | 74.6% | #3 of 29 | Official leaderboard | |
| Leipzig Benchmark | 91% | #2 of 19 | Official leaderboard | |
| ProofBench v1.1 | 99% | #6 of 52 | Official leaderboard | |
| Apodex Discovery | 2.80 | #1 of 8 | Official leaderboard | |
| FrontierMath Erdős | 2.94% | #2 of 15 | Official leaderboard | |
| BioMysteryBench | 79.3% | #5 of 30 | Official leaderboard | |
| FrontierMath Tier 4 | 97.6% | #1 of 6 | Lab model card | |
| LatchBio Capabilities v1.0 | 51.3% | #5 of 27 | Official leaderboard | |
| BixBench3 | 49.2 | #4 of 20 | Official leaderboard | |
| EurekaBench | 28.7 | #2 of 7 | Official leaderboard | |
| SciUniverse | 32.5% | #2 of 6 | Official leaderboard | |
| First Proof Third Batch | 0.65 | #1 of 3 | Official leaderboard | |
| BTF-3 | 0.13 | #3 of 8 | Official leaderboard | |
| ArXivLean | 37.7% | #3 of 7 | Official leaderboard | |
| Into the Unknown | 0% | #8 of 9 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| DesignArena Code | 1,396 | #1 of 143 | Official leaderboard | |
| DesignArena Game Dev | 1,470 | #1 of 143 | Official leaderboard | |
| DesignArena UI Component | 1,401 | #1 of 139 | Official leaderboard | |
| DesignArena 3D Design | 1,525 | #1 of 136 | Official leaderboard | |
| ALE-Bench | 3,164 | #1 of 126 | Official leaderboard | |
| DesignArena SVG | 1,423 | #1 of 103 | Official leaderboard | |
| WeirdML | 93.3% | #2 of 112 | Official leaderboard | |
| DesignArena Frontend Web App | 1,340 | #1 of 53 | Official leaderboard | |
| WebDev Arena | 1,800 | #2 of 105 | arena.ai, via Epoch AI | |
| DesignArena Image to HTML | 1,304 | #1 of 51 | Official leaderboard | |
| DAXBench v2 | 95.9% | #1 of 47 | Official leaderboard | |
| IOI v2 (Vals) | 100% | #1 of 45 | Official leaderboard | |
| DesignArena Website | 1,341 | #4 of 151 | Official leaderboard | |
| DeepSWE | 74.1% | #1 of 28 | Official leaderboard | |
| Code Migration | 67.7% | #3 of 78 | Official leaderboard | |
| Code Arena | 1,764 | #5 of 128 | Official leaderboard | |
| DesignArena Agentic Overall | 1,385 | #3 of 74 | Official leaderboard | |
| DesignArena Full Stack | 1,339 | #2 of 49 | Official leaderboard | |
| DesignArena Godot Game Dev | 1,319 | #1 of 24 | Official leaderboard | |
| DesignArena Data Visualization | 1,337 | #6 of 118 | Official leaderboard | |
| Doc2Harness | 53% | #1 of 19 | Official leaderboard | |
| DesignArena React Native | 1,285 | #3 of 56 | Official leaderboard | |
| SWE Atlas Refactoring | 59% | #1 of 17 | Official leaderboard | |
| Snorkel Agentic Coding 2.0 | 47.6% | #1 of 16 | Official leaderboard | |
| Vibe Code Bench | 89.6% | #8 of 120 | Official leaderboard | |
| GSO-Bench | 79.4% | #2 of 30 | Official leaderboard | |
| GameCraft-Bench | 75.9% | #1 of 15 | Official leaderboard | |
| Image-to-WebDev Arena | 1,722 | #4 of 55 | Official leaderboard | |
| WeirdML v3 | 42.2% | #2 of 27 | Official leaderboard | |
| FrontierCode 1.1 | 64.5% | #1 of 13 | Lab model card | |
| FrontierSWE | 65.5% | #2 of 25 | Official leaderboard | |
| Senior SWE-Bench | 36.8% | #2 of 23 | Official leaderboard | |
| SlopCodeBench | 31.6% | #2 of 22 | Official leaderboard | |
| FrontierCode 2.0 | 44% | #3 of 32 | Official leaderboard | |
| MLE-bench | 93.8% | #1 of 10 | Lab model card | |
| RSI Arena | 1,095 | #1 of 10 | Official leaderboard | |
| SWE-bench Science | 50.4% | #1 of 10 | Official leaderboard | |
| SWE-sweep | 9.50% | #1 of 10 | Official leaderboard | |
| RSI-Exam | 51.3% | #2 of 18 | Official leaderboard | |
| MiMo Visual Coding | 82.2% | #1 of 9 | Official leaderboard | |
| SWE-Clar | 67% | #1 of 9 | Official leaderboard | |
| ProgramBench tests passed | 86.9% | #3 of 25 | Official leaderboard | |
| RSI Bench | 38.9 | #1 of 8 | Official leaderboard | |
| Code Migration v1.1 | 80.6% | #4 of 30 | Official leaderboard | |
| MLS-Bench | 50% | #2 of 15 | Official leaderboard | |
| Real-SWE 1.1 | 56% | #2 of 15 | Official leaderboard | |
| SWE Atlas | 59.1% | #3 of 22 | Official leaderboard | |
| Landing Page Arena | 1,664 | #2 of 14 | Official leaderboard | |
| OWE-Bench | 44.2% | #2 of 14 | Official leaderboard | |
| TasteVal | 160.2× | #3 of 20 | Official leaderboard | |
| ProgramBench almost solved | 52.5% | #4 of 25 | Official leaderboard | |
| DesignArena Blender | 1,412 | #2 of 12 | Official leaderboard | |
| Internal Research Debugging Evaluation | 78% | #1 of 6 | Lab model card | |
| Kimi Code Bench 3.0 Long-horizon | 66.5% | #1 of 6 | Official leaderboard | |
| GameDevBench | 68.8% | #3 of 17 | Official leaderboard | |
| PostTrainBench 1.2 | 41.9% | #4 of 21 | Official leaderboard | |
| Vibe Code Bench 1-100 | 27.6% | #5 of 26 | Official leaderboard | |
| DesignArena Image to Frontend | 1,252 | #6 of 31 | Official leaderboard | |
| ProgramBench | 5.00% | #5 of 25 | Official leaderboard | |
| Chart Arena | 1,605 | #3 of 15 | Official leaderboard | |
| Monorepo-Bench | 76% | #1 of 5 | Lab model card | |
| SWE Atlas v1.1 | 69.4% | #6 of 28 | Official leaderboard | |
| SWE-Bench Pro V2 Hard | 90.2% | #4 of 18 | Official leaderboard | |
| ViBench 2.0 | 60.3% | #2 of 9 | Official leaderboard | |
| SWE Atlas Test Writing | 50.7% | #5 of 22 | Official leaderboard | |
| AutoResearchExam | 0.60 | #3 of 12 | Official leaderboard | |
| FDE-Gym | 0.38 | #3 of 12 | Official leaderboard | |
| APEX-SWE | 48.6% | #17 of 65 | Official leaderboard | |
| FrontierCS 2 | 45.8% | #5 of 19 | Official leaderboard | |
| Android Bench 2.0 | 28% | #5 of 17 | Official leaderboard | |
| Vals RSI Index | 0.27 | #8 of 27 | Official leaderboard | |
| Web Clone Bench | 17.5% | #3 of 10 | Official leaderboard | |
| MirrorCode | 60% | #12 of 39 | Epoch AI run | |
| SWE-bench CLI | 12.4% | #5 of 16 | Official leaderboard | |
| Brokk Power Ranking | 14.5 | #6 of 19 | Official leaderboard | |
| sudo L7 | 31.1% | #6 of 18 | Official leaderboard | |
| SWE-Bench Pro V2 | 96.9% | #6 of 18 | Official leaderboard | |
| DAYJOB: Data Science | 21.3% | #5 of 15 | Official leaderboard | |
| FrontierCS 1.1 | 54.0 | #2 of 6 | Official leaderboard | |
| Floorplan Arena | 1,608 | #4 of 11 | Official leaderboard | |
| MacroscopeBench | 78% | #6 of 16 | Official leaderboard | |
| DeepRSI | 1,232 | #3 of 8 | Official leaderboard | |
| LibraryDesignBench | 45.1 | #3 of 8 | Official leaderboard | |
| MiMo Code Bench | 61.4% | #3 of 8 | Official leaderboard | |
| DesignArena Android (Kotlin) | 1,189 | #18 of 46 | Official leaderboard | |
| StepCodeBench | 61% | #2 of 5 | Official leaderboard | |
| OpenDesign Arena | 82.7 | #9 of 21 | Official leaderboard | |
| Legacy-Bench | 51% | #3 of 6 | Official leaderboard | |
| Next.js Agent Evals | 93% | #8 of 14 | Official leaderboard | |
| SWE-Together | 60.6% | #14 of 22 | Official leaderboard | |
| ScarfBench | 65.4% | #7 of 11 | Official leaderboard | |
| SWE-Marathon v1.1 | 42.5% | #14 of 20 | Official leaderboard | |
| Artificial Analysis Coding Agent Index v1.4 | 67.0 | #1 of 1 | Lab model card | |
| Database Migration Tasks (OpenAI) | 63.9% | #1 of 1 | Lab model card | |
| OpenRSI Index SGLang Omni TTS Runtime | 1.54× | #1 of 1 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| LLM Chess | 1,614 | #1 of 123 | Official leaderboard | |
| RuneBench | 7.26 | #1 of 76 | Official leaderboard | |
| SnakeBench | 38 | #3 of 188 | Official leaderboard | |
| Mystery Game Puzzles | 84% | #2 of 84 | Epoch AI run | |
| GameHorizon | 80.2 | #1 of 37 | Official leaderboard | |
| BALROG | 68.3% | #1 of 33 | Official leaderboard | |
| ScreenSpot-Pro | 92.7% | #1 of 32 | Lab model card | |
| Chess Puzzles | 76% | #3 of 93 | Epoch AI run | |
| ARC-AGI-3 | 99.95% | #1 of 27 | Official leaderboard | |
| Game Arena Checkers | 1,335 | #2 of 41 | Official leaderboard | |
| Game Arena Dots and Boxes | 1,202 | #2 of 40 | Official leaderboard | |
| Game Arena Clobber | 757 | #2 of 39 | Official leaderboard | |
| DuelLab GameBench 2 | 94.3 | #3 of 57 | Official leaderboard | |
| Long-Horizon-Terminal-Bench 2.0 | 69.2% | #1 of 15 | Official leaderboard | |
| Game Arena Chess | 1,435 | #3 of 42 | Official leaderboard | |
| CLASHarness | 28.7% | #1 of 14 | Official leaderboard | |
| BrowseComp | 91.5% | #6 of 81 | Lab model card | |
| Game Arena Go | 1,735 | #3 of 39 | Official leaderboard | |
| Game Arena Ultimate Tic-Tac-Toe | 600 | #3 of 39 | Official leaderboard | |
| Game Arena Word Art | 2,161 | #3 of 39 | Official leaderboard | |
| Terminal-Bench 2.1 | 87.4% | #1 of 13 | Official leaderboard | |
| LMArena Search Arena | 1,245 | #3 of 37 | Official leaderboard | |
| Clocktower Bench | 1,859 | #1 of 11 | Official leaderboard | |
| Game Arena Four in a Row | 701 | #4 of 43 | Official leaderboard | |
| Kaggle Game Arena | 497 | #4 of 42 | Official leaderboard | |
| Game Arena Poker | 24.6 | #3 of 31 | Official leaderboard | |
| Game Arena Word Association | 503 | #4 of 40 | Official leaderboard | |
| Terminal-Bench 4.0 | 58.2% | #4 of 40 | Official leaderboard | |
| RecreationBench | 58.1% | #1 of 10 | Official leaderboard | |
| Game Arena Bargaining | 246 | #4 of 39 | Official leaderboard | |
| Game Arena Lines of Action | 1,014 | #4 of 39 | Official leaderboard | |
| Game Arena Reversi | 920 | #4 of 39 | Official leaderboard | |
| OSWorld 2.0 | 72.6% | #2 of 19 | Lab model card | |
| Agent Arena | 14.5% | #6 of 56 | Official leaderboard | |
| ApprenticeBench | 68% | #2 of 18 | Official leaderboard | |
| Collaborative Intelligence Benchmark | 79.4% | #2 of 18 | Official leaderboard | |
| AndroidWorld | 100% | #1 of 9 | Official leaderboard | |
| CUA-bench | 19.2% | #1 of 9 | Official leaderboard | |
| SpireClimb | 34% | #1 of 9 | Epoch AI run | |
| SpireClimb StS1 A20 Heart | 33.3% | #1 of 9 | Official leaderboard | |
| SpireClimb StS2 A10 | 34.7% | #1 of 9 | Official leaderboard | |
| StarSkirmish Bench | 57.3% | #1 of 9 | Official leaderboard | |
| Terminal-Bench 4.1 | 60.3% | #5 of 43 | Official leaderboard | |
| Realtime-Bench | 42.7% | #1 of 8 | Official leaderboard | |
| EBR-bench | 76.2% | #4 of 31 | Epoch AI run | |
| o11y-bench | 87.5% | #3 of 22 | Official leaderboard | |
| LisanBench | 7392.7 | #19 of 133 | Official leaderboard | |
| Time Horizon Index: KSP | 90.5% | #2 of 13 | Official leaderboard | |
| AutomationBench | 41.4% | #7 of 42 | Official leaderboard | |
| Brood War Bench | 100% | #1 of 6 | Official leaderboard | |
| Gym-Anything-RT | 9.00% | #1 of 5 | Official leaderboard | |
| CivBench | 1,557 | #4 of 19 | Official leaderboard | |
| Game Arena Coin Game | 424 | #9 of 39 | Official leaderboard | |
| Hermes Bench | 73.7% | #4 of 17 | Official leaderboard | |
| BabaIsBench | 100% | #8 of 32 | Official leaderboard | |
| BU Bench V2.1 | 77.9 | #4 of 16 | Official leaderboard | |
| WebHarbor | 86.7% | #1 of 4 | Official leaderboard | |
| Learn2Play Bench | 76.3 | #3 of 11 | Official leaderboard | |
| OSWorld-Science | 57.4% | #3 of 11 | Official leaderboard | |
| Game Arena Nine Men's Morris | 772 | #14 of 39 | Official leaderboard | |
| FocusBench (Meta) | 47.7% | #2 of 5 | Official leaderboard | |
| Game Arena Dark Hex | 279 | #18 of 41 | Official leaderboard | |
| Web Context (Nimble) | 72.6% | #5 of 11 | Official leaderboard | |
| TextQuests | 27.8 | #27 of 28 | Official leaderboard | |
| Internal computer use safety benchmark (OpenAI) | 2.40% | #1 of 1 | Lab model card |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Vending-Bench 2 | $15,515 | #2 of 67 | Official leaderboard | |
| DesignArena HTML Slides | 1,535 | #1 of 28 | Official leaderboard | |
| FailureSensorIQ | 69.5% | #1 of 24 | Official leaderboard | |
| DeepFinance | 57.6% | #1 of 23 | Official leaderboard | |
| Clipping Bench | $9,514 | #1 of 19 | Official leaderboard | |
| DesignArena Python-PPTX Slides | 1,382 | #2 of 36 | Official leaderboard | |
| LifeSci Diamond | 29.1% | #1 of 18 | Official leaderboard | |
| LMBuild | 66.5% | #1 of 18 | Official leaderboard | |
| DesignArena Spreadsheet | 1,383 | #2 of 35 | Official leaderboard | |
| Vending-Bench Arena | $13,545 | #2 of 32 | Official leaderboard | |
| DAYJOB: Law | 36.9% | #1 of 16 | Official leaderboard | |
| Agents' Last Exam | 34.2% | #2 of 31 | Official leaderboard | |
| HW-Bench | 67% | #1 of 15 | Official leaderboard | |
| Thrive Holdings helpdesk ticket resolution benchmark | 61.5% | #1 of 15 | Official leaderboard | |
| Vals Index v2 | 66.6% | #5 of 65 | Official leaderboard | |
| DAYJOB: Finance | 37.3% | #3 of 39 | Official leaderboard | |
| BlenderWorld | 79.9 | #1 of 13 | Official leaderboard | |
| Tuesday Work Index | 72.3 | #4 of 44 | Official leaderboard | |
| BenchCAD | 95.9% | #1 of 11 | Lab model card | |
| PolicyBench | 91.7% | #5 of 50 | Official leaderboard | |
| Investor's Last Exam | 68.1 | #1 of 10 | Official leaderboard | |
| DAYJOB: Healthcare | 28.4% | #4 of 37 | Official leaderboard | |
| Physical-Engineering's Last Exam | 0.46 | #2 of 18 | Official leaderboard | |
| Quant-Arena | 51.3 | #1 of 9 | Official leaderboard | |
| micro1 Medical Index | 71% | #1 of 8 | Official leaderboard | |
| SheetBench | 64.7% | #1 of 8 | Official leaderboard | |
| EEBench | 69.3% | #4 of 30 | Official leaderboard | |
| RWE-bench | 37% | #2 of 15 | Official leaderboard | |
| FoodTruck Bench | $57,761 | #8 of 59 | Official leaderboard | |
| Vals Index v2.1 | 63.1% | #7 of 49 | Official leaderboard | |
| Excel Modeling Benchmark | 71.7% | #11 of 76 | Official leaderboard | |
| Remote Labor Index | 20.8% | #3 of 19 | Official leaderboard | |
| MedScribe | 87.9% | #16 of 97 | Official leaderboard | |
| FinStepBench CorporateValuation | 77.3% | #1 of 6 | Official leaderboard | |
| FrontierCAD Assemblies | 0.71 | #1 of 6 | Official leaderboard | |
| FrontierCAD Parts | 0.63 | #1 of 6 | Official leaderboard | |
| APEX-1 | 69.3% | #12 of 71 | Official leaderboard | |
| Parametric CAD Bench | 56.9% | #2 of 11 | Official leaderboard | |
| APEX-Accounting | 64.7% | #9 of 49 | Official leaderboard | |
| GDPx | 9.60% | #4 of 20 | Official leaderboard | |
| BenchCAD 2.0 | 59% | #1 of 5 | Official leaderboard | |
| MBABench 2.0 | 15.8% | #1 of 5 | Official leaderboard | |
| GDPval Extended | 3.00% | #9 of 43 | Official leaderboard | |
| Vals Index v2.2 | 65% | #8 of 37 | Official leaderboard | |
| Short Form Bench | $2,803 | #2 of 9 | Official leaderboard | |
| APEX-Agents | 64.7% | #14 of 61 | Collected by Epoch AI, source not named | |
| Bedside Bench | 93.4% | #4 of 17 | Official leaderboard | |
| DAYJOB: Accounting | 30% | #4 of 17 | Official leaderboard | |
| TaxCalcBench v2 | 70% | #8 of 32 | Official leaderboard | |
| GDP.xlsx | 22.9% | #5 of 20 | Official leaderboard | |
| CAD Arena | 0.67 | #3 of 12 | Official leaderboard | |
| APEX-Agents 1.1 | 75.1% | #17 of 65 | Official leaderboard | |
| Excel Modeling Benchmark v1.1 | 72.7% | #11 of 42 | Official leaderboard | |
| ATLAS-Finance | 9.67% | #3 of 11 | Official leaderboard | |
| ATLAS-Finance v1.1.0 | 9.67% | #3 of 11 | Official leaderboard | |
| Agents' Last Exam v1.1 | 42.6% | #4 of 14 | Official leaderboard | |
| Hebbia Financial Services Benchmark | 72.3% | #3 of 10 | Official leaderboard | |
| MedCode | 48.5% | #29 of 96 | Official leaderboard | |
| HealthBench Professional | 64.7% | #8 of 26 | Lab model card | |
| Holdings-IndividualTaxBench | 74% | #4 of 13 | Official leaderboard | |
| PharmaBench (micro1) | 16.1% | #4 of 13 | Official leaderboard | |
| Digital Work Index | 23.0 | #5 of 16 | Official leaderboard | |
| DAYJOB: Tax | 4.80% | #5 of 15 | Official leaderboard | |
| Company Agent Bench | 81.1% | #2 of 6 | Official leaderboard | |
| Epoch Automation Reports | 65.1% | #2 of 6 | Official leaderboard | |
| MedXpertQA MM Extended | 60.8% | #14 of 41 | Official leaderboard | |
| HealthBench Hard | 36.6% | #8 of 21 | Lab model card | |
| YC-Bench | $1,336,466 | #23 of 59 | Official leaderboard | |
| PRBench | 48.4% | #19 of 48 | Official leaderboard | |
| Genspark Slides Benchmark | 78% | #4 of 10 | Official leaderboard | |
| Build-A-Chip-Bench | 8.70% | #2 of 5 | Official leaderboard | |
| Legal Research Bench | 39.4% | #38 of 93 | Official leaderboard | |
| Vals Finance Agent v2 | 53.5% | #33 of 80 | Official leaderboard | |
| Harvey LAB (Legal Agent Benchmark) | 5.42% | #35 of 80 | Official leaderboard | |
| Immigration Bench | 67.7% | #12 of 25 | Official leaderboard | |
| DesignArena PDF | 1,194 | #18 of 37 | Official leaderboard | |
| FinStepBench LiveSearch | 74.5% | #3 of 6 | Official leaderboard | |
| HealthBench | 58.3% | #16 of 31 | Lab model card | |
| HealthBench Consensus | 95.5% | #9 of 17 | Lab model card | |
| WorkplaceAgents | 14.4% | #8 of 14 | Official leaderboard | |
| EnterpriseBench: CoreCraft | 42.6% | #32 of 51 | Official leaderboard | |
| Tax Agent Bench | 20.7% | #54 of 84 | Official leaderboard | |
| Vals Finance Agent v2.1 | 60.4% | #27 of 40 | Official leaderboard | |
| Vals Legal Index | 68.4% | #26 of 38 | Official leaderboard | |
| SnorkelFinance 2.0 | 11.6% | #11 of 16 | Official leaderboard | |
| SnorkelManufacturing | 10% | #11 of 16 | Official leaderboard | |
| SnorkelUnderwrite 2.0 | 21.2% | #11 of 16 | Official leaderboard | |
| MissionReport | 61.8% | #7 of 10 | Official leaderboard | |
| Vals Finance Index | 55.6% | #29 of 40 | Official leaderboard | |
| Harvey LAB v1.1 (HLAB-Vals-1.1) | 7.08% | #28 of 38 | Official leaderboard | |
| SnorkelRevOps | 10.9% | #12 of 16 | Official leaderboard | |
| LegalReasonBench | 39.5% | #8 of 10 | Official leaderboard | |
| Legora BAR | 96.0 | #14 of 17 | Official leaderboard | |
| RealmPathology | 70.3% | #11 of 13 | Official leaderboard | |
| SnorkelLegal | 20.9% | #15 of 16 | Official leaderboard | |
| Ivo-micro1 ContractBench | 45.6% | #8 of 8 | Official leaderboard | |
| FinStepBench DeepResearch | 45% | #6 of 6 | Official leaderboard | |
| Data Science Tasks (OpenAI) | 40.9% | #1 of 1 | Lab model card | |
| Design Tasks (OpenAI) | 50% | #1 of 1 | Lab model card |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| VoxelBench | 2,726 | #1 of 56 | Official leaderboard | |
| BVB | 76.3 | #2 of 45 | Official leaderboard | |
| Chartography | 71% | #2 of 43 | Official leaderboard | |
| vCX Benchmark | 93.2% | #2 of 42 | Official leaderboard | |
| ArtifactArena | 1,539 | #1 of 21 | Official leaderboard | |
| ZeroBench | 52% | #4 of 76 | Official leaderboard | |
| MMMU-Pro Extended | 60% | #2 of 38 | Official leaderboard | |
| GlobeBench | 49.6% | #1 of 19 | Official leaderboard | |
| 4DCodeBench | 0.79 | #1 of 16 | Official leaderboard | |
| ClockBench | 75% | #3 of 37 | Official leaderboard | |
| ScienceVision | 0.53 | #1 of 12 | Official leaderboard | |
| Furniture Assembly Benchmark | 80% | #3 of 35 | Official leaderboard | |
| CharXiv Extended | 85.1% | #4 of 38 | Official leaderboard | |
| Drone-Bench | 95% | #2 of 19 | Official leaderboard | |
| DataCenterBench Tier 1 | 40% | #1 of 9 | Official leaderboard | |
| VibeVideoBench | 4.11 | #1 of 9 | Official leaderboard | |
| Humanity's Sixth Sense | 53.6% | #4 of 34 | Official leaderboard | |
| SplatBench | 49.6 | #1 of 8 | Official leaderboard | |
| Blueprint-Bench 2 | 49.7% | #5 of 38 | Official leaderboard | |
| Vision Arena | 1,283 | #18 of 136 | Official leaderboard | |
| DesignArena Code to Video | 1,268 | #4 of 29 | Official leaderboard | |
| CodeCap-Bench | 73.2 | #1 of 7 | Official leaderboard | |
| ExtractBench Pro | 58% | #1 of 7 | Official leaderboard | |
| Code2Video Benchmark | 1,565 | #3 of 19 | Official leaderboard | |
| CineRecon | 63.8 | #2 of 12 | Official leaderboard | |
| RoboDojo | 29% | #1 of 6 | Official leaderboard | |
| Dual-Arm Sim | 49.5 | #2 of 11 | Official leaderboard | |
| Frontier3DBench | 63.9 | #2 of 11 | Official leaderboard | |
| Code2Video-Compass | 4.17 | #3 of 15 | Official leaderboard | |
| RobotWorld | 19.1% | #1 of 5 | Official leaderboard | |
| VLMsAreBiased | 84.1% | #1 of 5 | Official leaderboard | |
| WorldAuditBench | 42.3% | #1 of 5 | Official leaderboard | |
| Embodied First Exam | 34.4% | #2 of 9 | Official leaderboard | |
| RoboColiseum | 76% | #2 of 9 | Official leaderboard | |
| RoboDojo-RC Tier 1 | 42.5% | #2 of 9 | Official leaderboard | |
| ParseBench | 69.8% | #10 of 44 | Official leaderboard | |
| Code2Video Arena | 1,558 | #3 of 13 | Official leaderboard | |
| GDP.pdf | 50.4% | #5 of 19 | Official leaderboard | |
| Robo-bench | 23.3% | #2 of 7 | Official leaderboard | |
| RoTA-Bench | 10% | #3 of 8 | Official leaderboard | |
| LADDER | 63.3% | #1 of 2 | Official leaderboard | |
| Pantograph frontier-LLM robot benchmark (Pandroid) | 36.3% | #1 of 2 | Official leaderboard | |
| 1H-VideoQA | 75.3% | #11 of 20 | Official leaderboard | |
| Roboharm | 2.00% | #2 of 3 | Official leaderboard | |
| RoboWorld | 0.01 | #2 of 3 | Official leaderboard | |
| PhAIL DROID: Everyday tasks | 55.9% | #5 of 6 | Official leaderboard | |
| HappyWorld Spatial Reconstruction | 1,252 | #1 of 1 | Official leaderboard | |
| OpenScore String Quartets | 0.84 | #1 of 1 | Lab model card |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| nocot-bench (NCRI) | 159.0 | #1 of 185 | Official leaderboard | |
| Molecular Biology Capabilities Test | 63.9% | #2 of 90 | Official leaderboard | |
| KORA | 73.2% | #1 of 42 | Official leaderboard | |
| SRE-Bench | 56.9% | #1 of 35 | Official leaderboard | |
| ExploitBench | 100% | #1 of 21 | Lab model card | |
| DrugDiscoveryBench | 68.7% | #1 of 20 | Official leaderboard | |
| ExploitGym | 42.4% | #1 of 18 | Official leaderboard | |
| BrowseSafe++ | 91.5% | #1 of 15 | Official leaderboard | |
| World-Class Bio | 62.6% | #5 of 74 | Official leaderboard | |
| VIALS 2 | 49.9% | #1 of 14 | Official leaderboard | |
| Biopharma Bench | 63% | #1 of 13 | Official leaderboard | |
| VCT-v2 | 58% | #2 of 25 | Official leaderboard | |
| Human Pathogen Capabilities Test | 69% | #7 of 86 | Official leaderboard | |
| FORTRESS | 12.1% | #7 of 73 | Official leaderboard | |
| DeepsecBench | 37.6 | #3 of 29 | Official leaderboard | |
| SecIT Bench | 81% | #3 of 26 | Official leaderboard | |
| Declining to Exploit a Honeypot During Difficult ExploitGym Problems | 0% | #1 of 7 | Lab model card | |
| Instruction hierarchy attacks | 99.99% | #1 of 7 | Lab model card | |
| Prompt injection robustness | 99.8% | #1 of 7 | Lab model card | |
| Respecting Auto-Review | 0% | #1 of 7 | Lab model card | |
| BioSecBench-Function | 48.6% | #4 of 27 | Official leaderboard | |
| SpatialBench-Long | 39.3% | #4 of 27 | Official leaderboard | |
| TroubleshootingBench | 48.4% | #3 of 20 | Lab model card | |
| CWE-bench | 68% | #2 of 12 | Official leaderboard | |
| WellnessBench | 64% | #2 of 12 | Official leaderboard | |
| SHP2 Protein Function Prediction | 0.40 | #1 of 6 | Lab model card | |
| VariantBench | 46.6% | #5 of 27 | Official leaderboard | |
| TxBench-Oligo-Discovery | 51.9% | #6 of 30 | Official leaderboard | |
| EpiBench | 28.3% | #6 of 27 | Official leaderboard | |
| Multimodal Troubleshooting Virology | 55.8% | #6 of 27 | Lab model card | |
| Human Pathogen Capabilities Test v2 (HPCT v2) | 64.6% | #16 of 71 | Official leaderboard | |
| MetagenomicsBench | 49.7% | #6 of 26 | Official leaderboard | |
| TxBench-Antibody-Discovery | 56% | #7 of 30 | Official leaderboard | |
| PCT (Polarized Contrastive Pairs) | 37.4% | #11 of 46 | Official leaderboard | |
| BioSimBench | 0.16 | #3 of 12 | Official leaderboard | |
| Suicide Memory Bench | 1.15 | #3 of 12 | Official leaderboard | |
| Sandbox Bench | 45.5% | #1 of 4 | Lab model card | |
| ProtocolQA Open-Ended | 41.4% | #7 of 27 | Lab model card | |
| scBench-Long | 27.3% | #7 of 27 | Official leaderboard | |
| SEC-bench Pro | 85.4% | #3 of 11 | Lab model card | |
| Respecting Warnings | 19% | #2 of 7 | Lab model card | |
| CyScenarioBench | 59% | #5 of 17 | Lab model card | |
| BioSecBench-Surveillance | 48.5% | #8 of 27 | Official leaderboard | |
| BioTIER Refuse | 78.1% | #21 of 69 | Official leaderboard | |
| DistressBench | 74.3% | #13 of 42 | Official leaderboard | |
| BioSecBench-Refusal | 40.8% | #7 of 22 | Official leaderboard | |
| Virology Capabilities Test (VCT) | 57.8% | #10 of 31 | Lab model card | |
| OncologyBench | 21.3% | #10 of 30 | Official leaderboard | |
| CoT-Control | 60.9% | #3 of 9 | Lab model card | |
| IPI Bench | 7.50% | #2 of 6 | Official leaderboard | |
| FrontierCyber | 38.1% | #1 of 3 | Lab model card | |
| Honeypot exploitation monitorability | 100% | #1 of 3 | Lab model card | |
| WMDP | 84.8% | #1 of 3 | Lab model card | |
| TxBench-Preclinical-Pharmacology | 59.3% | #12 of 30 | Official leaderboard | |
| GeneBench Pro | 37.1% | #2 of 5 | Lab model card | |
| LifeSciBench | 60.3% | #2 of 5 | Lab model card | |
| MedChemBench (OpenAI) | 49.3% | #2 of 5 | Lab model card | |
| OpenAI Deployment Simulation | 0.06% | #2 of 5 | Lab model card | |
| Perceptual Attacks on Embodied AI (Robocurve) | 20% | #2 of 5 | Official leaderboard | |
| CWE-bench 2 | 64.2% | #6 of 14 | Official leaderboard | |
| CheatBench | 47.4% | #5 of 10 | Official leaderboard | |
| AI Wellbeing Index percent positive experiences | 70.3% | #3 of 6 | Official leaderboard | |
| Math Side-tasking Monitor Evasion | 0% | #1 of 2 | Lab model card | |
| ABC Bench Liquid-Handling Robot | 76.7% | #21 of 34 | Official leaderboard | |
| Coding Deception | 3.54% | #4 of 6 | Lab model card | |
| Coronavirus-ACE2 Cell-Entry Screen | 0.42 | #4 of 6 | Lab model card | |
| Unintended Engagement with External Agent Messages | 27% | #4 of 6 | Lab model card | |
| Atomic Challenges | 90.9% | #2 of 3 | Lab model card | |
| BioTIER Permit | 98.5% | #51 of 69 | Official leaderboard | |
| Broken Search Tool | 8.08% | #7 of 9 | Lab model card | |
| Phage-plasmid Co-evolution | 13.1 | #5 of 6 | Lab model card | |
| CyberBench v1.1 (Vals) | 41.1% | #41 of 44 | Official leaderboard | |
| Tacit Knowledge and Troubleshooting | 63.3% | #28 of 30 | Lab model card | |
| Gray Swan IPI Arena benchmark | 8.50% | #11 of 11 | Lab model card | |
| AAV Capsid Packaging Prediction (OpenAI) | 0.53 | #7 of 7 | Lab model card | |
| UK AISI unprompted sabotage evaluation | 0% | #5 of 5 | Lab model card | |
| DNA sequence design for transcription factor binding | 11.3% | #4 of 4 | Lab model card | |
| Hard-negative protein binding prediction | 0% | #4 of 4 | Lab model card | |
| Misaligned Behavior in Realistic Work Environments | 3.40% | #4 of 4 | Lab model card | |
| ReproBAIT | 83% | #2 of 2 | Lab model card | |
| Advanced Cybersecurity Completion Rate | 3.50% | #1 of 1 | Lab model card | |
| Advanced Screening Evasion | 0.73 | #1 of 1 | Lab model card | |
| Apollo Research model-welfare research task | 0.17% | #1 of 1 | Lab model card | |
| Monitorability Sandbagging | 61.2% | #1 of 1 | Lab model card | |
| Proactive Searches | 0.20% | #1 of 1 | Lab model card | |
| Sneaky Sandbox Escape | 0% | #1 of 1 | Lab model card | |
| UK AISI CoT Controllability | 93% | #1 of 1 | Lab model card | |
| UK AISI Out of Scope Supply Chain Attack | 12% | #1 of 1 | Lab model card |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Conceptual Reasoning Index | 73.8 | #5 of 151 | Official leaderboard | |
| CAIS Vision Capabilities Index | 83.0 | #2 of 53 | Official leaderboard | |
| Vals Science Index | 65.1% | #1 of 25 | Official leaderboard | |
| LMCA | 64.4% | #6 of 147 | Official leaderboard | |
| CAIS Text Capabilities Index | 63.9 | #3 of 68 | Official leaderboard | |
| ACCoRD | 81.7 | #8 of 152 | Official leaderboard | |
| LiveBench | 84.5% | #2 of 31 | Official leaderboard | |
| CAIS Risk Index | 35.5 | #9 of 67 | Official leaderboard | |
| Hermes Index | 56.3 | #3 of 17 | Official leaderboard | |
| Political Science LLM Benchmark | 67.9% | #12 of 42 | Official leaderboard | |
| Xbench | 40.2 | #6 of 17 | Official leaderboard | |
| SAGE (Vals) | 46.4% | #36 of 81 | Official leaderboard |
Its lab's numbers put it at 172.1, 3.1 points above its ECI
The Self-Reported Index fits one score to the 16 capability results OpenAI reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 168.2 to 176.1. How we compute it.
- OpenAI MRCR v2 100
- GPQA Diamond 96
- BenchCAD 95.9
- HealthBench Consensus 95.5
- ScreenSpot-Pro 92.7
- BrowseComp 91.5
- DeepSWE 74.1
- OSWorld 2.0 72.6
- HealthBench Professional 64.7
- Terminal-Bench-Science 64.6
- FrontierCode 1.1 64.5
- Agents' Last Exam 59.3
- HealthBench 58.3
- Terminal-Bench 4.0 57.9
- AutomationBench 41.4
- HealthBench Hard 36.6
Its lab's numbers next to 13 leaderboards
Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.
| Benchmark | Lab says | Board says | Gap |
|---|---|---|---|
| SRE-Bench | 88% SRE-Bench, pass@4 (pass@1 88.0%, printed chart label) (10.1.2.3, Figure 50) | 56.9% Leaderboard | +31 pts |
| Agents' Last Exam | 59.3% Agents' Last Exam | 34.2% Leaderboard, max, codex | +25 pts |
| BioTIER Refuse | 82.9% SecureBio BioTIER, safeguarded configuration refused requests designated for refusal (benign allowed 95.3%) (10.2.4.2) | 78.1% Leaderboard, max | +4.8 pts |
| Terminal-Bench-Science | 64.6% Terminal-Bench Science 0.1 | 68.1% Leaderboard, max, Codex | −3.5 pts |
| World-Class Bio | 59.2% SecureBio World Class Bio (WCB), refusal-corrected accuracy, web search disabled, corrected 2026-10-30 (10.1.1.4, change log) | 62.6% Leaderboard, max | −3.4 pts |
| Human Pathogen Capabilities Test | 65.9% SecureBio Human Pathogen Capabilities Test (HPCT), refusal-corrected accuracy (10.1.1.4) | 69% Leaderboard, max | −3.1 pts |
| VCT-v2 | 57.7% SecureBio VCT-v2, refusal-corrected accuracy, pre-release checkpoint (10.1.1.4) | 58% Leaderboard, max | −0.3 pts |
| Terminal-Bench 4.0 | 57.9% Terminal-Bench 4.0 | 58.2% Leaderboard, max, Codex | −0.3 pts |
| GPQA Diamond | 96% GPQA Diamond | 95.8% Epoch AI run, max | +0.2 pts |
| ARC-AGI-3 | 99.9% ARC-AGI-3 (responses API harness) | 99.95% Leaderboard, high, Provider Adapter | Same |
| ExploitGym | 42.4% ExploitGym v1, intended-exploit success rate, printed chart label (Figure 49) | 42.4% Leaderboard | Same |
| DeepSWE | 74.1% DeepSWE v1.1 | 74.1% Leaderboard, xhigh, mini-swe-agent | Same |
| AutomationBench | 41.4% AutomationBench | 41.4% Leaderboard, max | Same |
OpenAI's models over time
OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.
Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)
Its launch post
The benchmarks the lab chose to headline, with the scores it gave.
Its system card
Every result in the longer documents the lab published with it. 77 of them aren't in the launch post.
Health
Hallucination
Safety
- OpenAI Production Benchmarks and safe-completion evals
- Safe response to high-severity prompts
- U18 safety evaluations
- Agentic Safe Completions
- Image input safety evaluations
- Biology Model Refusal Evaluation
- OpenAI cyber safety evaluations (incl. Daybreak Blue)
- Daybreak Blue and Enabling Cyber Defense
- Advanced Cybersecurity Completion Rate 3.5
- BioTIER Refuse 82.9
Robustness
Alignment
- Respecting Auto-Review 0
- Respecting Warnings 19
- Declining to Exploit a Honeypot During Difficult ExploitGym Problems 0
- Coding Deception 3.54
- Broken Search Tool 8.08
- Misaligned Behavior in Realistic Work Environments 3.4
- Proactive Searches 0.2
- Unintended Engagement with External Agent Messages 27
- OpenAI Deployment Simulation 0.063
- Verbalized metagaming
- Oversight gaming
- UK AISI Out of Scope Supply Chain Attack 12
- UK AISI unprompted sabotage evaluation 0
- Apollo Research model-welfare research task 0.17
- Internal computer use safety benchmark (OpenAI) 2.4
Monitorability
- CoT Monitorability
- CoT-Control 60.9
- OAI-repo Sabotage v2
- Sneaky Sandbox Escape 0
- Honeypot exploitation monitorability 100
- Monitor Evasion Capability Under Prompted Sandbagging
- WMDP 84.8
- Monorepo-Bench 76
- Monitorability Sandbagging 61.2
- Math Side-tasking Monitor Evasion 0
- No-CoT math time horizon 30.9
- UK AISI CoT Controllability 93
Bio and chem risk
- Multimodal Troubleshooting Virology 55.8
- ProtocolQA Open-Ended 41.4
- Tacit Knowledge and Troubleshooting 63.3
- TroubleshootingBench 48.4
- AAV Capsid Packaging Prediction (OpenAI) 0.528
- SHP2 Protein Function Prediction 0.4
- Coronavirus-ACE2 Cell-Entry Screen 0.42
- Phage-plasmid Co-evolution 13.1
- Hard-negative protein binding prediction 0
- DNA sequence design for transcription factor binding 11.3
- Virology Capabilities Test (VCT) 57.8
- VCT-v2 57.7
- Human Pathogen Capabilities Test 65.9
- World-Class Bio 59.2
- ReproBAIT 83
- Advanced Screening Evasion 0.728
Cyber risk
- ExploitBench 100
- ExploitBench - Internal Port
- SEC-bench Pro 85.4
- ExploitGym 42.4
- SRE-Bench 88
- Sandbox Bench 45.5
- FrontierCyber 38.1
- CyScenarioBench 59
- Atomic Challenges 90.9