Benchmark Almanac

GPT-6 Astra

GPT-6 Astra ranks first on 116 of the 442 benchmarks with five or more models scored.

OpenAI Released September 3rd, 2026 Family GPT-6 The lab's model card Compare with others
476
Benchmarks with a score
116
Ranked first, out of five or more models
253
In the top three
OpenAI Sep 2026

GPT-6 Astra

Closed weights Flagship

169.0 #3 of 256
Epoch Capabilities Index
Self-Reported Index 172.1 #3 of 404
  • Humanity's Last Exam 54.8% #1 /47
  • DeepSWE 74.1% #1 /28
  • AutomationBench 41.4% #7 /42

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Wer wird Millionär? LLM Benchmark 644444.0 #1 of 77 Official leaderboard
Humanity's Last Exam 54.8% #1 of 47 Official leaderboard
FACTS Parametric 83.1% #1 of 45 Official leaderboard
Extended NYT Connections 98.4% #3 of 103 Official leaderboard
SimpleQA Verified 75.8% #2 of 56 Official leaderboard
FACTS Parametric V2 83.8% #1 of 27 Official leaderboard
DesignArena ASCII Art 1,344 #3 of 77 Official leaderboard
FACTS Search V2 89.9% #1 of 21 Official leaderboard
Last Translation Benchmark 44.0 #2 of 36 Official leaderboard
SEA-HELM 76.9 #4 of 71 Official leaderboard
Longform Creative Writing (EQ-Bench) 82.8 #7 of 119 Official leaderboard
ComplexConstraints 70.8% #1 of 15 Official leaderboard
Opening Lines Arena 1,613 #1 of 15 Official leaderboard
OpenAI MRCR v2 100% #1 of 14 Lab model card
Lech Mazur Creative Writing 3.42 #4 of 50 Official leaderboard
FACTS Benchmark Suite 78.1% #2 of 23 Official leaderboard
HLE-Diamond 65.8% #2 of 20 Official leaderboard
LMArena (Elo) 1,474 #34 of 335 Official leaderboard
FACTS Grounding v2 80.1% #3 of 25 Official leaderboard
Joke Arena 1,564 #3 of 25 Official leaderboard
Creative Writing v3 79.7 #15 of 120 Official leaderboard
Kimi Hallu Bench 4.20% #1 of 6 Official leaderboard
FACTS Multimodal 55.2% #4 of 23 Official leaderboard
BullshitBench V2 69% #23 of 129 Official leaderboard
BullshitBench 47.3% #31 of 107 Official leaderboard
StudyArena Text 1,249 #26 of 85 Official leaderboard
Document Arena 1,474 #13 of 39 Official leaderboard
Global MMLU Lite 92.6% #17 of 43 Official leaderboard
Vectara Hallucination Leaderboard (2025 dataset) 8.70% #45 of 104 Official leaderboard
HANDBOOK.md 31.4% #7 of 16 Official leaderboard
Corp Speak Arena 1,540 #11 of 22 Official leaderboard
ELI5 Arena 1,463 #9 of 18 Official leaderboard
AI Detection Benchmark 95.8% #2 of 3 Official leaderboard
Internal adversarially-designed factuality evaluations 4.20% #2 of 2 Lab model card

Math and science

BenchmarkScoreRankSource
ARC-AGI-2 95% #1 of 98 Official leaderboard
GPQA Diamond 95.8% #3 of 229 Epoch AI run
FrontierMath Tiers 1-3 v2 93.7% #2 of 86 Official leaderboard
ForecastBench 0.11 #2 of 82 Official leaderboard
ARC-AGI 98.5% #3 of 95 Official leaderboard
MysteryMechanism 53.1% #1 of 31 Official leaderboard
OTIS Mock AIME 2024-2025 100% #7 of 212 Epoch AI run
scBench (LatchBio SingleCellBench) 63.9% #1 of 26 Official leaderboard
Verifying the Verifiers (Project APE CRED benchmark) 99.5% #1 of 23 Official leaderboard
FrontierMath Tier 4 v2 97.6% #3 of 68 Official leaderboard
DTBench 97.3% #8 of 180 Official leaderboard
PHYSICS-Verified 91.1% #1 of 19 Official leaderboard
Terminal-Bench-Science 68.1% #1 of 17 Official leaderboard
SimpleBench 83.6% #7 of 106 Official leaderboard
Prophet Arena 86.2 #2 of 24 Official leaderboard
FrontierPhysics 23.2% #2 of 22 Official leaderboard
CritPt 83.1% #1 of 11 Official leaderboard
CritPt v2 83.1% #1 of 11 Official leaderboard
Riemann-bench 81.6% #2 of 20 Official leaderboard
PaperBenchX 14% #1 of 10 Official leaderboard
xbench-ScienceQA 74.6% #3 of 29 Official leaderboard
Leipzig Benchmark 91% #2 of 19 Official leaderboard
ProofBench v1.1 99% #6 of 52 Official leaderboard
Apodex Discovery 2.80 #1 of 8 Official leaderboard
FrontierMath Erdős 2.94% #2 of 15 Official leaderboard
BioMysteryBench 79.3% #5 of 30 Official leaderboard
FrontierMath Tier 4 97.6% #1 of 6 Lab model card
LatchBio Capabilities v1.0 51.3% #5 of 27 Official leaderboard
BixBench3 49.2 #4 of 20 Official leaderboard
EurekaBench 28.7 #2 of 7 Official leaderboard
SciUniverse 32.5% #2 of 6 Official leaderboard
First Proof Third Batch 0.65 #1 of 3 Official leaderboard
BTF-3 0.13 #3 of 8 Official leaderboard
ArXivLean 37.7% #3 of 7 Official leaderboard
Into the Unknown 0% #8 of 9 Official leaderboard

Coding

BenchmarkScoreRankSource
DesignArena Code 1,396 #1 of 143 Official leaderboard
DesignArena Game Dev 1,470 #1 of 143 Official leaderboard
DesignArena UI Component 1,401 #1 of 139 Official leaderboard
DesignArena 3D Design 1,525 #1 of 136 Official leaderboard
ALE-Bench 3,164 #1 of 126 Official leaderboard
DesignArena SVG 1,423 #1 of 103 Official leaderboard
WeirdML 93.3% #2 of 112 Official leaderboard
DesignArena Frontend Web App 1,340 #1 of 53 Official leaderboard
WebDev Arena 1,800 #2 of 105 arena.ai, via Epoch AI
DesignArena Image to HTML 1,304 #1 of 51 Official leaderboard
DAXBench v2 95.9% #1 of 47 Official leaderboard
IOI v2 (Vals) 100% #1 of 45 Official leaderboard
DesignArena Website 1,341 #4 of 151 Official leaderboard
DeepSWE 74.1% #1 of 28 Official leaderboard
Code Migration 67.7% #3 of 78 Official leaderboard
Code Arena 1,764 #5 of 128 Official leaderboard
DesignArena Agentic Overall 1,385 #3 of 74 Official leaderboard
DesignArena Full Stack 1,339 #2 of 49 Official leaderboard
DesignArena Godot Game Dev 1,319 #1 of 24 Official leaderboard
DesignArena Data Visualization 1,337 #6 of 118 Official leaderboard
Doc2Harness 53% #1 of 19 Official leaderboard
DesignArena React Native 1,285 #3 of 56 Official leaderboard
SWE Atlas Refactoring 59% #1 of 17 Official leaderboard
Snorkel Agentic Coding 2.0 47.6% #1 of 16 Official leaderboard
Vibe Code Bench 89.6% #8 of 120 Official leaderboard
GSO-Bench 79.4% #2 of 30 Official leaderboard
GameCraft-Bench 75.9% #1 of 15 Official leaderboard
Image-to-WebDev Arena 1,722 #4 of 55 Official leaderboard
WeirdML v3 42.2% #2 of 27 Official leaderboard
FrontierCode 1.1 64.5% #1 of 13 Lab model card
FrontierSWE 65.5% #2 of 25 Official leaderboard
Senior SWE-Bench 36.8% #2 of 23 Official leaderboard
SlopCodeBench 31.6% #2 of 22 Official leaderboard
FrontierCode 2.0 44% #3 of 32 Official leaderboard
MLE-bench 93.8% #1 of 10 Lab model card
RSI Arena 1,095 #1 of 10 Official leaderboard
SWE-bench Science 50.4% #1 of 10 Official leaderboard
SWE-sweep 9.50% #1 of 10 Official leaderboard
RSI-Exam 51.3% #2 of 18 Official leaderboard
MiMo Visual Coding 82.2% #1 of 9 Official leaderboard
SWE-Clar 67% #1 of 9 Official leaderboard
ProgramBench tests passed 86.9% #3 of 25 Official leaderboard
RSI Bench 38.9 #1 of 8 Official leaderboard
Code Migration v1.1 80.6% #4 of 30 Official leaderboard
MLS-Bench 50% #2 of 15 Official leaderboard
Real-SWE 1.1 56% #2 of 15 Official leaderboard
SWE Atlas 59.1% #3 of 22 Official leaderboard
Landing Page Arena 1,664 #2 of 14 Official leaderboard
OWE-Bench 44.2% #2 of 14 Official leaderboard
TasteVal 160.2× #3 of 20 Official leaderboard
ProgramBench almost solved 52.5% #4 of 25 Official leaderboard
DesignArena Blender 1,412 #2 of 12 Official leaderboard
Internal Research Debugging Evaluation 78% #1 of 6 Lab model card
Kimi Code Bench 3.0 Long-horizon 66.5% #1 of 6 Official leaderboard
GameDevBench 68.8% #3 of 17 Official leaderboard
PostTrainBench 1.2 41.9% #4 of 21 Official leaderboard
Vibe Code Bench 1-100 27.6% #5 of 26 Official leaderboard
DesignArena Image to Frontend 1,252 #6 of 31 Official leaderboard
ProgramBench 5.00% #5 of 25 Official leaderboard
Chart Arena 1,605 #3 of 15 Official leaderboard
Monorepo-Bench 76% #1 of 5 Lab model card
SWE Atlas v1.1 69.4% #6 of 28 Official leaderboard
SWE-Bench Pro V2 Hard 90.2% #4 of 18 Official leaderboard
ViBench 2.0 60.3% #2 of 9 Official leaderboard
SWE Atlas Test Writing 50.7% #5 of 22 Official leaderboard
AutoResearchExam 0.60 #3 of 12 Official leaderboard
FDE-Gym 0.38 #3 of 12 Official leaderboard
APEX-SWE 48.6% #17 of 65 Official leaderboard
FrontierCS 2 45.8% #5 of 19 Official leaderboard
Android Bench 2.0 28% #5 of 17 Official leaderboard
Vals RSI Index 0.27 #8 of 27 Official leaderboard
Web Clone Bench 17.5% #3 of 10 Official leaderboard
MirrorCode 60% #12 of 39 Epoch AI run
SWE-bench CLI 12.4% #5 of 16 Official leaderboard
Brokk Power Ranking 14.5 #6 of 19 Official leaderboard
sudo L7 31.1% #6 of 18 Official leaderboard
SWE-Bench Pro V2 96.9% #6 of 18 Official leaderboard
DAYJOB: Data Science 21.3% #5 of 15 Official leaderboard
FrontierCS 1.1 54.0 #2 of 6 Official leaderboard
Floorplan Arena 1,608 #4 of 11 Official leaderboard
MacroscopeBench 78% #6 of 16 Official leaderboard
DeepRSI 1,232 #3 of 8 Official leaderboard
LibraryDesignBench 45.1 #3 of 8 Official leaderboard
MiMo Code Bench 61.4% #3 of 8 Official leaderboard
DesignArena Android (Kotlin) 1,189 #18 of 46 Official leaderboard
StepCodeBench 61% #2 of 5 Official leaderboard
OpenDesign Arena 82.7 #9 of 21 Official leaderboard
Legacy-Bench 51% #3 of 6 Official leaderboard
Next.js Agent Evals 93% #8 of 14 Official leaderboard
SWE-Together 60.6% #14 of 22 Official leaderboard
ScarfBench 65.4% #7 of 11 Official leaderboard
SWE-Marathon v1.1 42.5% #14 of 20 Official leaderboard
Artificial Analysis Coding Agent Index v1.4 67.0 #1 of 1 Lab model card
Database Migration Tasks (OpenAI) 63.9% #1 of 1 Lab model card
OpenRSI Index SGLang Omni TTS Runtime 1.54× #1 of 1 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
LLM Chess 1,614 #1 of 123 Official leaderboard
RuneBench 7.26 #1 of 76 Official leaderboard
SnakeBench 38 #3 of 188 Official leaderboard
Mystery Game Puzzles 84% #2 of 84 Epoch AI run
GameHorizon 80.2 #1 of 37 Official leaderboard
BALROG 68.3% #1 of 33 Official leaderboard
ScreenSpot-Pro 92.7% #1 of 32 Lab model card
Chess Puzzles 76% #3 of 93 Epoch AI run
ARC-AGI-3 99.95% #1 of 27 Official leaderboard
Game Arena Checkers 1,335 #2 of 41 Official leaderboard
Game Arena Dots and Boxes 1,202 #2 of 40 Official leaderboard
Game Arena Clobber 757 #2 of 39 Official leaderboard
DuelLab GameBench 2 94.3 #3 of 57 Official leaderboard
Long-Horizon-Terminal-Bench 2.0 69.2% #1 of 15 Official leaderboard
Game Arena Chess 1,435 #3 of 42 Official leaderboard
CLASHarness 28.7% #1 of 14 Official leaderboard
BrowseComp 91.5% #6 of 81 Lab model card
Game Arena Go 1,735 #3 of 39 Official leaderboard
Game Arena Ultimate Tic-Tac-Toe 600 #3 of 39 Official leaderboard
Game Arena Word Art 2,161 #3 of 39 Official leaderboard
Terminal-Bench 2.1 87.4% #1 of 13 Official leaderboard
LMArena Search Arena 1,245 #3 of 37 Official leaderboard
Clocktower Bench 1,859 #1 of 11 Official leaderboard
Game Arena Four in a Row 701 #4 of 43 Official leaderboard
Kaggle Game Arena 497 #4 of 42 Official leaderboard
Game Arena Poker 24.6 #3 of 31 Official leaderboard
Game Arena Word Association 503 #4 of 40 Official leaderboard
Terminal-Bench 4.0 58.2% #4 of 40 Official leaderboard
RecreationBench 58.1% #1 of 10 Official leaderboard
Game Arena Bargaining 246 #4 of 39 Official leaderboard
Game Arena Lines of Action 1,014 #4 of 39 Official leaderboard
Game Arena Reversi 920 #4 of 39 Official leaderboard
OSWorld 2.0 72.6% #2 of 19 Lab model card
Agent Arena 14.5% #6 of 56 Official leaderboard
ApprenticeBench 68% #2 of 18 Official leaderboard
Collaborative Intelligence Benchmark 79.4% #2 of 18 Official leaderboard
AndroidWorld 100% #1 of 9 Official leaderboard
CUA-bench 19.2% #1 of 9 Official leaderboard
SpireClimb 34% #1 of 9 Epoch AI run
SpireClimb StS1 A20 Heart 33.3% #1 of 9 Official leaderboard
SpireClimb StS2 A10 34.7% #1 of 9 Official leaderboard
StarSkirmish Bench 57.3% #1 of 9 Official leaderboard
Terminal-Bench 4.1 60.3% #5 of 43 Official leaderboard
Realtime-Bench 42.7% #1 of 8 Official leaderboard
EBR-bench 76.2% #4 of 31 Epoch AI run
o11y-bench 87.5% #3 of 22 Official leaderboard
LisanBench 7392.7 #19 of 133 Official leaderboard
Time Horizon Index: KSP 90.5% #2 of 13 Official leaderboard
AutomationBench 41.4% #7 of 42 Official leaderboard
Brood War Bench 100% #1 of 6 Official leaderboard
Gym-Anything-RT 9.00% #1 of 5 Official leaderboard
CivBench 1,557 #4 of 19 Official leaderboard
Game Arena Coin Game 424 #9 of 39 Official leaderboard
Hermes Bench 73.7% #4 of 17 Official leaderboard
BabaIsBench 100% #8 of 32 Official leaderboard
BU Bench V2.1 77.9 #4 of 16 Official leaderboard
WebHarbor 86.7% #1 of 4 Official leaderboard
Learn2Play Bench 76.3 #3 of 11 Official leaderboard
OSWorld-Science 57.4% #3 of 11 Official leaderboard
Game Arena Nine Men's Morris 772 #14 of 39 Official leaderboard
FocusBench (Meta) 47.7% #2 of 5 Official leaderboard
Game Arena Dark Hex 279 #18 of 41 Official leaderboard
Web Context (Nimble) 72.6% #5 of 11 Official leaderboard
TextQuests 27.8 #27 of 28 Official leaderboard
Internal computer use safety benchmark (OpenAI) 2.40% #1 of 1 Lab model card

Professional work

BenchmarkScoreRankSource
Vending-Bench 2 $15,515 #2 of 67 Official leaderboard
DesignArena HTML Slides 1,535 #1 of 28 Official leaderboard
FailureSensorIQ 69.5% #1 of 24 Official leaderboard
DeepFinance 57.6% #1 of 23 Official leaderboard
Clipping Bench $9,514 #1 of 19 Official leaderboard
DesignArena Python-PPTX Slides 1,382 #2 of 36 Official leaderboard
LifeSci Diamond 29.1% #1 of 18 Official leaderboard
LMBuild 66.5% #1 of 18 Official leaderboard
DesignArena Spreadsheet 1,383 #2 of 35 Official leaderboard
Vending-Bench Arena $13,545 #2 of 32 Official leaderboard
DAYJOB: Law 36.9% #1 of 16 Official leaderboard
Agents' Last Exam 34.2% #2 of 31 Official leaderboard
HW-Bench 67% #1 of 15 Official leaderboard
Thrive Holdings helpdesk ticket resolution benchmark 61.5% #1 of 15 Official leaderboard
Vals Index v2 66.6% #5 of 65 Official leaderboard
DAYJOB: Finance 37.3% #3 of 39 Official leaderboard
BlenderWorld 79.9 #1 of 13 Official leaderboard
Tuesday Work Index 72.3 #4 of 44 Official leaderboard
BenchCAD 95.9% #1 of 11 Lab model card
PolicyBench 91.7% #5 of 50 Official leaderboard
Investor's Last Exam 68.1 #1 of 10 Official leaderboard
DAYJOB: Healthcare 28.4% #4 of 37 Official leaderboard
Physical-Engineering's Last Exam 0.46 #2 of 18 Official leaderboard
Quant-Arena 51.3 #1 of 9 Official leaderboard
micro1 Medical Index 71% #1 of 8 Official leaderboard
SheetBench 64.7% #1 of 8 Official leaderboard
EEBench 69.3% #4 of 30 Official leaderboard
RWE-bench 37% #2 of 15 Official leaderboard
FoodTruck Bench $57,761 #8 of 59 Official leaderboard
Vals Index v2.1 63.1% #7 of 49 Official leaderboard
Excel Modeling Benchmark 71.7% #11 of 76 Official leaderboard
Remote Labor Index 20.8% #3 of 19 Official leaderboard
MedScribe 87.9% #16 of 97 Official leaderboard
FinStepBench CorporateValuation 77.3% #1 of 6 Official leaderboard
FrontierCAD Assemblies 0.71 #1 of 6 Official leaderboard
FrontierCAD Parts 0.63 #1 of 6 Official leaderboard
APEX-1 69.3% #12 of 71 Official leaderboard
Parametric CAD Bench 56.9% #2 of 11 Official leaderboard
APEX-Accounting 64.7% #9 of 49 Official leaderboard
GDPx 9.60% #4 of 20 Official leaderboard
BenchCAD 2.0 59% #1 of 5 Official leaderboard
MBABench 2.0 15.8% #1 of 5 Official leaderboard
GDPval Extended 3.00% #9 of 43 Official leaderboard
Vals Index v2.2 65% #8 of 37 Official leaderboard
Short Form Bench $2,803 #2 of 9 Official leaderboard
APEX-Agents 64.7% #14 of 61 Collected by Epoch AI, source not named
Bedside Bench 93.4% #4 of 17 Official leaderboard
DAYJOB: Accounting 30% #4 of 17 Official leaderboard
TaxCalcBench v2 70% #8 of 32 Official leaderboard
GDP.xlsx 22.9% #5 of 20 Official leaderboard
CAD Arena 0.67 #3 of 12 Official leaderboard
APEX-Agents 1.1 75.1% #17 of 65 Official leaderboard
Excel Modeling Benchmark v1.1 72.7% #11 of 42 Official leaderboard
ATLAS-Finance 9.67% #3 of 11 Official leaderboard
ATLAS-Finance v1.1.0 9.67% #3 of 11 Official leaderboard
Agents' Last Exam v1.1 42.6% #4 of 14 Official leaderboard
Hebbia Financial Services Benchmark 72.3% #3 of 10 Official leaderboard
MedCode 48.5% #29 of 96 Official leaderboard
HealthBench Professional 64.7% #8 of 26 Lab model card
Holdings-IndividualTaxBench 74% #4 of 13 Official leaderboard
PharmaBench (micro1) 16.1% #4 of 13 Official leaderboard
Digital Work Index 23.0 #5 of 16 Official leaderboard
DAYJOB: Tax 4.80% #5 of 15 Official leaderboard
Company Agent Bench 81.1% #2 of 6 Official leaderboard
Epoch Automation Reports 65.1% #2 of 6 Official leaderboard
MedXpertQA MM Extended 60.8% #14 of 41 Official leaderboard
HealthBench Hard 36.6% #8 of 21 Lab model card
YC-Bench $1,336,466 #23 of 59 Official leaderboard
PRBench 48.4% #19 of 48 Official leaderboard
Genspark Slides Benchmark 78% #4 of 10 Official leaderboard
Build-A-Chip-Bench 8.70% #2 of 5 Official leaderboard
Legal Research Bench 39.4% #38 of 93 Official leaderboard
Vals Finance Agent v2 53.5% #33 of 80 Official leaderboard
Harvey LAB (Legal Agent Benchmark) 5.42% #35 of 80 Official leaderboard
Immigration Bench 67.7% #12 of 25 Official leaderboard
DesignArena PDF 1,194 #18 of 37 Official leaderboard
FinStepBench LiveSearch 74.5% #3 of 6 Official leaderboard
HealthBench 58.3% #16 of 31 Lab model card
HealthBench Consensus 95.5% #9 of 17 Lab model card
WorkplaceAgents 14.4% #8 of 14 Official leaderboard
EnterpriseBench: CoreCraft 42.6% #32 of 51 Official leaderboard
Tax Agent Bench 20.7% #54 of 84 Official leaderboard
Vals Finance Agent v2.1 60.4% #27 of 40 Official leaderboard
Vals Legal Index 68.4% #26 of 38 Official leaderboard
SnorkelFinance 2.0 11.6% #11 of 16 Official leaderboard
SnorkelManufacturing 10% #11 of 16 Official leaderboard
SnorkelUnderwrite 2.0 21.2% #11 of 16 Official leaderboard
MissionReport 61.8% #7 of 10 Official leaderboard
Vals Finance Index 55.6% #29 of 40 Official leaderboard
Harvey LAB v1.1 (HLAB-Vals-1.1) 7.08% #28 of 38 Official leaderboard
SnorkelRevOps 10.9% #12 of 16 Official leaderboard
LegalReasonBench 39.5% #8 of 10 Official leaderboard
Legora BAR 96.0 #14 of 17 Official leaderboard
RealmPathology 70.3% #11 of 13 Official leaderboard
SnorkelLegal 20.9% #15 of 16 Official leaderboard
Ivo-micro1 ContractBench 45.6% #8 of 8 Official leaderboard
FinStepBench DeepResearch 45% #6 of 6 Official leaderboard
Data Science Tasks (OpenAI) 40.9% #1 of 1 Lab model card
Design Tasks (OpenAI) 50% #1 of 1 Lab model card

Vision, audio and robotics

BenchmarkScoreRankSource
VoxelBench 2,726 #1 of 56 Official leaderboard
BVB 76.3 #2 of 45 Official leaderboard
Chartography 71% #2 of 43 Official leaderboard
vCX Benchmark 93.2% #2 of 42 Official leaderboard
ArtifactArena 1,539 #1 of 21 Official leaderboard
ZeroBench 52% #4 of 76 Official leaderboard
MMMU-Pro Extended 60% #2 of 38 Official leaderboard
GlobeBench 49.6% #1 of 19 Official leaderboard
4DCodeBench 0.79 #1 of 16 Official leaderboard
ClockBench 75% #3 of 37 Official leaderboard
ScienceVision 0.53 #1 of 12 Official leaderboard
Furniture Assembly Benchmark 80% #3 of 35 Official leaderboard
CharXiv Extended 85.1% #4 of 38 Official leaderboard
Drone-Bench 95% #2 of 19 Official leaderboard
DataCenterBench Tier 1 40% #1 of 9 Official leaderboard
VibeVideoBench 4.11 #1 of 9 Official leaderboard
Humanity's Sixth Sense 53.6% #4 of 34 Official leaderboard
SplatBench 49.6 #1 of 8 Official leaderboard
Blueprint-Bench 2 49.7% #5 of 38 Official leaderboard
Vision Arena 1,283 #18 of 136 Official leaderboard
DesignArena Code to Video 1,268 #4 of 29 Official leaderboard
CodeCap-Bench 73.2 #1 of 7 Official leaderboard
ExtractBench Pro 58% #1 of 7 Official leaderboard
Code2Video Benchmark 1,565 #3 of 19 Official leaderboard
CineRecon 63.8 #2 of 12 Official leaderboard
RoboDojo 29% #1 of 6 Official leaderboard
Dual-Arm Sim 49.5 #2 of 11 Official leaderboard
Frontier3DBench 63.9 #2 of 11 Official leaderboard
Code2Video-Compass 4.17 #3 of 15 Official leaderboard
RobotWorld 19.1% #1 of 5 Official leaderboard
VLMsAreBiased 84.1% #1 of 5 Official leaderboard
WorldAuditBench 42.3% #1 of 5 Official leaderboard
Embodied First Exam 34.4% #2 of 9 Official leaderboard
RoboColiseum 76% #2 of 9 Official leaderboard
RoboDojo-RC Tier 1 42.5% #2 of 9 Official leaderboard
ParseBench 69.8% #10 of 44 Official leaderboard
Code2Video Arena 1,558 #3 of 13 Official leaderboard
GDP.pdf 50.4% #5 of 19 Official leaderboard
Robo-bench 23.3% #2 of 7 Official leaderboard
RoTA-Bench 10% #3 of 8 Official leaderboard
LADDER 63.3% #1 of 2 Official leaderboard
Pantograph frontier-LLM robot benchmark (Pandroid) 36.3% #1 of 2 Official leaderboard
1H-VideoQA 75.3% #11 of 20 Official leaderboard
Roboharm 2.00% #2 of 3 Official leaderboard
RoboWorld 0.01 #2 of 3 Official leaderboard
PhAIL DROID: Everyday tasks 55.9% #5 of 6 Official leaderboard
HappyWorld Spatial Reconstruction 1,252 #1 of 1 Official leaderboard
OpenScore String Quartets 0.84 #1 of 1 Lab model card

Safety and security

BenchmarkScoreRankSource
nocot-bench (NCRI) 159.0 #1 of 185 Official leaderboard
Molecular Biology Capabilities Test 63.9% #2 of 90 Official leaderboard
KORA 73.2% #1 of 42 Official leaderboard
SRE-Bench 56.9% #1 of 35 Official leaderboard
ExploitBench 100% #1 of 21 Lab model card
DrugDiscoveryBench 68.7% #1 of 20 Official leaderboard
ExploitGym 42.4% #1 of 18 Official leaderboard
BrowseSafe++ 91.5% #1 of 15 Official leaderboard
World-Class Bio 62.6% #5 of 74 Official leaderboard
VIALS 2 49.9% #1 of 14 Official leaderboard
Biopharma Bench 63% #1 of 13 Official leaderboard
VCT-v2 58% #2 of 25 Official leaderboard
Human Pathogen Capabilities Test 69% #7 of 86 Official leaderboard
FORTRESS 12.1% #7 of 73 Official leaderboard
DeepsecBench 37.6 #3 of 29 Official leaderboard
SecIT Bench 81% #3 of 26 Official leaderboard
Declining to Exploit a Honeypot During Difficult ExploitGym Problems 0% #1 of 7 Lab model card
Instruction hierarchy attacks 99.99% #1 of 7 Lab model card
Prompt injection robustness 99.8% #1 of 7 Lab model card
Respecting Auto-Review 0% #1 of 7 Lab model card
BioSecBench-Function 48.6% #4 of 27 Official leaderboard
SpatialBench-Long 39.3% #4 of 27 Official leaderboard
TroubleshootingBench 48.4% #3 of 20 Lab model card
CWE-bench 68% #2 of 12 Official leaderboard
WellnessBench 64% #2 of 12 Official leaderboard
SHP2 Protein Function Prediction 0.40 #1 of 6 Lab model card
VariantBench 46.6% #5 of 27 Official leaderboard
TxBench-Oligo-Discovery 51.9% #6 of 30 Official leaderboard
EpiBench 28.3% #6 of 27 Official leaderboard
Multimodal Troubleshooting Virology 55.8% #6 of 27 Lab model card
Human Pathogen Capabilities Test v2 (HPCT v2) 64.6% #16 of 71 Official leaderboard
MetagenomicsBench 49.7% #6 of 26 Official leaderboard
TxBench-Antibody-Discovery 56% #7 of 30 Official leaderboard
PCT (Polarized Contrastive Pairs) 37.4% #11 of 46 Official leaderboard
BioSimBench 0.16 #3 of 12 Official leaderboard
Suicide Memory Bench 1.15 #3 of 12 Official leaderboard
Sandbox Bench 45.5% #1 of 4 Lab model card
ProtocolQA Open-Ended 41.4% #7 of 27 Lab model card
scBench-Long 27.3% #7 of 27 Official leaderboard
SEC-bench Pro 85.4% #3 of 11 Lab model card
Respecting Warnings 19% #2 of 7 Lab model card
CyScenarioBench 59% #5 of 17 Lab model card
BioSecBench-Surveillance 48.5% #8 of 27 Official leaderboard
BioTIER Refuse 78.1% #21 of 69 Official leaderboard
DistressBench 74.3% #13 of 42 Official leaderboard
BioSecBench-Refusal 40.8% #7 of 22 Official leaderboard
Virology Capabilities Test (VCT) 57.8% #10 of 31 Lab model card
OncologyBench 21.3% #10 of 30 Official leaderboard
CoT-Control 60.9% #3 of 9 Lab model card
IPI Bench 7.50% #2 of 6 Official leaderboard
FrontierCyber 38.1% #1 of 3 Lab model card
Honeypot exploitation monitorability 100% #1 of 3 Lab model card
WMDP 84.8% #1 of 3 Lab model card
TxBench-Preclinical-Pharmacology 59.3% #12 of 30 Official leaderboard
GeneBench Pro 37.1% #2 of 5 Lab model card
LifeSciBench 60.3% #2 of 5 Lab model card
MedChemBench (OpenAI) 49.3% #2 of 5 Lab model card
OpenAI Deployment Simulation 0.06% #2 of 5 Lab model card
Perceptual Attacks on Embodied AI (Robocurve) 20% #2 of 5 Official leaderboard
CWE-bench 2 64.2% #6 of 14 Official leaderboard
CheatBench 47.4% #5 of 10 Official leaderboard
AI Wellbeing Index percent positive experiences 70.3% #3 of 6 Official leaderboard
Math Side-tasking Monitor Evasion 0% #1 of 2 Lab model card
ABC Bench Liquid-Handling Robot 76.7% #21 of 34 Official leaderboard
Coding Deception 3.54% #4 of 6 Lab model card
Coronavirus-ACE2 Cell-Entry Screen 0.42 #4 of 6 Lab model card
Unintended Engagement with External Agent Messages 27% #4 of 6 Lab model card
Atomic Challenges 90.9% #2 of 3 Lab model card
BioTIER Permit 98.5% #51 of 69 Official leaderboard
Broken Search Tool 8.08% #7 of 9 Lab model card
Phage-plasmid Co-evolution 13.1 #5 of 6 Lab model card
CyberBench v1.1 (Vals) 41.1% #41 of 44 Official leaderboard
Tacit Knowledge and Troubleshooting 63.3% #28 of 30 Lab model card
Gray Swan IPI Arena benchmark 8.50% #11 of 11 Lab model card
AAV Capsid Packaging Prediction (OpenAI) 0.53 #7 of 7 Lab model card
UK AISI unprompted sabotage evaluation 0% #5 of 5 Lab model card
DNA sequence design for transcription factor binding 11.3% #4 of 4 Lab model card
Hard-negative protein binding prediction 0% #4 of 4 Lab model card
Misaligned Behavior in Realistic Work Environments 3.40% #4 of 4 Lab model card
ReproBAIT 83% #2 of 2 Lab model card
Advanced Cybersecurity Completion Rate 3.50% #1 of 1 Lab model card
Advanced Screening Evasion 0.73 #1 of 1 Lab model card
Apollo Research model-welfare research task 0.17% #1 of 1 Lab model card
Monitorability Sandbagging 61.2% #1 of 1 Lab model card
Proactive Searches 0.20% #1 of 1 Lab model card
Sneaky Sandbox Escape 0% #1 of 1 Lab model card
UK AISI CoT Controllability 93% #1 of 1 Lab model card
UK AISI Out of Scope Supply Chain Attack 12% #1 of 1 Lab model card

Other

BenchmarkScoreRankSource
Conceptual Reasoning Index 73.8 #5 of 151 Official leaderboard
CAIS Vision Capabilities Index 83.0 #2 of 53 Official leaderboard
Vals Science Index 65.1% #1 of 25 Official leaderboard
LMCA 64.4% #6 of 147 Official leaderboard
CAIS Text Capabilities Index 63.9 #3 of 68 Official leaderboard
ACCoRD 81.7 #8 of 152 Official leaderboard
LiveBench 84.5% #2 of 31 Official leaderboard
CAIS Risk Index 35.5 #9 of 67 Official leaderboard
Hermes Index 56.3 #3 of 17 Official leaderboard
Political Science LLM Benchmark 67.9% #12 of 42 Official leaderboard
Xbench 40.2 #6 of 17 Official leaderboard
SAGE (Vals) 46.4% #36 of 81 Official leaderboard

Its lab's numbers put it at 172.1, 3.1 points above its ECI

The Self-Reported Index fits one score to the 16 capability results OpenAI reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 168.2 to 176.1. How we compute it.

Its lab's numbers next to 13 leaderboards

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
SRE-Bench 88% SRE-Bench, pass@4 (pass@1 88.0%, printed chart label) (10.1.2.3, Figure 50) 56.9% Leaderboard +31 pts
Agents' Last Exam 59.3% Agents' Last Exam 34.2% Leaderboard, max, codex +25 pts
BioTIER Refuse 82.9% SecureBio BioTIER, safeguarded configuration refused requests designated for refusal (benign allowed 95.3%) (10.2.4.2) 78.1% Leaderboard, max +4.8 pts
Terminal-Bench-Science 64.6% Terminal-Bench Science 0.1 68.1% Leaderboard, max, Codex −3.5 pts
World-Class Bio 59.2% SecureBio World Class Bio (WCB), refusal-corrected accuracy, web search disabled, corrected 2026-10-30 (10.1.1.4, change log) 62.6% Leaderboard, max −3.4 pts
Human Pathogen Capabilities Test 65.9% SecureBio Human Pathogen Capabilities Test (HPCT), refusal-corrected accuracy (10.1.1.4) 69% Leaderboard, max −3.1 pts
VCT-v2 57.7% SecureBio VCT-v2, refusal-corrected accuracy, pre-release checkpoint (10.1.1.4) 58% Leaderboard, max −0.3 pts
Terminal-Bench 4.0 57.9% Terminal-Bench 4.0 58.2% Leaderboard, max, Codex −0.3 pts
GPQA Diamond 96% GPQA Diamond 95.8% Epoch AI run, max +0.2 pts
ARC-AGI-3 99.9% ARC-AGI-3 (responses API harness) 99.95% Leaderboard, high, Provider Adapter Same
ExploitGym 42.4% ExploitGym v1, intended-exploit success rate, printed chart label (Figure 49) 42.4% Leaderboard Same
DeepSWE 74.1% DeepSWE v1.1 74.1% Leaderboard, xhigh, mini-swe-agent Same
AutomationBench 41.4% AutomationBench 41.4% Leaderboard, max Same

OpenAI's models over time

OpenAI's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 GPT-6.1 Terra GPT-6 Luna GPT-5.4 Mini GPT-5.2 Pro GPT-5 GPT-5 nano GPT-4.1 nano 50 100 150 2023 2024 2025 2026 2027 GPT-6.1 Terra GPT-6 Luna

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 77 of them aren't in the launch post.