Vibe Code Bench
The official leaderboard hasn’t scored a model released after Gemini 4 Neon (November 2026). Labs report their own numbers for one newer model: Inkling 2 Mini at 77.9%.
End-to-end web application development from natural-language specs. Built apps are tested against functional requirements.
Official scaffold fork at github.com/vals-ai/VibeCodeBench-Openhands-Scaffold. Results come from the Vals AI leaderboard.
- Made by
- Vals AI
- Released
- March 2026
- Kind
- Building whole projects
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Code
- Tasks
- Kept private
- Measures
- Capability
- Language
- English
- Interaction
- Agentic
- Environment
- Terminal
- Refresh
- New versions replace it
- Run by
- A host
- Based on
- Vibe Code Bench v1
- In views
- Agents
- Strongest model tested
- GPT-6.2 Astra #1 on the capability index
- Last in a launch post
- November 2026
- Last model added
- November 2026
- Scores refreshed
- November 19th, 2026
In the authors’ words
Code generation has emerged as one of AI's highest-impact use cases, yet existing benchmarks measure isolated tasks rather than the complete "zero-to-one" process of building a working application from scratch. We introduce Vibe Code Bench, a benchmark of 100 web application specifications (50 private validation, 50 held-out test) with 964 browser-based workflows comprising 10,131 substeps, evaluated against deployed applications by an autonomous browser agent. Across 16 frontier models, the best achieves 61.8% accuracy on the test split, revealing that reliable end-to-end application development remains a frontier challenge. We identify self-testing during generation as a strong performance predictor (Pearson r=0.72), and show through a completed human alignment study that evaluator selection materially affects outcomes (31.8-93.6% pairwise step-level agreement). Our contributions include (1) a novel benchmark dataset and browser-based evaluation pipeline for end-to-end web application development, (2) a comprehensive evaluation of 16 frontier models with cost, latency, and error analysis, and (3) an evaluator alignment protocol with both cross-model and human annotation results.
Claude Fable 5.2 leads with 93.8% Claude Fable 5.2 leads with 93.8%
Best score per entry from the benchmark's own leaderboard, read on November 19th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.
Claude Fable 5.2 leads with 93.8%, claims included
Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model. Striped bars are claims, and dotted bars are reruns by Epoch AI or another board.
- 93.8 Claude Fable 5.2
- 93.7
Gemini 4 Neon
- 92.4 Claude Sonnet 5.5
- 91.9
Gemini 4 Argon
- 90.4 Claude Haiku 5.5
- 90.3 Claude Fable 5
- 90.3 Claude Opus 5.5
- 90.3 Claude Fable 5.1
- 89.9 GPT-6.2 Astra
- 89.6 GPT-6 Astra
- 89.1
Gemini 4 Carbon
- 88.9 GPT-6.1 Sol
- 88.4 Claude Opus 5
- 87.8 GPT-6 Sol
- 87.8
Gemini 4 Hydrogen
- 87.7
DeepSeek V4.1 Flash 1017
- 87.6 GPT-6.2 Sol
- 86.7
Qwen4-Max
- 86.2 Grok 4.7
- 86.0
Muse Wonder Full
- 85.9
Muse Spark 1.3
- 85.2 MiMo-V2.6 Pro
- 85.0 Kimi K3
- 84.9 Kimi K3.1 Pro
- 84.7
DeepSeek V4.1 Flash
- 84.0 GPT-6.1 Terra
- 83.9
Ember-1
- 83.7
Muse Ember
- 83.1
Muse Wonder
- 82.7 Claude Opus 4.8
- 82.3
DeepSeek V4 Pro 0813
- 81.7 GPT-6 Luna
- 81.6
Mistral Large 4
- 81.5
Inkling 2 Small
- 81.3 Claude Sonnet 5
- 81.0
Tencent Hy4
- 80.5 GPT-5.6 Sol
- 79.1
Muse Spark 1.2
- 79.0 MiMo-V2.6 Flash
- 78.7
Gemini 3.8 Flash
- 78.4
Mistral Large 4 Preview
- 78.1 GLM-5.3
- 77.5
Tencent Hy4 preview
- 77.1
Qwen3.8 Max (0902)
- 77.1 GPT-5.6 Luna
- 76.2 Grok 4.6
- 76.2
Muse Spark Open
- 74.8 Hy4 Flash
- 74.7
DeepSeek V4 Flash 0731
- 74.6 GPT-5.6 Terra
- 73.9
MiniMax-M3.1-Flash
- 72.2
Muse Spark 1.1
- 71.0 Claude Opus 4.7
- 70.4
Step 5 Preview
- 70.4
Gemini 3.7 Flash
- 69.8 GPT-5.5
- 69.0 Grok 4.5
- 67.4 GPT-5.4
- 66.4 Beam 1.0
- 64.8
Qwen 3.8 27B
- 64.7
Qwen 3.8 Max
- 64.0
Gemini 3.6 Flash
- 64.0 GLM-5.2
- 61.8 GPT-5.3 Codex
- 60.9 Mercury 3
- 57.6 Claude Opus 4.6
- 55.8 Claude Sonnet 4.6
- 53.5 GPT-5.2
- 49.9
DeepSeek-V4-Pro
- 49.6 Composer 2.5
- 48.7
Gemini 3.5 Flash
- 48.0 GPT-5.4 Mini
- 47.7
Qwen3.7-Max
- 47.6
MiniMax-M3
- 47.2 Kimi K2.7 Code
- 46.4
Qwen3.7-Plus
- 42.2 MiMo-V2.5
- 37.9 GPT-5.2 Codex
- 37.9 Kimi K2.6
- 37.2
Gemini 3.5 Flash-Lite
- 34.1 MiMo-V2.5-Pro
- 32.0
Gemini 3.1 Pro
- 31.5 GLM-5.1
- 30.8 GLM-5.3-Flash
- 26.1 GPT-5.4 Nano
- 25.6
Qwen 3.6 Plus
- 24.6 GPT-5.1
- 23.4 GLM-5
- 22.6 Claude Sonnet 4.5
- 22.2 GPT-5.1-Codex-Max
- 20.6 Claude Opus 4.5
- 20.2
Gemini 3 Flash
- 20.1 GPT-5
- 19.7
Muse Spark
- 19.4 Grok 4.3
- 19.2
Inkling
- 19.1
Inkling-Small
- 17.5 Kimi K2.5
- 15.7
Qwen 3.5 Plus (hosted 397B-A17B)
- 14.8
MiniMax-M2.5
- 14.3
Gemini 3 Pro
- 14.2 GPT-5 mini
- 13.3 Grok Build 0.1
- 13.1 GPT-5.1-Codex
- 11.9
Qwen3.6 27B
- 11.9
MiniMax-M2.7
- 11.4 Claude Haiku 4.5
- 11.0
Laguna M.1
- 7.64
Nemotron 3 Ultra
- 7.22 SWE-1.6 Fast
- 5.21
Laguna XS.2
- 5.11
DeepSeek-V3.2
- 4.06 Grok 4.20
- 3.71
Nemotron 3.5 Super VL
- 3.68 Mercury 2.5
- 3.51
Qwen3-Max
- 3.40
Ling-3.0-flash-Fin
- 3.09 GLM-4.6
- 2.91
Ling-3.0-flash
- 2.89
Mistral Medium 3.5
- 1.20 Grok 4.1 Fast
- 0.40
Gemini 2.5 Pro
- 0.0 Grok 4 Fast
- 0.0
Gemini 3.1 Flash-Lite
- 0.0
Mistral Small 4
- 0.0
Nemotron 3.5 Lightning 30B-A3B
- 1 Claude Fable 5.2 93.8%
- 2
Gemini 4 Neon 93.7%
- 3 Claude Sonnet 5.5 92.4%
- 4
Gemini 4 Argon 91.9%
- 5 Claude Haiku 5.5 90.4%
- 6 Claude Fable 5 90.3%
- 7 Claude Opus 5.5 90.3%
- 8 Claude Fable 5.1 90.3%
- 9 GPT-6.2 Astra 89.9%
- 10 GPT-6 Astra 89.6%
- 11
Gemini 4 Carbon 89.1%
- 12 GPT-6.1 Sol 88.9%
- 13 Claude Opus 5 88.4%
- 14 GPT-6 Sol 87.8%
- 15
Gemini 4 Hydrogen 87.8%
- 16
DeepSeek V4.1 Flash 1017 87.7%
- 17 GPT-6.2 Sol 87.6%
- 18
Qwen4-Max 86.7%
- 19 Grok 4.7 86.2%
- 20
Muse Wonder Full 86%
- 21
Muse Spark 1.3 max 85.9%
- 22 MiMo-V2.6 Pro 85.2%
- 23 Kimi K3 85%
- 24 Kimi K3.1 Pro 84.9%
- 25
DeepSeek V4.1 Flash 84.7%
- 26 GPT-6.1 Terra 84%
- 27
Ember-1 83.9%
- 28
Muse Ember 83.7%
- 29
Muse Wonder 83.1%
- 30 Claude Opus 4.8 82.7%
- 31
DeepSeek V4 Pro 0813 82.3%
- 32 GPT-6 Luna 81.7%
- 33
Mistral Large 4 81.6%
- 34
Inkling 2 Small 81.5%
- 35 Claude Sonnet 5 81.3%
- 36
Tencent Hy4 81%
- 37 GPT-5.6 Sol 80.5%
- 38
Muse Spark 1.2 79.1%
- 39 MiMo-V2.6 Flash 79%
- 40
Gemini 3.8 Flash 78.7%
- 41
Mistral Large 4 Preview 78.4%
- 42 GLM-5.3 78.1%
- 43
Tencent Hy4 preview 77.5%
- 44
Qwen3.8 Max (0902) 77.1%
- 45 GPT-5.6 Luna 77.1%
- 46 Grok 4.6 76.2%
- 47
Muse Spark Open 76.2%
- 48 Hy4 Flash 74.8%
- 49
DeepSeek V4 Flash 0731 74.7%
- 50 GPT-5.6 Terra 74.6%
- 51
MiniMax-M3.1-Flash 73.9%
- 52
Muse Spark 1.1 72.2%
- 53 Claude Opus 4.7 71%
- 54
Step 5 Preview 70.4%
- 55
Gemini 3.7 Flash 70.4%
- 56 GPT-5.5 69.8%
- 57 Grok 4.5 69%
- 58 GPT-5.4 xhigh 67.4%
- 59 Beam 1.0 66.4%
- 60
Qwen 3.8 27B 64.8%
- 61
Qwen 3.8 Max 64.7%
- 62
Gemini 3.6 Flash 64%
- 63 GLM-5.2 64%
- 64 GPT-5.3 Codex 61.8%
- 65 Mercury 3 60.9%
- 66 Claude Opus 4.6 non-thinking 57.6%
- 67 Claude Sonnet 4.6 55.8%
- 68 GPT-5.2 53.5%
- 69
DeepSeek-V4-Pro 49.9%
- 70 Composer 2.5 49.6%
- 71
Gemini 3.5 Flash 48.7%
- 72 GPT-5.4 Mini 48%
- 73
Qwen3.7-Max 47.7%
- 74
MiniMax-M3 47.6%
- 75 Kimi K2.7 Code 47.2%
- 76
Qwen3.7-Plus 46.4%
- 77 MiMo-V2.5 42.2%
- 78 GPT-5.2 Codex 37.9%
- 79 Kimi K2.6 37.9%
- 80
Gemini 3.5 Flash-Lite 37.2%
- 81 MiMo-V2.5-Pro 34.1%
- 82
Gemini 3.1 Pro 32%
- 83 GLM-5.1 31.5%
- 84 GLM-5.3-Flash 30.8%
- 85 GPT-5.4 Nano 26.1%
- 86
Qwen 3.6 Plus 25.6%
- 87 GPT-5.1 24.6%
- 88 GLM-5 thinking 23.4%
- 89 Claude Sonnet 4.5 thinking 22.6%
- 90 GPT-5.1-Codex-Max 22.2%
- 91 Claude Opus 4.5 thinking 20.6%
- 92
Gemini 3 Flash 20.2%
- 93 GPT-5 20.1%
- 94
Muse Spark 19.7%
- 95 Grok 4.3 19.4%
- 96
Inkling 19.2%
- 97
Inkling-Small 19.1%
- 98 Kimi K2.5 thinking 17.5%
- 99
Qwen 3.5 Plus (hosted 397B-A17B) thinking 15.7%
- 100
MiniMax-M2.5 14.8%
- 101
Gemini 3 Pro 14.3%
- 102 GPT-5 mini 14.2%
- 103 Grok Build 0.1 13.3%
- 104 GPT-5.1-Codex 13.1%
- 105
Qwen3.6 27B 11.9%
- 106
MiniMax-M2.7 11.9%
- 107 Claude Haiku 4.5 thinking 11.4%
- 108
Laguna M.1 11%
- 109
Nemotron 3 Ultra 7.64%
- 110 SWE-1.6 Fast 7.22%
- 111
Laguna XS.2 5.21%
- 112
DeepSeek-V3.2 thinking 5.11%
- 113 Grok 4.20 reasoning 4.06%
- 114
Nemotron 3.5 Super VL 3.71%
- 115 Mercury 2.5 3.68%
- 116
Qwen3-Max 3.51%
- 117
Ling-3.0-flash-Fin 3.40%
- 118 GLM-4.6 3.09%
- 119
Ling-3.0-flash 2.91%
- 120
Mistral Medium 3.5 2.89%
- 121 Grok 4.1 Fast reasoning 1.20%
- 122
Gemini 2.5 Pro Jun 2025 0.40%
- 123 Grok 4 Fast reasoning 0%
- 124
Gemini 3.1 Flash-Lite 0%
- 125
Mistral Small 4 0%
- 126
Nemotron 3.5 Lightning 30B-A3B 0%
Source: Official Vibe Code Bench leaderboard
- 93.8 Claude Fable 5.2
- 93.7
Gemini 4 Neon
- 92.4 Claude Sonnet 5.5
- 91.9
Gemini 4 Argon
- 90.4 Claude Haiku 5.5
- 90.3 Claude Fable 5
- 90.3 Claude Opus 5.5
- 90.3 Claude Fable 5.1
- 89.9 GPT-6.2 Astra
- 89.6 GPT-6 Astra
- 89.1
Gemini 4 Carbon
- 88.9 GPT-6.1 Sol
- 88.4 Claude Opus 5
- 87.8 GPT-6 Sol
- 87.8
Gemini 4 Hydrogen
- 87.7
DeepSeek V4.1 Flash 1017
- 87.6 GPT-6.2 Sol
- 86.7
Qwen4-Max
- 86.2 Grok 4.7
- 86.0
Muse Wonder Full
- 85.9
Muse Spark 1.3
- 85.2 MiMo-V2.6 Pro
- 85.0 Kimi K3
- 84.9 Kimi K3.1 Pro
- 84.7
DeepSeek V4.1 Flash
- 84.0 GPT-6.1 Terra
- 83.9
Ember-1
- 83.7
Muse Ember
- 83.1
Muse Wonder
- 82.7 Claude Opus 4.8
- 82.3
DeepSeek V4 Pro 0813
- 81.7 GPT-6 Luna
- 81.6
Mistral Large 4
- 81.5
Inkling 2 Small
- 81.3 Claude Sonnet 5
- 81.0
Tencent Hy4
- 80.5 GPT-5.6 Sol
- 79.1
Muse Spark 1.2
- 79.0 MiMo-V2.6 Flash
- 78.7
Gemini 3.8 Flash
- 78.4
Mistral Large 4 Preview
- 78.1 GLM-5.3
- 77.5
Tencent Hy4 preview
- 77.1
Qwen3.8 Max (0902)
- 77.1 GPT-5.6 Luna
- 76.2 Grok 4.6
- 76.2
Muse Spark Open
- 74.7
DeepSeek V4 Flash 0731
- 74.6 GPT-5.6 Terra
- 73.9
MiniMax-M3.1-Flash
- 72.2
Muse Spark 1.1
- 71.0 Claude Opus 4.7
- 70.4
Step 5 Preview
- 70.4
Gemini 3.7 Flash
- 69.8 GPT-5.5
- 69.0 Grok 4.5
- 67.4 GPT-5.4
- 66.4 Beam 1.0
- 64.8
Qwen 3.8 27B
- 64.7
Qwen 3.8 Max
- 64.0
Gemini 3.6 Flash
- 64.0 GLM-5.2
- 61.8 GPT-5.3 Codex
- 60.9 Mercury 3
- 57.6 Claude Opus 4.6
- 55.8 Claude Sonnet 4.6
- 53.5 GPT-5.2
- 49.9
DeepSeek-V4-Pro
- 49.6 Composer 2.5
- 48.7
Gemini 3.5 Flash
- 48.0 GPT-5.4 Mini
- 47.7
Qwen3.7-Max
- 47.6
MiniMax-M3
- 47.2 Kimi K2.7 Code
- 46.4
Qwen3.7-Plus
- 42.2 MiMo-V2.5
- 37.9 GPT-5.2 Codex
- 37.9 Kimi K2.6
- 37.2
Gemini 3.5 Flash-Lite
- 34.1 MiMo-V2.5-Pro
- 32.0
Gemini 3.1 Pro
- 31.5 GLM-5.1
- 30.8 GLM-5.3-Flash
- 26.1 GPT-5.4 Nano
- 25.6
Qwen 3.6 Plus
- 24.6 GPT-5.1
- 23.4 GLM-5
- 22.6 Claude Sonnet 4.5
- 22.2 GPT-5.1-Codex-Max
- 20.6 Claude Opus 4.5
- 20.2
Gemini 3 Flash
- 20.1 GPT-5
- 19.7
Muse Spark
- 19.4 Grok 4.3
- 19.2
Inkling
- 19.1
Inkling-Small
- 17.5 Kimi K2.5
- 15.7
Qwen 3.5 Plus (hosted 397B-A17B)
- 14.8
MiniMax-M2.5
- 14.3
Gemini 3 Pro
- 14.2 GPT-5 mini
- 13.3 Grok Build 0.1
- 13.1 GPT-5.1-Codex
- 11.9
Qwen3.6 27B
- 11.9
MiniMax-M2.7
- 11.4 Claude Haiku 4.5
- 11.0
Laguna M.1
- 7.64
Nemotron 3 Ultra
- 5.21
Laguna XS.2
- 5.11
DeepSeek-V3.2
- 4.06 Grok 4.20
- 3.71
Nemotron 3.5 Super VL
- 3.68 Mercury 2.5
- 3.51
Qwen3-Max
- 3.40
Ling-3.0-flash-Fin
- 3.09 GLM-4.6
- 2.91
Ling-3.0-flash
- 2.89
Mistral Medium 3.5
- 1.20 Grok 4.1 Fast
- 0.40
Gemini 2.5 Pro
- 0.0 Grok 4 Fast
- 0.0
Gemini 3.1 Flash-Lite
- 0.0
Mistral Small 4
- 0.0
Nemotron 3.5 Lightning 30B-A3B
- 1 Claude Fable 5.2 93.8%
- 2
Gemini 4 Neon 93.7%
- 3 Claude Sonnet 5.5 92.4%
- 4
Gemini 4 Argon 91.9%
- 5 Claude Haiku 5.5 90.4%
- 6 Claude Fable 5 90.3%
- 7 Claude Opus 5.5 90.3%
- 8 Claude Fable 5.1 90.3%
- 9 GPT-6.2 Astra 89.9%
- 10 GPT-6 Astra 89.6%
- 11
Gemini 4 Carbon 89.1%
- 12 GPT-6.1 Sol 88.9%
- 13 Claude Opus 5 88.4%
- 14 GPT-6 Sol 87.8%
- 15
Gemini 4 Hydrogen 87.8%
- 16
DeepSeek V4.1 Flash 1017 87.7%
- 17 GPT-6.2 Sol 87.6%
- 18
Qwen4-Max 86.7%
- 19 Grok 4.7 86.2%
- 20
Muse Wonder Full 86%
- 21
Muse Spark 1.3 max 85.9%
- 22 MiMo-V2.6 Pro 85.2%
- 23 Kimi K3 85%
- 24 Kimi K3.1 Pro 84.9%
- 25
DeepSeek V4.1 Flash 84.7%
- 26 GPT-6.1 Terra 84%
- 27
Ember-1 83.9%
- 28
Muse Ember 83.7%
- 29
Muse Wonder 83.1%
- 30 Claude Opus 4.8 82.7%
- 31
DeepSeek V4 Pro 0813 82.3%
- 32 GPT-6 Luna 81.7%
- 33
Mistral Large 4 81.6%
- 34
Inkling 2 Small 81.5%
- 35 Claude Sonnet 5 81.3%
- 36
Tencent Hy4 81%
- 37 GPT-5.6 Sol 80.5%
- 38
Muse Spark 1.2 79.1%
- 39 MiMo-V2.6 Flash 79%
- 40
Gemini 3.8 Flash 78.7%
- 41
Mistral Large 4 Preview 78.4%
- 42 GLM-5.3 78.1%
- 43
Tencent Hy4 preview 77.5%
- 44
Qwen3.8 Max (0902) 77.1%
- 45 GPT-5.6 Luna 77.1%
- 46 Grok 4.6 76.2%
- 47
Muse Spark Open 76.2%
- 48
DeepSeek V4 Flash 0731 74.7%
- 49 GPT-5.6 Terra 74.6%
- 50
MiniMax-M3.1-Flash 73.9%
- 51
Muse Spark 1.1 72.2%
- 52 Claude Opus 4.7 71%
- 53
Step 5 Preview 70.4%
- 54
Gemini 3.7 Flash 70.4%
- 55 GPT-5.5 69.8%
- 56 Grok 4.5 69%
- 57 GPT-5.4 xhigh 67.4%
- 58 Beam 1.0 66.4%
- 59
Qwen 3.8 27B 64.8%
- 60
Qwen 3.8 Max 64.7%
- 61
Gemini 3.6 Flash 64%
- 62 GLM-5.2 64%
- 63 GPT-5.3 Codex 61.8%
- 64 Mercury 3 60.9%
- 65 Claude Opus 4.6 non-thinking 57.6%
- 66 Claude Sonnet 4.6 55.8%
- 67 GPT-5.2 53.5%
- 68
DeepSeek-V4-Pro 49.9%
- 69 Composer 2.5 49.6%
- 70
Gemini 3.5 Flash 48.7%
- 71 GPT-5.4 Mini 48%
- 72
Qwen3.7-Max 47.7%
- 73
MiniMax-M3 47.6%
- 74 Kimi K2.7 Code 47.2%
- 75
Qwen3.7-Plus 46.4%
- 76 MiMo-V2.5 42.2%
- 77 GPT-5.2 Codex 37.9%
- 78 Kimi K2.6 37.9%
- 79
Gemini 3.5 Flash-Lite 37.2%
- 80 MiMo-V2.5-Pro 34.1%
- 81
Gemini 3.1 Pro 32%
- 82 GLM-5.1 31.5%
- 83 GLM-5.3-Flash 30.8%
- 84 GPT-5.4 Nano 26.1%
- 85
Qwen 3.6 Plus 25.6%
- 86 GPT-5.1 24.6%
- 87 GLM-5 thinking 23.4%
- 88 Claude Sonnet 4.5 thinking 22.6%
- 89 GPT-5.1-Codex-Max 22.2%
- 90 Claude Opus 4.5 thinking 20.6%
- 91
Gemini 3 Flash 20.2%
- 92 GPT-5 20.1%
- 93
Muse Spark 19.7%
- 94 Grok 4.3 19.4%
- 95
Inkling 19.2%
- 96
Inkling-Small 19.1%
- 97 Kimi K2.5 thinking 17.5%
- 98
Qwen 3.5 Plus (hosted 397B-A17B) thinking 15.7%
- 99
MiniMax-M2.5 14.8%
- 100
Gemini 3 Pro 14.3%
- 101 GPT-5 mini 14.2%
- 102 Grok Build 0.1 13.3%
- 103 GPT-5.1-Codex 13.1%
- 104
Qwen3.6 27B 11.9%
- 105
MiniMax-M2.7 11.9%
- 106 Claude Haiku 4.5 thinking 11.4%
- 107
Laguna M.1 11%
- 108
Nemotron 3 Ultra 7.64%
- 109
Laguna XS.2 5.21%
- 110
DeepSeek-V3.2 thinking 5.11%
- 111 Grok 4.20 reasoning 4.06%
- 112
Nemotron 3.5 Super VL 3.71%
- 113 Mercury 2.5 3.68%
- 114
Qwen3-Max 3.51%
- 115
Ling-3.0-flash-Fin 3.40%
- 116 GLM-4.6 3.09%
- 117
Ling-3.0-flash 2.91%
- 118
Mistral Medium 3.5 2.89%
- 119 Grok 4.1 Fast reasoning 1.20%
- 120
Gemini 2.5 Pro Jun 2025 0.40%
- 121 Grok 4 Fast reasoning 0%
- 122
Gemini 3.1 Flash-Lite 0%
- 123
Mistral Small 4 0%
- 124
Nemotron 3.5 Lightning 30B-A3B 0%
Source: Official Vibe Code Bench leaderboard
- 93.8 Claude Fable 5.2
- 93.7
Gemini 4 Neon
- 92.4 Claude Sonnet 5.5
- 91.9
Gemini 4 Argon
- 90.4 Claude Haiku 5.5
- 90.3 Claude Fable 5
- 90.3 Claude Opus 5.5
- 90.3 Claude Fable 5.1
- 89.9 GPT-6.2 Astra
- 89.6 GPT-6 Astra
- 89.1
Gemini 4 Carbon
- 88.9 GPT-6.1 Sol
- 88.4 Claude Opus 5
- 87.8 GPT-6 Sol
- 87.8
Gemini 4 Hydrogen
- 87.7
DeepSeek V4.1 Flash 1017
- 87.6 GPT-6.2 Sol
- 86.7
Qwen4-Max
- 86.2 Grok 4.7
- 86.0
Muse Wonder Full
- 85.9
Muse Spark 1.3
- 85.2 MiMo-V2.6 Pro
- 85.0 Kimi K3
- 84.9 Kimi K3.1 Pro
- 84.7
DeepSeek V4.1 Flash
- 84.0 GPT-6.1 Terra
- 83.9
Ember-1
- 83.7
Muse Ember
- 83.1
Muse Wonder
- 82.7 Claude Opus 4.8
- 82.3
DeepSeek V4 Pro 0813
- 81.7 GPT-6 Luna
- 81.6
Inkling 2 Small
- 81.6
Mistral Large 4
- 81.3 Claude Sonnet 5
- 81.0
Tencent Hy4
- 80.5 GPT-5.6 Sol
- 79.1
Muse Spark 1.2
- 79.0 MiMo-V2.6 Flash
- 78.7
Gemini 3.8 Flash
- 78.4
Mistral Large 4 Preview
- 78.1 GLM-5.3
- 77.9
Inkling 2 Mini
- 77.5
Tencent Hy4 preview
- 77.1
Qwen3.8 Max (0902)
- 77.1 GPT-5.6 Luna
- 76.2 Grok 4.6
- 76.2
Muse Spark Open
- 74.7
DeepSeek V4 Flash 0731
- 74.6 GPT-5.6 Terra
- 73.9
MiniMax-M3.1-Flash
- 72.2
Muse Spark 1.1
- 71.0 Claude Opus 4.7
- 70.4
Step 5 Preview
- 70.4
Gemini 3.7 Flash
- 69.8 GPT-5.5
- 69.0 Grok 4.5
- 67.4 GPT-5.4
- 66.4 Beam 1.0
- 64.8
Qwen 3.8 27B
- 64.7
Qwen 3.8 Max
- 64.0
Gemini 3.6 Flash
- 64.0 GLM-5.2
- 61.8 GPT-5.3 Codex
- 60.9 Mercury 3
- 57.6 Claude Opus 4.6
- 55.8 Claude Sonnet 4.6
- 53.5 GPT-5.2
- 49.9
DeepSeek-V4-Pro
- 49.6 Composer 2.5
- 48.7
Gemini 3.5 Flash
- 48.0 GPT-5.4 Mini
- 47.7
Qwen3.7-Max
- 47.6
MiniMax-M3
- 47.2 Kimi K2.7 Code
- 46.4
Qwen3.7-Plus
- 42.2 MiMo-V2.5
- 37.9 GPT-5.2 Codex
- 37.9 Kimi K2.6
- 37.2
Gemini 3.5 Flash-Lite
- 34.1 MiMo-V2.5-Pro
- 32.0
Gemini 3.1 Pro
- 31.5 GLM-5.1
- 30.8 GLM-5.3-Flash
- 26.1 GPT-5.4 Nano
- 25.6
Qwen 3.6 Plus
- 24.6 GPT-5.1
- 23.4 GLM-5
- 22.6 Claude Sonnet 4.5
- 22.2 GPT-5.1-Codex-Max
- 20.6 Claude Opus 4.5
- 20.2
Gemini 3 Flash
- 20.1 GPT-5
- 19.7
Muse Spark
- 19.4 Grok 4.3
- 19.2
Inkling
- 19.1
Inkling-Small
- 17.5 Kimi K2.5
- 15.7
Qwen 3.5 Plus (hosted 397B-A17B)
- 14.8
MiniMax-M2.5
- 14.3
Gemini 3 Pro
- 14.2 GPT-5 mini
- 13.3 Grok Build 0.1
- 13.1 GPT-5.1-Codex
- 11.9
Qwen3.6 27B
- 11.9
MiniMax-M2.7
- 11.4 Claude Haiku 4.5
- 11.0
Laguna M.1
- 7.64
Nemotron 3 Ultra
- 5.21
Laguna XS.2
- 5.11
DeepSeek-V3.2
- 4.06 Grok 4.20
- 3.71
Nemotron 3.5 Super VL
- 3.68 Mercury 2.5
- 3.51
Qwen3-Max
- 3.40
Ling-3.0-flash-Fin
- 3.09 GLM-4.6
- 2.91
Ling-3.0-flash
- 2.89
Mistral Medium 3.5
- 1.20 Grok 4.1 Fast
- 0.40
Gemini 2.5 Pro
- 0.0 Grok 4 Fast
- 0.0
Gemini 3.1 Flash-Lite
- 0.0
Mistral Small 4
- 0.0
Nemotron 3.5 Lightning 30B-A3B
- 1 Claude Fable 5.2 93.8%
- 2
Gemini 4 Neon 93.7%
- 3 Claude Sonnet 5.5 92.4%
- 4
Gemini 4 Argon 91.9%
- 5 Claude Haiku 5.5 90.4%
- 6 Claude Fable 5 90.3%
- 7 Claude Opus 5.5 90.3%
- 8 Claude Fable 5.1 90.3%
- 9 GPT-6.2 Astra 89.9%
- 10 GPT-6 Astra 89.6%
- 11
Gemini 4 Carbon 89.1%
- 12 GPT-6.1 Sol 88.9%
- 13 Claude Opus 5 88.4%
- 14 GPT-6 Sol 87.8%
- 15
Gemini 4 Hydrogen 87.8%
- 16
DeepSeek V4.1 Flash 1017 87.7%
- 17 GPT-6.2 Sol 87.6%
- 18
Qwen4-Max 86.7%
- 19 Grok 4.7 86.2%
- 20
Muse Wonder Full 86%
- 21
Muse Spark 1.3 max 85.9%
- 22 MiMo-V2.6 Pro 85.2%
- 23 Kimi K3 85%
- 24 Kimi K3.1 Pro 84.9%
- 25
DeepSeek V4.1 Flash 84.7%
- 26 GPT-6.1 Terra 84%
- 27
Ember-1 83.9%
- 28
Muse Ember 83.7%
- 29
Muse Wonder 83.1%
- 30 Claude Opus 4.8 82.7%
- 31
DeepSeek V4 Pro 0813 82.3%
- 32 GPT-6 Luna 81.7%
- 33
Inkling 2 Small 81.6%
- 34
Mistral Large 4 81.6%
- 35 Claude Sonnet 5 81.3%
- 36
Tencent Hy4 81%
- 37 GPT-5.6 Sol 80.5%
- 38
Muse Spark 1.2 79.1%
- 39 MiMo-V2.6 Flash 79%
- 40
Gemini 3.8 Flash 78.7%
- 41
Mistral Large 4 Preview 78.4%
- 42 GLM-5.3 78.1%
- 43
Inkling 2 Mini 77.9%
- 44
Tencent Hy4 preview 77.5%
- 45
Qwen3.8 Max (0902) 77.1%
- 46 GPT-5.6 Luna 77.1%
- 47 Grok 4.6 76.2%
- 48
Muse Spark Open 76.2%
- 49
DeepSeek V4 Flash 0731 74.7%
- 50 GPT-5.6 Terra 74.6%
- 51
MiniMax-M3.1-Flash 73.9%
- 52
Muse Spark 1.1 72.2%
- 53 Claude Opus 4.7 71%
- 54
Step 5 Preview 70.4%
- 55
Gemini 3.7 Flash 70.4%
- 56 GPT-5.5 69.8%
- 57 Grok 4.5 69%
- 58 GPT-5.4 xhigh 67.4%
- 59 Beam 1.0 66.4%
- 60
Qwen 3.8 27B 64.8%
- 61
Qwen 3.8 Max 64.7%
- 62
Gemini 3.6 Flash 64%
- 63 GLM-5.2 64%
- 64 GPT-5.3 Codex 61.8%
- 65 Mercury 3 60.9%
- 66 Claude Opus 4.6 non-thinking 57.6%
- 67 Claude Sonnet 4.6 55.8%
- 68 GPT-5.2 53.5%
- 69
DeepSeek-V4-Pro 49.9%
- 70 Composer 2.5 49.6%
- 71
Gemini 3.5 Flash 48.7%
- 72 GPT-5.4 Mini 48%
- 73
Qwen3.7-Max 47.7%
- 74
MiniMax-M3 47.6%
- 75 Kimi K2.7 Code 47.2%
- 76
Qwen3.7-Plus 46.4%
- 77 MiMo-V2.5 42.2%
- 78 GPT-5.2 Codex 37.9%
- 79 Kimi K2.6 37.9%
- 80
Gemini 3.5 Flash-Lite 37.2%
- 81 MiMo-V2.5-Pro 34.1%
- 82
Gemini 3.1 Pro 32%
- 83 GLM-5.1 31.5%
- 84 GLM-5.3-Flash 30.8%
- 85 GPT-5.4 Nano 26.1%
- 86
Qwen 3.6 Plus 25.6%
- 87 GPT-5.1 24.6%
- 88 GLM-5 thinking 23.4%
- 89 Claude Sonnet 4.5 thinking 22.6%
- 90 GPT-5.1-Codex-Max 22.2%
- 91 Claude Opus 4.5 thinking 20.6%
- 92
Gemini 3 Flash 20.2%
- 93 GPT-5 20.1%
- 94
Muse Spark 19.7%
- 95 Grok 4.3 19.4%
- 96
Inkling 19.2%
- 97
Inkling-Small 19.1%
- 98 Kimi K2.5 thinking 17.5%
- 99
Qwen 3.5 Plus (hosted 397B-A17B) thinking 15.7%
- 100
MiniMax-M2.5 14.8%
- 101
Gemini 3 Pro 14.3%
- 102 GPT-5 mini 14.2%
- 103 Grok Build 0.1 13.3%
- 104 GPT-5.1-Codex 13.1%
- 105
Qwen3.6 27B 11.9%
- 106
MiniMax-M2.7 11.9%
- 107 Claude Haiku 4.5 thinking 11.4%
- 108
Laguna M.1 11%
- 109
Nemotron 3 Ultra 7.64%
- 110
Laguna XS.2 5.21%
- 111
DeepSeek-V3.2 thinking 5.11%
- 112 Grok 4.20 reasoning 4.06%
- 113
Nemotron 3.5 Super VL 3.71%
- 114 Mercury 2.5 3.68%
- 115
Qwen3-Max 3.51%
- 116
Ling-3.0-flash-Fin 3.40%
- 117 GLM-4.6 3.09%
- 118
Ling-3.0-flash 2.91%
- 119
Mistral Medium 3.5 2.89%
- 120 Grok 4.1 Fast reasoning 1.20%
- 121
Gemini 2.5 Pro Jun 2025 0.40%
- 122 Grok 4 Fast reasoning 0%
- 123
Gemini 3.1 Flash-Lite 0%
- 124
Mistral Small 4 0%
- 125
Nemotron 3.5 Lightning 30B-A3B 0%
Sources: Official Vibe Code Bench leaderboard and labs’ model cards
| # | Entry | Score ± 95% CI | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 93.8% ±2.3 | OpenHands | Nov 2026 | Official leaderboard |
| 2 | | 93.7% ±2.3 | OpenHands | Nov 2026 | Official leaderboard |
| 3 | Claude Sonnet 5.5 | 92.4% ±2.5 | OpenHands | Sep 2026 | Official leaderboard |
| 4 | | 91.9% ±3.7 | OpenHands | Sep 2026 | Official leaderboard |
| 5 | Claude Haiku 5.5 | 90.4% ±3.4 | OpenHands | Oct 2026 | Official leaderboard |
| 6 | Claude Fable 5 | 90.3% ±4.1 | OpenHands | Jun 2026 | Official leaderboard |
| 7 | Claude Opus 5.5 | 90.3% ±3 | OpenHands | Sep 2026 | Official leaderboard |
| 8 | Claude Fable 5.1 | 90.3% ±3.1 | OpenHands | Sep 2026 | Official leaderboard |
| 9 | GPT-6.2 Astra | 89.9% ±4 | OpenHands | Nov 2026 | Official leaderboard |
| 10 | GPT-6 Astra | 89.6% ±4.3 | OpenHands | Sep 2026 | Official leaderboard |
| 11 | | 89.1% ±4.5 | OpenHands | Oct 2026 | Official leaderboard |
| 12 | GPT-6.1 Sol | 88.9% ±3.7 | OpenHands | Sep 2026 | Official leaderboard |
| 13 | Claude Opus 5 | 88.4% ±5.9 | OpenHands | Jul 2026 | Official leaderboard |
| 14 | GPT-6 Sol | 87.8% ±5 | OpenHands | Sep 2026 | Official leaderboard |
| 15 | | 87.8% ±4.5 | OpenHands | Nov 2026 | Official leaderboard |
| 16 | | 87.7% ±5.4 | OpenHands | Oct 2026 | Official leaderboard |
| 17 | GPT-6.2 Sol | 87.6% ±4.3 | OpenHands | Nov 2026 | Official leaderboard |
| 18 | | 86.7% ±4.5 | OpenHands | Nov 2026 | Official leaderboard |
| 19 | Grok 4.7 | 86.2% ±4.3 | OpenHands | Sep 2026 | Official leaderboard |
| 20 | | 86% ±3.8 | OpenHands | Oct 2026 | Official leaderboard |
| 21 | | 85.9% ±4.9 | max, OpenHands | Sep 2026 | Official leaderboard |
| 22 | MiMo-V2.6 Pro | 85.2% ±6.6 | OpenHands | Sep 2026 | Official leaderboard |
| 23 | Kimi K3 | 85% ±5.4 | OpenHands | Jul 2026 | Official leaderboard |
| 24 | Kimi K3.1 Pro | 84.9% ±5.8 | OpenHands | Oct 2026 | Official leaderboard |
| 25 | | 84.7% ±5.7 | OpenHands | Sep 2026 | Official leaderboard |
| 26 | GPT-6.1 Terra | 84% ±5.6 | OpenHands | Oct 2026 | Official leaderboard |
| 27 | | 83.9% ±6.2 | OpenHands | Sep 2026 | Official leaderboard |
| 28 | | 83.7% ±5.4 | OpenHands | Nov 2026 | Official leaderboard |
| 29 | | 83.1% ±4.9 | OpenHands | Oct 2026 | Official leaderboard |
| 30 | Claude Opus 4.8 | 82.7% ±6 | OpenHands | May 2026 | Official leaderboard |
| 31 | | 82.3% ±6.2 | OpenHands | Aug 2026 | Official leaderboard |
| 32 | GPT-6 Luna | 81.7% ±6.6 | OpenHands | Sep 2026 | Official leaderboard |
| 33 | | 81.6% ±6.4 | OpenHands | Oct 2026 | Official leaderboard |
| 34 | | 81.5% ±6.8 | OpenHands | Nov 2026 | Official leaderboard |
| 35 | Claude Sonnet 5 | 81.3% ±6 | OpenHands | Jun 2026 | Official leaderboard |
| 36 | | 81% ±7 | OpenHands | Nov 2026 | Official leaderboard |
| 37 | GPT-5.6 Sol | 80.5% ±7.3 | OpenHands | Jul 2026 | Official leaderboard |
| 38 | | 79.1% ±6.5 | OpenHands | Aug 2026 | Official leaderboard |
| 39 | MiMo-V2.6 Flash | 79% ±7.9 | OpenHands | Sep 2026 | Official leaderboard |
| 40 | | 78.7% ±7.6 | OpenHands | Sep 2026 | Official leaderboard |
| 41 | | 78.4% ±7 | OpenHands | Oct 2026 | Official leaderboard |
| 42 | GLM-5.3 | 78.1% ±7.7 | OpenHands | Aug 2026 | Official leaderboard |
| 43 | | 77.5% ±7.9 | OpenHands | Aug 2026 | Official leaderboard |
| 44 | | 77.1% ±7.3 | OpenHands | Sep 2026 | Official leaderboard |
| 45 | GPT-5.6 Luna | 77.1% ±6 | OpenHands | Jul 2026 | Official leaderboard |
| 46 | Grok 4.6 | 76.2% ±7.5 | OpenHands | Aug 2026 | Official leaderboard |
| 47 | | 76.2% ±6.5 | OpenHands | Oct 2026 | Official leaderboard |
| 48 | Hy4 Flash | 74.8% ±7.6 | OpenHands | Official leaderboard | |
| 49 | | 74.7% ±6.7 | OpenHands | Jul 2026 | Official leaderboard |
| 50 | GPT-5.6 Terra | 74.6% ±8.2 | OpenHands | Jul 2026 | Official leaderboard |
| 51 | | 73.9% ±8.3 | OpenHands | Oct 2026 | Official leaderboard |
| 52 | | 72.2% ±6.5 | OpenHands | Jul 2026 | Official leaderboard |
| 53 | Claude Opus 4.7 | 71% ±8.8 | OpenHands | Apr 2026 | Official leaderboard |
| 54 | | 70.4% ±8.4 | OpenHands | Sep 2026 | Official leaderboard |
| 55 | | 70.4% ±9.5 | OpenHands | Aug 2026 | Official leaderboard |
| 56 | GPT-5.5 | 69.8% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 57 | Grok 4.5 | 69% ±8.8 | OpenHands | Jul 2026 | Official leaderboard |
| 58 | GPT-5.4 | 67.4% ±9.5 | xhigh, OpenHands | Mar 2026 | Official leaderboard |
| 59 | Beam 1.0 | 66.4% ±8 | OpenHands | Oct 2026 | Official leaderboard |
| 60 | | 64.8% ±9.5 | OpenHands | Aug 2026 | Official leaderboard |
| 61 | | 64.7% ±10.5 | OpenHands | Aug 2026 | Official leaderboard |
| 62 | | 64% ±8.4 | OpenHands | Jul 2026 | Official leaderboard |
| 63 | GLM-5.2 | 64% ±9.4 | OpenHands | Jun 2026 | Official leaderboard |
| 64 | GPT-5.3 Codex | 61.8% ±9.2 | OpenHands | Feb 2026 | Official leaderboard |
| 65 | Mercury 3 | 60.9% ±10.5 | OpenHands | Oct 2026 | Official leaderboard |
| 66 | Claude Opus 4.6 | 57.6% ±8.6 | non-thinking, OpenHands | Feb 2026 | Official leaderboard |
| 67 | Claude Sonnet 4.6 | 55.8% ±9.2 | Claude Code | Feb 2026 | Official leaderboard |
| 68 | GPT-5.2 | 53.5% ±9.9 | OpenHands | Dec 2025 | Official leaderboard |
| 69 | | 49.9% ±9.3 | OpenHands | Apr 2026 | Official leaderboard |
| 70 | Composer 2.5 | 49.6% ±9.7 | Cursor CLI | May 2026 | Official leaderboard |
| 71 | | 48.7% ±9.3 | OpenHands | May 2026 | Official leaderboard |
| 72 | GPT-5.4 Mini | 48% ±11 | OpenHands | Mar 2026 | Official leaderboard |
| 73 | | 47.7% ±9.1 | OpenHands | May 2026 | Official leaderboard |
| 74 | | 47.6% ±10.7 | OpenHands | Jun 2026 | Official leaderboard |
| 75 | Kimi K2.7 Code | 47.2% ±10.2 | OpenHands | Jun 2026 | Official leaderboard |
| 76 | | 46.4% ±9 | OpenHands | Jun 2026 | Official leaderboard |
| 77 | MiMo-V2.5 | 42.2% ±9 | OpenHands | Apr 2026 | Official leaderboard |
| 78 | GPT-5.2 Codex | 37.9% ±9 | OpenHands | Dec 2025 | Official leaderboard |
| 79 | Kimi K2.6 | 37.9% ±9.6 | OpenHands | Apr 2026 | Official leaderboard |
| 80 | | 37.2% ±9.1 | OpenHands | Jul 2026 | Official leaderboard |
| 81 | MiMo-V2.5-Pro | 34.1% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 82 | | 32% ±8.5 | OpenHands | Feb 2026 | Official leaderboard |
| 83 | GLM-5.1 | 31.5% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 84 | GLM-5.3-Flash | 30.8% ±10.3 | OpenHands | Aug 2026 | Official leaderboard |
| 85 | GPT-5.4 Nano | 26.1% ±9.9 | OpenHands | Mar 2026 | Official leaderboard |
| 86 | | 25.6% ±7.7 | OpenHands | Mar 2026 | Official leaderboard |
| 87 | GPT-5.1 | 24.6% ±8.3 | OpenHands | Nov 2025 | Official leaderboard |
| 88 | GLM-5 | 23.4% ±7.9 | thinking, OpenHands | Feb 2026 | Official leaderboard |
| 89 | Claude Sonnet 4.5 | 22.6% ±7.3 | thinking, OpenHands | Sep 2025 | Official leaderboard |
| 90 | GPT-5.1-Codex-Max | 22.2% ±7.5 | OpenHands | Nov 2025 | Official leaderboard |
| 91 | Claude Opus 4.5 | 20.6% ±6.2 | thinking, OpenHands | Nov 2025 | Official leaderboard |
| 92 | | 20.2% ±7.7 | OpenHands | Dec 2025 | Official leaderboard |
| 93 | GPT-5 | 20.1% ±6.7 | OpenHands | Aug 2025 | Official leaderboard |
| 94 | | 19.7% ±7.8 | OpenHands | Apr 2026 | Official leaderboard |
| 95 | Grok 4.3 | 19.4% ±8.3 | OpenHands | Apr 2026 | Official leaderboard |
| 96 | | 19.2% ±7.2 | OpenHands | Jul 2026 | Official leaderboard |
| 97 | | 19.1% ±6.7 | OpenHands | Jul 2026 | Official leaderboard |
| 98 | Kimi K2.5 | 17.5% ±6.4 | thinking, OpenHands | Jan 2026 | Official leaderboard |
| 99 | | 15.7% ±6.2 | thinking, OpenHands | Feb 2026 | Official leaderboard |
| 100 | | 14.8% ±5.8 | OpenHands | Feb 2026 | Official leaderboard |
| 101 | | 14.3% ±6 | OpenHands | Nov 2025 | Official leaderboard |
| 102 | GPT-5 mini | 14.2% ±6.9 | OpenHands | Aug 2025 | Official leaderboard |
| 103 | Grok Build 0.1 | 13.3% ±7.5 | Grok Build | May 2026 | Official leaderboard |
| 104 | GPT-5.1-Codex | 13.1% ±6.2 | OpenHands | Nov 2025 | Official leaderboard |
| 105 | | 11.9% ±6.7 | OpenHands | Apr 2026 | Official leaderboard |
| 106 | | 11.9% ±5.6 | OpenHands | Mar 2026 | Official leaderboard |
| 107 | Claude Haiku 4.5 | 11.4% ±6.1 | thinking, OpenHands | Oct 2025 | Official leaderboard |
| 108 | | 11% ±5.5 | OpenHands | Apr 2026 | Official leaderboard |
| 109 | | 7.64% ±5.5 | OpenHands | Jun 2026 | Official leaderboard |
| 110 | SWE-1.6 Fast | 7.22% ±5.2 | Devin CLI | Official leaderboard | |
| 111 | | 5.21% ±4.3 | OpenHands | Apr 2026 | Official leaderboard |
| 112 | | 5.11% ±4.2 | thinking, OpenHands | Dec 2025 | Official leaderboard |
| 113 | Grok 4.20 | 4.06% ±4 | reasoning, OpenHands | Feb 2026 | Official leaderboard |
| 114 | | 3.71% ±3.8 | OpenHands | Oct 2026 | Official leaderboard |
| 115 | Mercury 2.5 | 3.68% ±2.8 | OpenHands | Sep 2026 | Official leaderboard |
| 116 | | 3.51% ±2.5 | OpenHands | Sep 2025 | Official leaderboard |
| 117 | | 3.40% ±2.5 | OpenHands | Sep 2026 | Official leaderboard |
| 118 | GLM-4.6 | 3.09% ±2.3 | OpenHands | Sep 2025 | Official leaderboard |
| 119 | | 2.91% ±4.1 | OpenHands | Aug 2026 | Official leaderboard |
| 120 | | 2.89% ±3.4 | OpenHands | Apr 2026 | Official leaderboard |
| 121 | Grok 4.1 Fast | 1.20% ±2.4 | reasoning, OpenHands | Nov 2025 | Official leaderboard |
| 122 | | 0.40% ±0.8 | OpenHands | Jun 2025 | Official leaderboard |
| 123 | Grok 4 Fast | 0% | reasoning, OpenHands | Sep 2025 | Official leaderboard |
| 124 | | 0% | OpenHands | Mar 2026 | Official leaderboard |
| 125 | | 0% | OpenHands | Mar 2026 | Official leaderboard |
| 126 | | 0% | OpenHands | Aug 2026 | Official leaderboard |
| # | Model | Score ± 95% CI | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 93.8% ±2.3 | OpenHands | Nov 2026 | Official leaderboard |
| 2 | | 93.7% ±2.3 | OpenHands | Nov 2026 | Official leaderboard |
| 3 | Claude Sonnet 5.5 | 92.4% ±2.5 | OpenHands | Sep 2026 | Official leaderboard |
| 4 | | 91.9% ±3.7 | OpenHands | Sep 2026 | Official leaderboard |
| 5 | Claude Haiku 5.5 | 90.4% ±3.4 | OpenHands | Oct 2026 | Official leaderboard |
| 6 | Claude Fable 5 | 90.3% ±4.1 | OpenHands | Jun 2026 | Official leaderboard |
| 7 | Claude Opus 5.5 | 90.3% ±3 | OpenHands | Sep 2026 | Official leaderboard |
| 8 | Claude Fable 5.1 | 90.3% ±3.1 | OpenHands | Sep 2026 | Official leaderboard |
| 9 | GPT-6.2 Astra | 89.9% ±4 | OpenHands | Nov 2026 | Official leaderboard |
| 10 | GPT-6 Astra | 89.6% ±4.3 | OpenHands | Sep 2026 | Official leaderboard |
| 11 | | 89.1% ±4.5 | OpenHands | Oct 2026 | Official leaderboard |
| 12 | GPT-6.1 Sol | 88.9% ±3.7 | OpenHands | Sep 2026 | Official leaderboard |
| 13 | Claude Opus 5 | 88.4% ±5.9 | OpenHands | Jul 2026 | Official leaderboard |
| 14 | GPT-6 Sol | 87.8% ±5 | OpenHands | Sep 2026 | Official leaderboard |
| 15 | | 87.8% ±4.5 | OpenHands | Nov 2026 | Official leaderboard |
| 16 | | 87.7% ±5.4 | OpenHands | Oct 2026 | Official leaderboard |
| 17 | GPT-6.2 Sol | 87.6% ±4.3 | OpenHands | Nov 2026 | Official leaderboard |
| 18 | | 86.7% ±4.5 | OpenHands | Nov 2026 | Official leaderboard |
| 19 | Grok 4.7 | 86.2% ±4.3 | OpenHands | Sep 2026 | Official leaderboard |
| 20 | | 86% ±3.8 | OpenHands | Oct 2026 | Official leaderboard |
| 21 | | 85.9% ±4.9 | max, OpenHands | Sep 2026 | Official leaderboard |
| 22 | MiMo-V2.6 Pro | 85.2% ±6.6 | OpenHands | Sep 2026 | Official leaderboard |
| 23 | Kimi K3 | 85% ±5.4 | OpenHands | Jul 2026 | Official leaderboard |
| 24 | Kimi K3.1 Pro | 84.9% ±5.8 | OpenHands | Oct 2026 | Official leaderboard |
| 25 | | 84.7% ±5.7 | OpenHands | Sep 2026 | Official leaderboard |
| 26 | GPT-6.1 Terra | 84% ±5.6 | OpenHands | Oct 2026 | Official leaderboard |
| 27 | | 83.9% ±6.2 | OpenHands | Sep 2026 | Official leaderboard |
| 28 | | 83.7% ±5.4 | OpenHands | Nov 2026 | Official leaderboard |
| 29 | | 83.1% ±4.9 | OpenHands | Oct 2026 | Official leaderboard |
| 30 | Claude Opus 4.8 | 82.7% ±6 | OpenHands | May 2026 | Official leaderboard |
| 31 | | 82.3% ±6.2 | OpenHands | Aug 2026 | Official leaderboard |
| 32 | GPT-6 Luna | 81.7% ±6.6 | OpenHands | Sep 2026 | Official leaderboard |
| 33 | | 81.6% ±6.4 | OpenHands | Oct 2026 | Official leaderboard |
| 34 | | 81.5% ±6.8 | OpenHands | Nov 2026 | Official leaderboard |
| 35 | Claude Sonnet 5 | 81.3% ±6 | OpenHands | Jun 2026 | Official leaderboard |
| 36 | | 81% ±7 | OpenHands | Nov 2026 | Official leaderboard |
| 37 | GPT-5.6 Sol | 80.5% ±7.3 | OpenHands | Jul 2026 | Official leaderboard |
| 38 | | 79.1% ±6.5 | OpenHands | Aug 2026 | Official leaderboard |
| 39 | MiMo-V2.6 Flash | 79% ±7.9 | OpenHands | Sep 2026 | Official leaderboard |
| 40 | | 78.7% ±7.6 | OpenHands | Sep 2026 | Official leaderboard |
| 41 | | 78.4% ±7 | OpenHands | Oct 2026 | Official leaderboard |
| 42 | GLM-5.3 | 78.1% ±7.7 | OpenHands | Aug 2026 | Official leaderboard |
| 43 | | 77.5% ±7.9 | OpenHands | Aug 2026 | Official leaderboard |
| 44 | | 77.1% ±7.3 | OpenHands | Sep 2026 | Official leaderboard |
| 45 | GPT-5.6 Luna | 77.1% ±6 | OpenHands | Jul 2026 | Official leaderboard |
| 46 | Grok 4.6 | 76.2% ±7.5 | OpenHands | Aug 2026 | Official leaderboard |
| 47 | | 76.2% ±6.5 | OpenHands | Oct 2026 | Official leaderboard |
| 48 | | 74.7% ±6.7 | OpenHands | Jul 2026 | Official leaderboard |
| 49 | GPT-5.6 Terra | 74.6% ±8.2 | OpenHands | Jul 2026 | Official leaderboard |
| 50 | | 73.9% ±8.3 | OpenHands | Oct 2026 | Official leaderboard |
| 51 | | 72.2% ±6.5 | OpenHands | Jul 2026 | Official leaderboard |
| 52 | Claude Opus 4.7 | 71% ±8.8 | OpenHands | Apr 2026 | Official leaderboard |
| 53 | | 70.4% ±8.4 | OpenHands | Sep 2026 | Official leaderboard |
| 54 | | 70.4% ±9.5 | OpenHands | Aug 2026 | Official leaderboard |
| 55 | GPT-5.5 | 69.8% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 56 | Grok 4.5 | 69% ±8.8 | OpenHands | Jul 2026 | Official leaderboard |
| 57 | GPT-5.4 | 67.4% ±9.5 | xhigh, OpenHands | Mar 2026 | Official leaderboard |
| 58 | Beam 1.0 | 66.4% ±8 | OpenHands | Oct 2026 | Official leaderboard |
| 59 | | 64.8% ±9.5 | OpenHands | Aug 2026 | Official leaderboard |
| 60 | | 64.7% ±10.5 | OpenHands | Aug 2026 | Official leaderboard |
| 61 | | 64% ±8.4 | OpenHands | Jul 2026 | Official leaderboard |
| 62 | GLM-5.2 | 64% ±9.4 | OpenHands | Jun 2026 | Official leaderboard |
| 63 | GPT-5.3 Codex | 61.8% ±9.2 | OpenHands | Feb 2026 | Official leaderboard |
| 64 | Mercury 3 | 60.9% ±10.5 | OpenHands | Oct 2026 | Official leaderboard |
| 65 | Claude Opus 4.6 | 57.6% ±8.6 | non-thinking, OpenHands | Feb 2026 | Official leaderboard |
| 66 | Claude Sonnet 4.6 | 55.8% ±9.2 | Claude Code | Feb 2026 | Official leaderboard |
| 67 | GPT-5.2 | 53.5% ±9.9 | OpenHands | Dec 2025 | Official leaderboard |
| 68 | | 49.9% ±9.3 | OpenHands | Apr 2026 | Official leaderboard |
| 69 | Composer 2.5 | 49.6% ±9.7 | Cursor CLI | May 2026 | Official leaderboard |
| 70 | | 48.7% ±9.3 | OpenHands | May 2026 | Official leaderboard |
| 71 | GPT-5.4 Mini | 48% ±11 | OpenHands | Mar 2026 | Official leaderboard |
| 72 | | 47.7% ±9.1 | OpenHands | May 2026 | Official leaderboard |
| 73 | | 47.6% ±10.7 | OpenHands | Jun 2026 | Official leaderboard |
| 74 | Kimi K2.7 Code | 47.2% ±10.2 | OpenHands | Jun 2026 | Official leaderboard |
| 75 | | 46.4% ±9 | OpenHands | Jun 2026 | Official leaderboard |
| 76 | MiMo-V2.5 | 42.2% ±9 | OpenHands | Apr 2026 | Official leaderboard |
| 77 | GPT-5.2 Codex | 37.9% ±9 | OpenHands | Dec 2025 | Official leaderboard |
| 78 | Kimi K2.6 | 37.9% ±9.6 | OpenHands | Apr 2026 | Official leaderboard |
| 79 | | 37.2% ±9.1 | OpenHands | Jul 2026 | Official leaderboard |
| 80 | MiMo-V2.5-Pro | 34.1% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 81 | | 32% ±8.5 | OpenHands | Feb 2026 | Official leaderboard |
| 82 | GLM-5.1 | 31.5% ±8.9 | OpenHands | Apr 2026 | Official leaderboard |
| 83 | GLM-5.3-Flash | 30.8% ±10.3 | OpenHands | Aug 2026 | Official leaderboard |
| 84 | GPT-5.4 Nano | 26.1% ±9.9 | OpenHands | Mar 2026 | Official leaderboard |
| 85 | | 25.6% ±7.7 | OpenHands | Mar 2026 | Official leaderboard |
| 86 | GPT-5.1 | 24.6% ±8.3 | OpenHands | Nov 2025 | Official leaderboard |
| 87 | GLM-5 | 23.4% ±7.9 | thinking, OpenHands | Feb 2026 | Official leaderboard |
| 88 | Claude Sonnet 4.5 | 22.6% ±7.3 | thinking, OpenHands | Sep 2025 | Official leaderboard |
| 89 | GPT-5.1-Codex-Max | 22.2% ±7.5 | OpenHands | Nov 2025 | Official leaderboard |
| 90 | Claude Opus 4.5 | 20.6% ±6.2 | thinking, OpenHands | Nov 2025 | Official leaderboard |
| 91 | | 20.2% ±7.7 | OpenHands | Dec 2025 | Official leaderboard |
| 92 | GPT-5 | 20.1% ±6.7 | OpenHands | Aug 2025 | Official leaderboard |
| 93 | | 19.7% ±7.8 | OpenHands | Apr 2026 | Official leaderboard |
| 94 | Grok 4.3 | 19.4% ±8.3 | OpenHands | Apr 2026 | Official leaderboard |
| 95 | | 19.2% ±7.2 | OpenHands | Jul 2026 | Official leaderboard |
| 96 | | 19.1% ±6.7 | OpenHands | Jul 2026 | Official leaderboard |
| 97 | Kimi K2.5 | 17.5% ±6.4 | thinking, OpenHands | Jan 2026 | Official leaderboard |
| 98 | | 15.7% ±6.2 | thinking, OpenHands | Feb 2026 | Official leaderboard |
| 99 | | 14.8% ±5.8 | OpenHands | Feb 2026 | Official leaderboard |
| 100 | | 14.3% ±6 | OpenHands | Nov 2025 | Official leaderboard |
| 101 | GPT-5 mini | 14.2% ±6.9 | OpenHands | Aug 2025 | Official leaderboard |
| 102 | Grok Build 0.1 | 13.3% ±7.5 | Grok Build | May 2026 | Official leaderboard |
| 103 | GPT-5.1-Codex | 13.1% ±6.2 | OpenHands | Nov 2025 | Official leaderboard |
| 104 | | 11.9% ±6.7 | OpenHands | Apr 2026 | Official leaderboard |
| 105 | | 11.9% ±5.6 | OpenHands | Mar 2026 | Official leaderboard |
| 106 | Claude Haiku 4.5 | 11.4% ±6.1 | thinking, OpenHands | Oct 2025 | Official leaderboard |
| 107 | | 11% ±5.5 | OpenHands | Apr 2026 | Official leaderboard |
| 108 | | 7.64% ±5.5 | OpenHands | Jun 2026 | Official leaderboard |
| 109 | | 5.21% ±4.3 | OpenHands | Apr 2026 | Official leaderboard |
| 110 | | 5.11% ±4.2 | thinking, OpenHands | Dec 2025 | Official leaderboard |
| 111 | Grok 4.20 | 4.06% ±4 | reasoning, OpenHands | Feb 2026 | Official leaderboard |
| 112 | | 3.71% ±3.8 | OpenHands | Oct 2026 | Official leaderboard |
| 113 | Mercury 2.5 | 3.68% ±2.8 | OpenHands | Sep 2026 | Official leaderboard |
| 114 | | 3.51% ±2.5 | OpenHands | Sep 2025 | Official leaderboard |
| 115 | | 3.40% ±2.5 | OpenHands | Sep 2026 | Official leaderboard |
| 116 | GLM-4.6 | 3.09% ±2.3 | OpenHands | Sep 2025 | Official leaderboard |
| 117 | | 2.91% ±4.1 | OpenHands | Aug 2026 | Official leaderboard |
| 118 | | 2.89% ±3.4 | OpenHands | Apr 2026 | Official leaderboard |
| 119 | Grok 4.1 Fast | 1.20% ±2.4 | reasoning, OpenHands | Nov 2025 | Official leaderboard |
| 120 | | 0.40% ±0.8 | OpenHands | Jun 2025 | Official leaderboard |
| 121 | Grok 4 Fast | 0% | reasoning, OpenHands | Sep 2025 | Official leaderboard |
| 122 | | 0% | OpenHands | Mar 2026 | Official leaderboard |
| 123 | | 0% | OpenHands | Mar 2026 | Official leaderboard |
| 124 | | 0% | OpenHands | Aug 2026 | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 93.8% | OpenHands | Nov 2026 | Official leaderboard |
| 2 | 93.7% | OpenHands | Nov 2026 | Official leaderboard | |
| 3 | Claude Sonnet 5.5 | 92.4% | OpenHands | Sep 2026 | Official leaderboard |
| 4 | 91.9% | OpenHands | Sep 2026 | Official leaderboard | |
| 5 | Claude Haiku 5.5 | 90.4% | OpenHands | Oct 2026 | Official leaderboard |
| 6 | Claude Fable 5 | 90.3% | OpenHands | Jun 2026 | Official leaderboard |
| 7 | Claude Opus 5.5 | 90.3% | OpenHands | Sep 2026 | Official leaderboard |
| 8 | Claude Fable 5.1 | 90.3% | OpenHands | Sep 2026 | Official leaderboard |
| 9 | GPT-6.2 Astra | 89.9% | OpenHands | Nov 2026 | Official leaderboard |
| 10 | GPT-6 Astra | 89.6% | OpenHands | Sep 2026 | Official leaderboard |
| 11 | 89.1% | OpenHands | Oct 2026 | Official leaderboard | |
| 12 | GPT-6.1 Sol | 88.9% | OpenHands | Sep 2026 | Official leaderboard |
| 13 | Claude Opus 5 | 88.4% | OpenHands | Jul 2026 | Official leaderboard |
| 14 | GPT-6 Sol | 87.8% | OpenHands | Sep 2026 | Official leaderboard |
| 15 | 87.8% | OpenHands | Nov 2026 | Official leaderboard | |
| 16 | 87.7% | OpenHands | Oct 2026 | Official leaderboard | |
| 17 | GPT-6.2 Sol | 87.6% | OpenHands | Nov 2026 | Official leaderboard |
| 18 | 86.7% | OpenHands | Nov 2026 | Official leaderboard | |
| 19 | Grok 4.7 | 86.2% | OpenHands | Sep 2026 | Official leaderboard |
| 20 | 86% | OpenHands | Oct 2026 | Official leaderboard | |
| 21 | 85.9% | max, OpenHands | Sep 2026 | Official leaderboard | |
| 22 | MiMo-V2.6 Pro | 85.2% | OpenHands | Sep 2026 | Official leaderboard |
| 23 | Kimi K3 | 85% | OpenHands | Jul 2026 | Official leaderboard |
| 24 | Kimi K3.1 Pro | 84.9% | OpenHands | Oct 2026 | Official leaderboard |
| 25 | 84.7% | OpenHands | Sep 2026 | Official leaderboard | |
| 26 | GPT-6.1 Terra | 84% | OpenHands | Oct 2026 | Official leaderboard |
| 27 | 83.9% | OpenHands | Sep 2026 | Official leaderboard | |
| 28 | 83.7% | OpenHands | Nov 2026 | Official leaderboard | |
| 29 | 83.1% | OpenHands | Oct 2026 | Official leaderboard | |
| 30 | Claude Opus 4.8 | 82.7% | OpenHands | May 2026 | Official leaderboard |
| 31 | 82.3% | OpenHands | Aug 2026 | Official leaderboard | |
| 32 | GPT-6 Luna | 81.7% | OpenHands | Sep 2026 | Official leaderboard |
| 33 | 81.6% | Nov 2026 | Lab model card | ||
| 34 | 81.6% | OpenHands | Oct 2026 | Official leaderboard | |
| 35 | Claude Sonnet 5 | 81.3% | OpenHands | Jun 2026 | Official leaderboard |
| 36 | 81% | OpenHands | Nov 2026 | Official leaderboard | |
| 37 | GPT-5.6 Sol | 80.5% | OpenHands | Jul 2026 | Official leaderboard |
| 38 | 79.1% | OpenHands | Aug 2026 | Official leaderboard | |
| 39 | MiMo-V2.6 Flash | 79% | OpenHands | Sep 2026 | Official leaderboard |
| 40 | 78.7% | OpenHands | Sep 2026 | Official leaderboard | |
| 41 | 78.4% | OpenHands | Oct 2026 | Official leaderboard | |
| 42 | GLM-5.3 | 78.1% | OpenHands | Aug 2026 | Official leaderboard |
| 43 | 77.9% | Nov 2026 | Lab model card | ||
| 44 | 77.5% | OpenHands | Aug 2026 | Official leaderboard | |
| 45 | 77.1% | OpenHands | Sep 2026 | Official leaderboard | |
| 46 | GPT-5.6 Luna | 77.1% | OpenHands | Jul 2026 | Official leaderboard |
| 47 | Grok 4.6 | 76.2% | OpenHands | Aug 2026 | Official leaderboard |
| 48 | 76.2% | OpenHands | Oct 2026 | Official leaderboard | |
| 49 | 74.7% | OpenHands | Jul 2026 | Official leaderboard | |
| 50 | GPT-5.6 Terra | 74.6% | OpenHands | Jul 2026 | Official leaderboard |
| 51 | 73.9% | OpenHands | Oct 2026 | Official leaderboard | |
| 52 | 72.2% | OpenHands | Jul 2026 | Official leaderboard | |
| 53 | Claude Opus 4.7 | 71% | OpenHands | Apr 2026 | Official leaderboard |
| 54 | 70.4% | OpenHands | Sep 2026 | Official leaderboard | |
| 55 | 70.4% | OpenHands | Aug 2026 | Official leaderboard | |
| 56 | GPT-5.5 | 69.8% | OpenHands | Apr 2026 | Official leaderboard |
| 57 | Grok 4.5 | 69% | OpenHands | Jul 2026 | Official leaderboard |
| 58 | GPT-5.4 | 67.4% | xhigh, OpenHands | Mar 2026 | Official leaderboard |
| 59 | Beam 1.0 | 66.4% | OpenHands | Oct 2026 | Official leaderboard |
| 60 | 64.8% | OpenHands | Aug 2026 | Official leaderboard | |
| 61 | 64.7% | OpenHands | Aug 2026 | Official leaderboard | |
| 62 | 64% | OpenHands | Jul 2026 | Official leaderboard | |
| 63 | GLM-5.2 | 64% | OpenHands | Jun 2026 | Official leaderboard |
| 64 | GPT-5.3 Codex | 61.8% | OpenHands | Feb 2026 | Official leaderboard |
| 65 | Mercury 3 | 60.9% | OpenHands | Oct 2026 | Official leaderboard |
| 66 | Claude Opus 4.6 | 57.6% | non-thinking, OpenHands | Feb 2026 | Official leaderboard |
| 67 | Claude Sonnet 4.6 | 55.8% | Claude Code | Feb 2026 | Official leaderboard |
| 68 | GPT-5.2 | 53.5% | OpenHands | Dec 2025 | Official leaderboard |
| 69 | 49.9% | OpenHands | Apr 2026 | Official leaderboard | |
| 70 | Composer 2.5 | 49.6% | Cursor CLI | May 2026 | Official leaderboard |
| 71 | 48.7% | OpenHands | May 2026 | Official leaderboard | |
| 72 | GPT-5.4 Mini | 48% | OpenHands | Mar 2026 | Official leaderboard |
| 73 | 47.7% | OpenHands | May 2026 | Official leaderboard | |
| 74 | 47.6% | OpenHands | Jun 2026 | Official leaderboard | |
| 75 | Kimi K2.7 Code | 47.2% | OpenHands | Jun 2026 | Official leaderboard |
| 76 | 46.4% | OpenHands | Jun 2026 | Official leaderboard | |
| 77 | MiMo-V2.5 | 42.2% | OpenHands | Apr 2026 | Official leaderboard |
| 78 | GPT-5.2 Codex | 37.9% | OpenHands | Dec 2025 | Official leaderboard |
| 79 | Kimi K2.6 | 37.9% | OpenHands | Apr 2026 | Official leaderboard |
| 80 | 37.2% | OpenHands | Jul 2026 | Official leaderboard | |
| 81 | MiMo-V2.5-Pro | 34.1% | OpenHands | Apr 2026 | Official leaderboard |
| 82 | 32% | OpenHands | Feb 2026 | Official leaderboard | |
| 83 | GLM-5.1 | 31.5% | OpenHands | Apr 2026 | Official leaderboard |
| 84 | GLM-5.3-Flash | 30.8% | OpenHands | Aug 2026 | Official leaderboard |
| 85 | GPT-5.4 Nano | 26.1% | OpenHands | Mar 2026 | Official leaderboard |
| 86 | 25.6% | OpenHands | Mar 2026 | Official leaderboard | |
| 87 | GPT-5.1 | 24.6% | OpenHands | Nov 2025 | Official leaderboard |
| 88 | GLM-5 | 23.4% | thinking, OpenHands | Feb 2026 | Official leaderboard |
| 89 | Claude Sonnet 4.5 | 22.6% | thinking, OpenHands | Sep 2025 | Official leaderboard |
| 90 | GPT-5.1-Codex-Max | 22.2% | OpenHands | Nov 2025 | Official leaderboard |
| 91 | Claude Opus 4.5 | 20.6% | thinking, OpenHands | Nov 2025 | Official leaderboard |
| 92 | 20.2% | OpenHands | Dec 2025 | Official leaderboard | |
| 93 | GPT-5 | 20.1% | OpenHands | Aug 2025 | Official leaderboard |
| 94 | 19.7% | OpenHands | Apr 2026 | Official leaderboard | |
| 95 | Grok 4.3 | 19.4% | OpenHands | Apr 2026 | Official leaderboard |
| 96 | 19.2% | OpenHands | Jul 2026 | Official leaderboard | |
| 97 | 19.1% | OpenHands | Jul 2026 | Official leaderboard | |
| 98 | Kimi K2.5 | 17.5% | thinking, OpenHands | Jan 2026 | Official leaderboard |
| 99 | 15.7% | thinking, OpenHands | Feb 2026 | Official leaderboard | |
| 100 | 14.8% | OpenHands | Feb 2026 | Official leaderboard | |
| 101 | 14.3% | OpenHands | Nov 2025 | Official leaderboard | |
| 102 | GPT-5 mini | 14.2% | OpenHands | Aug 2025 | Official leaderboard |
| 103 | Grok Build 0.1 | 13.3% | Grok Build | May 2026 | Official leaderboard |
| 104 | GPT-5.1-Codex | 13.1% | OpenHands | Nov 2025 | Official leaderboard |
| 105 | 11.9% | OpenHands | Apr 2026 | Official leaderboard | |
| 106 | 11.9% | OpenHands | Mar 2026 | Official leaderboard | |
| 107 | Claude Haiku 4.5 | 11.4% | thinking, OpenHands | Oct 2025 | Official leaderboard |
| 108 | 11% | OpenHands | Apr 2026 | Official leaderboard | |
| 109 | 7.64% | OpenHands | Jun 2026 | Official leaderboard | |
| 110 | 5.21% | OpenHands | Apr 2026 | Official leaderboard | |
| 111 | 5.11% | thinking, OpenHands | Dec 2025 | Official leaderboard | |
| 112 | Grok 4.20 | 4.06% | reasoning, OpenHands | Feb 2026 | Official leaderboard |
| 113 | 3.71% | OpenHands | Oct 2026 | Official leaderboard | |
| 114 | Mercury 2.5 | 3.68% | OpenHands | Sep 2026 | Official leaderboard |
| 115 | 3.51% | OpenHands | Sep 2025 | Official leaderboard | |
| 116 | 3.40% | OpenHands | Sep 2026 | Official leaderboard | |
| 117 | GLM-4.6 | 3.09% | OpenHands | Sep 2025 | Official leaderboard |
| 118 | 2.91% | OpenHands | Aug 2026 | Official leaderboard | |
| 119 | 2.89% | OpenHands | Apr 2026 | Official leaderboard | |
| 120 | Grok 4.1 Fast | 1.20% | reasoning, OpenHands | Nov 2025 | Official leaderboard |
| 121 | 0.40% | OpenHands | Jun 2025 | Official leaderboard | |
| 122 | Grok 4 Fast | 0% | reasoning, OpenHands | Sep 2025 | Official leaderboard |
| 123 | 0% | OpenHands | Mar 2026 | Official leaderboard | |
| 124 | 0% | OpenHands | Mar 2026 | Official leaderboard | |
| 125 | 0% | OpenHands | Aug 2026 | Official leaderboard |
Labs report scores for 3 models in their cards. Switch the scores above to rank them together.
Accuracy against latency
The Vals scatter chart with its x axis switched from Cost to Latency: mean time per test against accuracy, on a log scale. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Accuracy | Latency (mean per test) |
|---|---|---|---|
| Claude Fable 5.2 | OpenHands | 93.8% | 2,437 s |
| OpenHands | 93.7% | 1,418 s | |
| Claude Sonnet 5.5 | OpenHands | 92.4% | 3,672 s |
| OpenHands | 91.9% | 2,248 s | |
| Claude Haiku 5.5 | OpenHands | 90.4% | 2,076 s |
| Claude Fable 5 | OpenHands | 90.4% | 3,711 s |
| Claude Opus 5.5 | OpenHands | 90.3% | 5,767 s |
| Claude Fable 5.1 | OpenHands | 90.3% | 3,460 s |
| GPT-6.2 Astra | OpenHands | 89.9% | 2,652 s |
| GPT-6 Astra | OpenHands | 89.6% | 2,344 s |
| OpenHands | 89.1% | 2,172 s | |
| GPT-6.1 Sol | OpenHands | 88.9% | 4,490 s |
| Claude Opus 5 | OpenHands | 88.4% | 5,301 s |
| GPT-6 Sol | OpenHands | 87.8% | 2,336 s |
| OpenHands | 87.8% | 864.61 s | |
| OpenHands | 87.7% | 973.83 s | |
| GPT-6.2 Sol | OpenHands | 87.6% | 2,871 s |
| OpenHands | 86.7% | 4,173 s | |
| Grok 4.7 | OpenHands | 86.2% | 2,147 s |
| OpenHands | 86% | 648.34 s | |
| max, OpenHands | 85.9% | 977.67 s | |
| MiMo-V2.6 Pro | OpenHands | 85.2% | 3,647 s |
| Kimi K3 | OpenHands | 85% | 999.02 s |
| Kimi K3.1 Pro | OpenHands | 84.9% | 3,029 s |
| OpenHands | 84.7% | 928.1 s | |
| GPT-6.1 Terra | OpenHands | 84% | 2,250 s |
| OpenHands | 83.9% | 2,358 s | |
| OpenHands | 83.7% | 167.86 s | |
| OpenHands | 83.1% | 350.08 s | |
| OpenHands | 82.9% | 773.8 s | |
| Claude Opus 4.8 | OpenHands | 82.7% | 4,549 s |
| OpenHands | 82.3% | 3,983 s | |
| GPT-6 Luna | OpenHands | 81.7% | 2,220 s |
| OpenHands | 81.6% | 3,013 s | |
| OpenHands | 81.6% | 1,537 s | |
| Claude Sonnet 5 | OpenHands | 81.3% | 4,001 s |
| OpenHands | 81% | 2,282 s | |
| GPT-5.6 Sol | OpenHands | 80.5% | 2,033 s |
| OpenHands | 79.1% | 1,195 s | |
| MiMo-V2.6 Flash | OpenHands | 79% | 3,013 s |
| OpenHands | 78.7% | 519.1 s | |
| OpenHands | 78.4% | 10,395 s | |
| GLM-5.3 | OpenHands | 78.1% | 3,847 s |
| Claude Opus 4.8 | Claude Code | 77.5% | 1,142 s |
| OpenHands | 77.5% | 2,493 s | |
| OpenHands | 77.1% | 5,079 s | |
| GPT-5.6 Luna | OpenHands | 77.1% | 1,552 s |
| Grok 4.6 | OpenHands | 76.2% | 1,530 s |
| OpenHands | 76.2% | 1,869 s | |
| Hy4 Flash | OpenHands | 74.8% | 1,008 s |
| OpenHands | 74.7% | 2,242 s | |
| GPT-5.6 Terra | OpenHands | 74.6% | 1,152 s |
| OpenHands | 73.9% | 1,264 s | |
| OpenHands | 72.2% | 615.43 s | |
| Claude Opus 4.7 | OpenHands | 71% | 2,142 s |
| OpenHands | 70.4% | 5,466 s | |
| OpenHands | 70.4% | 1,424 s | |
| GPT-5.5 | OpenHands | 69.9% | 1,912 s |
| Grok 4.5 | OpenHands | 69% | 830.06 s |
| GPT-5.4 | xhigh, OpenHands | 67.4% | 5,175 s |
| GPT-5.5 | Factory | 67.4% | 1,177 s |
| Beam 1.0 | OpenHands | 66.4% | 145.26 s |
| OpenHands | 64.9% | 2,619 s | |
| OpenHands | 64.7% | 10,135 s | |
| OpenHands | 64% | 1,523 s | |
| GLM-5.2 | OpenHands | 64% | 3,748 s |
| GPT-5.3 Codex | OpenHands | 61.8% | 4,548 s |
| Mercury 3 | OpenHands | 60.9% | 566.58 s |
| GPT-5.5 | Codex | 58.2% | 708.51 s |
| Claude Opus 4.6 | non-thinking, OpenHands | 57.6% | 1,279 s |
| Claude Sonnet 4.6 | Claude Code | 55.8% | 2,982 s |
| Claude Opus 4.6 | thinking, OpenHands | 53.5% | 1,386 s |
| GPT-5.2 | OpenHands | 53.5% | 4,971 s |
| Claude Sonnet 4.6 | OpenHands | 51.5% | 1,572 s |
| OpenHands | 49.9% | 3,419 s | |
| Composer 2.5 | Cursor CLI | 49.6% | 592.9 s |
| OpenHands | 48.7% | 893.07 s | |
| GPT-5.4 | Codex | 48.5% | 1,075 s |
| GPT-5.4 Mini | OpenHands | 48% | 2,055 s |
| OpenHands | 47.7% | 4,690 s | |
| OpenHands | 47.6% | 5,073 s | |
| Kimi K2.7 Code | OpenHands | 47.2% | 10,318 s |
| OpenHands | 46.4% | 2,232 s | |
| MiMo-V2.5 | OpenHands | 42.2% | 1,580 s |
| GPT-5.2 Codex | OpenHands | 37.9% | 1,935 s |
| Kimi K2.6 | OpenHands | 37.9% | 2,968 s |
| OpenHands | 37.2% | 501.52 s | |
| MiMo-V2.5-Pro | OpenHands | 34.1% | 2,404 s |
| OpenHands | 32% | 1,212 s | |
| GLM-5.1 | OpenHands | 31.5% | 2,015 s |
| GLM-5.3-Flash | OpenHands | 30.8% | 5,027 s |
| GPT-5.4 Nano | OpenHands | 26.1% | 3,276 s |
| OpenHands | 25.6% | 2,290 s | |
| GPT-5.1 | OpenHands | 24.6% | 1,836 s |
| GLM-5 | thinking, OpenHands | 23.4% | 13,456 s |
| Claude Sonnet 4.5 | thinking, OpenHands | 22.6% | 2,962 s |
| GPT-5.1-Codex-Max | OpenHands | 22.2% | 31,183 s |
| Claude Opus 4.5 | thinking, OpenHands | 20.6% | 2,283 s |
| OpenHands | 20.2% | 806.66 s | |
| GPT-5 | OpenHands | 20.1% | 1,852 s |
| OpenHands | 19.7% | 981.3 s | |
| Grok 4.3 | OpenHands | 19.4% | 589.41 s |
| OpenHands | 19.2% | 1,106 s | |
| OpenHands | 19.1% | 2,950 s | |
| Kimi K2.5 | thinking, OpenHands | 17.5% | 2,570 s |
| thinking, OpenHands | 15.7% | 3,016 s | |
| OpenHands | 14.9% | 3,066 s | |
| OpenHands | 14.3% | 10,399 s | |
| GPT-5 mini | OpenHands | 14.2% | 698.25 s |
| Grok Build 0.1 | Grok Build | 13.4% | 394.64 s |
| GPT-5.1-Codex | OpenHands | 13.1% | 3,026 s |
| OpenHands | 11.9% | 9,763 s | |
| OpenHands | 11.9% | 1,377 s | |
| Claude Haiku 4.5 | thinking, OpenHands | 11.4% | 775.88 s |
| OpenHands | 11% | 2,382 s | |
| OpenHands | 7.6% | 2,218 s | |
| SWE-1.6 Fast | Devin CLI | 7.2% | 189.13 s |
| OpenHands | 5.2% | 2,199 s | |
| thinking, OpenHands | 5.1% | 3,366 s | |
| Grok 4.20 | reasoning, OpenHands | 4.1% | 301.65 s |
| OpenHands | 3.7% | 262.9 s | |
| Mercury 2.5 | OpenHands | 3.7% | 193.04 s |
| OpenHands | 3.5% | 3,465 s | |
| OpenHands | 3.4% | 1,451 s | |
| GLM-4.6 | OpenHands | 3.1% | 10,002 s |
| OpenHands | 2.9% | 1,006 s | |
| OpenHands | 2.9% | 2,471 s | |
| Grok 4.1 Fast | reasoning, OpenHands | 1.2% | 527.56 s |
| OpenHands | 0.4% | 2,097 s | |
| OpenHands | 0% | 572.71 s | |
| OpenHands | 0% | 959.66 s | |
| Grok 4 Fast | reasoning, OpenHands | 0% | 1,449 s |
| OpenHands | 0% | 1,815 s |
Accuracy against latency
The Vals scatter chart with its x axis switched from Cost to Latency: mean time per test against accuracy, on a log scale. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Accuracy | Latency (mean per test) |
|---|---|---|---|
| Claude Fable 5.2 | OpenHands | 93.8% | 2,437 s |
| OpenHands | 93.7% | 1,418 s | |
| Claude Sonnet 5.5 | OpenHands | 92.4% | 3,672 s |
| OpenHands | 91.9% | 2,248 s | |
| Claude Haiku 5.5 | OpenHands | 90.4% | 2,076 s |
| Claude Fable 5 | OpenHands | 90.4% | 3,711 s |
| Claude Opus 5.5 | OpenHands | 90.3% | 5,767 s |
| Claude Fable 5.1 | OpenHands | 90.3% | 3,460 s |
| GPT-6.2 Astra | OpenHands | 89.9% | 2,652 s |
| GPT-6 Astra | OpenHands | 89.6% | 2,344 s |
| OpenHands | 89.1% | 2,172 s | |
| GPT-6.1 Sol | OpenHands | 88.9% | 4,490 s |
| Claude Opus 5 | OpenHands | 88.4% | 5,301 s |
| GPT-6 Sol | OpenHands | 87.8% | 2,336 s |
| OpenHands | 87.8% | 864.61 s | |
| OpenHands | 87.7% | 973.83 s | |
| GPT-6.2 Sol | OpenHands | 87.6% | 2,871 s |
| OpenHands | 86.7% | 4,173 s | |
| Grok 4.7 | OpenHands | 86.2% | 2,147 s |
| OpenHands | 86% | 648.34 s | |
| max, OpenHands | 85.9% | 977.67 s | |
| MiMo-V2.6 Pro | OpenHands | 85.2% | 3,647 s |
| Kimi K3 | OpenHands | 85% | 999.02 s |
| Kimi K3.1 Pro | OpenHands | 84.9% | 3,029 s |
| OpenHands | 84.7% | 928.1 s | |
| GPT-6.1 Terra | OpenHands | 84% | 2,250 s |
| OpenHands | 83.9% | 2,358 s | |
| OpenHands | 83.7% | 167.86 s | |
| OpenHands | 83.1% | 350.08 s | |
| OpenHands | 82.9% | 773.8 s | |
| Claude Opus 4.8 | OpenHands | 82.7% | 4,549 s |
| OpenHands | 82.3% | 3,983 s | |
| GPT-6 Luna | OpenHands | 81.7% | 2,220 s |
| OpenHands | 81.6% | 3,013 s | |
| OpenHands | 81.6% | 1,537 s | |
| Claude Sonnet 5 | OpenHands | 81.3% | 4,001 s |
| OpenHands | 81% | 2,282 s | |
| GPT-5.6 Sol | OpenHands | 80.5% | 2,033 s |
| OpenHands | 79.1% | 1,195 s | |
| MiMo-V2.6 Flash | OpenHands | 79% | 3,013 s |
| OpenHands | 78.7% | 519.1 s | |
| OpenHands | 78.4% | 10,395 s | |
| GLM-5.3 | OpenHands | 78.1% | 3,847 s |
| Claude Opus 4.8 | Claude Code | 77.5% | 1,142 s |
| OpenHands | 77.5% | 2,493 s | |
| OpenHands | 77.1% | 5,079 s | |
| GPT-5.6 Luna | OpenHands | 77.1% | 1,552 s |
| Grok 4.6 | OpenHands | 76.2% | 1,530 s |
| OpenHands | 76.2% | 1,869 s | |
| OpenHands | 74.7% | 2,242 s | |
| GPT-5.6 Terra | OpenHands | 74.6% | 1,152 s |
| OpenHands | 73.9% | 1,264 s | |
| OpenHands | 72.2% | 615.43 s | |
| Claude Opus 4.7 | OpenHands | 71% | 2,142 s |
| OpenHands | 70.4% | 5,466 s | |
| OpenHands | 70.4% | 1,424 s | |
| GPT-5.5 | OpenHands | 69.9% | 1,912 s |
| Grok 4.5 | OpenHands | 69% | 830.06 s |
| GPT-5.4 | xhigh, OpenHands | 67.4% | 5,175 s |
| GPT-5.5 | Factory | 67.4% | 1,177 s |
| Beam 1.0 | OpenHands | 66.4% | 145.26 s |
| OpenHands | 64.9% | 2,619 s | |
| OpenHands | 64.7% | 10,135 s | |
| OpenHands | 64% | 1,523 s | |
| GLM-5.2 | OpenHands | 64% | 3,748 s |
| GPT-5.3 Codex | OpenHands | 61.8% | 4,548 s |
| Mercury 3 | OpenHands | 60.9% | 566.58 s |
| GPT-5.5 | Codex | 58.2% | 708.51 s |
| Claude Opus 4.6 | non-thinking, OpenHands | 57.6% | 1,279 s |
| Claude Sonnet 4.6 | Claude Code | 55.8% | 2,982 s |
| Claude Opus 4.6 | thinking, OpenHands | 53.5% | 1,386 s |
| GPT-5.2 | OpenHands | 53.5% | 4,971 s |
| Claude Sonnet 4.6 | OpenHands | 51.5% | 1,572 s |
| OpenHands | 49.9% | 3,419 s | |
| Composer 2.5 | Cursor CLI | 49.6% | 592.9 s |
| OpenHands | 48.7% | 893.07 s | |
| GPT-5.4 | Codex | 48.5% | 1,075 s |
| GPT-5.4 Mini | OpenHands | 48% | 2,055 s |
| OpenHands | 47.7% | 4,690 s | |
| OpenHands | 47.6% | 5,073 s | |
| Kimi K2.7 Code | OpenHands | 47.2% | 10,318 s |
| OpenHands | 46.4% | 2,232 s | |
| MiMo-V2.5 | OpenHands | 42.2% | 1,580 s |
| GPT-5.2 Codex | OpenHands | 37.9% | 1,935 s |
| Kimi K2.6 | OpenHands | 37.9% | 2,968 s |
| OpenHands | 37.2% | 501.52 s | |
| MiMo-V2.5-Pro | OpenHands | 34.1% | 2,404 s |
| OpenHands | 32% | 1,212 s | |
| GLM-5.1 | OpenHands | 31.5% | 2,015 s |
| GLM-5.3-Flash | OpenHands | 30.8% | 5,027 s |
| GPT-5.4 Nano | OpenHands | 26.1% | 3,276 s |
| OpenHands | 25.6% | 2,290 s | |
| GPT-5.1 | OpenHands | 24.6% | 1,836 s |
| GLM-5 | thinking, OpenHands | 23.4% | 13,456 s |
| Claude Sonnet 4.5 | thinking, OpenHands | 22.6% | 2,962 s |
| GPT-5.1-Codex-Max | OpenHands | 22.2% | 31,183 s |
| Claude Opus 4.5 | thinking, OpenHands | 20.6% | 2,283 s |
| OpenHands | 20.2% | 806.66 s | |
| GPT-5 | OpenHands | 20.1% | 1,852 s |
| OpenHands | 19.7% | 981.3 s | |
| Grok 4.3 | OpenHands | 19.4% | 589.41 s |
| OpenHands | 19.2% | 1,106 s | |
| OpenHands | 19.1% | 2,950 s | |
| Kimi K2.5 | thinking, OpenHands | 17.5% | 2,570 s |
| thinking, OpenHands | 15.7% | 3,016 s | |
| OpenHands | 14.9% | 3,066 s | |
| OpenHands | 14.3% | 10,399 s | |
| GPT-5 mini | OpenHands | 14.2% | 698.25 s |
| Grok Build 0.1 | Grok Build | 13.4% | 394.64 s |
| GPT-5.1-Codex | OpenHands | 13.1% | 3,026 s |
| OpenHands | 11.9% | 9,763 s | |
| OpenHands | 11.9% | 1,377 s | |
| Claude Haiku 4.5 | thinking, OpenHands | 11.4% | 775.88 s |
| OpenHands | 11% | 2,382 s | |
| OpenHands | 7.6% | 2,218 s | |
| OpenHands | 5.2% | 2,199 s | |
| thinking, OpenHands | 5.1% | 3,366 s | |
| Grok 4.20 | reasoning, OpenHands | 4.1% | 301.65 s |
| OpenHands | 3.7% | 262.9 s | |
| Mercury 2.5 | OpenHands | 3.7% | 193.04 s |
| OpenHands | 3.5% | 3,465 s | |
| OpenHands | 3.4% | 1,451 s | |
| GLM-4.6 | OpenHands | 3.1% | 10,002 s |
| OpenHands | 2.9% | 1,006 s | |
| OpenHands | 2.9% | 2,471 s | |
| Grok 4.1 Fast | reasoning, OpenHands | 1.2% | 527.56 s |
| OpenHands | 0.4% | 2,097 s | |
| OpenHands | 0% | 572.71 s | |
| OpenHands | 0% | 959.66 s | |
| Grok 4 Fast | reasoning, OpenHands | 0% | 1,449 s |
| OpenHands | 0% | 1,815 s |
The best score, 93.8%, costs $22 a task
Runs on the cost frontier score higher than any run that's cheaper. Claude Haiku 5.5 comes within 3.3 points of the best for $6.07 a task, 4 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.
Source: Official Vibe Code Bench leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Claude Fable 5.2 | OpenHands | 93.8% | $22 | 257,566 | |
| OpenHands | 93.7% | $6.76 | 159,652 | ||
| Claude Sonnet 5.5 | OpenHands | 92.4% | $20 | 509,821 | |
| OpenHands | 91.9% | $8.11 | 108,727 | ||
| Claude Haiku 5.5 | OpenHands | 90.4% | $6.07 | 477,279 | |
| Claude Fable 5 | OpenHands | 90.3% | $42 | ||
| Claude Opus 5.5 | OpenHands | 90.3% | $36 | 394,450 | |
| Claude Fable 5.1 | OpenHands | 90.3% | $33 | 224,587 | |
| GPT-6.2 Astra | OpenHands | 89.9% | $7.92 | 93,921 | |
| GPT-6 Astra | OpenHands | 89.6% | $39 | 153,442 | |
| OpenHands | 89.1% | $8.25 | 144,698 | ||
| GPT-6.1 Sol | OpenHands | 88.9% | $6.23 | 203,736 | |
| Claude Opus 5 | OpenHands | 88.4% | $34 | 195,337 | |
| GPT-6 Sol | OpenHands | 87.8% | $26 | 136,469 | |
| OpenHands | 87.8% | $4.55 | 184,074 | ||
| OpenHands | 87.7% | $0.58 | 184,924 | ||
| GPT-6.2 Sol | OpenHands | 87.6% | $3.23 | 126,894 | |
| OpenHands | 86.7% | $41 | 114,443 | ||
| Grok 4.7 | OpenHands | 86.2% | $16 | 158,477 | |
| OpenHands | 86% | $2.29 | 41,423 | ||
| max | OpenHands | 85.9% | $2.54 | 60,971 | |
| MiMo-V2.6 Pro | OpenHands | 85.2% | $1.04 | 149,562 | |
| Kimi K3 | OpenHands | 85% | $10 | 100,216 | |
| Kimi K3.1 Pro | OpenHands | 84.9% | $7.49 | 116,139 | |
| OpenHands | 84.7% | $0.41 | 143,729 | ||
| GPT-6.1 Terra | OpenHands | 84% | $6.00 | 118,574 | |
| OpenHands | 83.9% | $8.56 | 81,426 | ||
| OpenHands | 83.7% | $0.05 | 37,758 | ||
| OpenHands | 83.1% | $1.80 | 36,607 | ||
| OpenHands | 82.9% | $2.10 | 54,278 | ||
| Claude Opus 4.8 | OpenHands | 82.7% | $27 | ||
| OpenHands | 82.3% | $0.36 | 154,929 | ||
| GPT-6 Luna | OpenHands | 81.7% | $1.35 | 180,091 | |
| OpenHands | 81.6% | $12 | 127,093 | ||
| OpenHands | 81.5% | $1.90 | 188,867 | ||
| Claude Sonnet 5 | OpenHands | 81.3% | $25 | ||
| OpenHands | 81% | $2.39 | 154,239 | ||
| GPT-5.6 Sol | OpenHands | 80.5% | $33 | ||
| OpenHands | 79.1% | $1.53 | 47,024 | ||
| MiMo-V2.6 Flash | OpenHands | 79% | $0.56 | 165,570 | |
| OpenHands | 78.7% | $6.87 | 122,884 | ||
| OpenHands | 78.4% | $20 | 161,302 | ||
| GLM-5.3 | OpenHands | 78.1% | $12 | 163,467 | |
| Claude Opus 4.8 | Claude Code | 77.5% | $6.86 | 80,284 | |
| OpenHands | 77.5% | $2.18 | 125,264 | ||
| OpenHands | 77.1% | $12 | 166,554 | ||
| GPT-5.6 Luna | OpenHands | 77.1% | $0.73 | 73,204 | |
| Grok 4.6 | OpenHands | 76.2% | $4.88 | 76,097 | |
| OpenHands | 76.2% | $1.66 | 41,718 | ||
| OpenHands | 74.7% | $0.91 | 155,038 | ||
| GPT-5.6 Terra | OpenHands | 74.6% | $7.89 | 97,307 | |
| OpenHands | 73.9% | $1.15 | 169,763 | ||
| OpenHands | 72.2% | $0.92 | |||
| Claude Opus 4.7 | OpenHands | 71% | $21 | ||
| OpenHands | 70.4% | $5.86 | 163,654 | ||
| OpenHands | 70.4% | $4.83 | 117,608 | ||
| GPT-5.5 | OpenHands | 69.8% | $17 | 61,798 | |
| Grok 4.5 | OpenHands | 69% | $4.10 | ||
| GPT-5.4 | xhigh | OpenHands | 67.4% | $11 | 116,452 |
| GPT-5.5 | Factory | 67.4% | $5.93 | 48,868 | |
| Beam 1.0 | OpenHands | 66.4% | 40,097 | ||
| OpenHands | 64.8% | $23 | 176,498 | ||
| OpenHands | 64.7% | $8.24 | 119,118 | ||
| OpenHands | 64% | $3.04 | 81,300 | ||
| GLM-5.2 | OpenHands | 64% | $8.49 | ||
| GPT-5.3 Codex | OpenHands | 61.8% | $12 | 80,188 | |
| Mercury 3 | OpenHands | 60.9% | $0.63 | 129,860 | |
| GPT-5.5 | Codex | 58.2% | $3.63 | 40,368 | |
| Claude Opus 4.6 | non-thinking | OpenHands | 57.6% | $8.69 | |
| Claude Sonnet 4.6 | Claude Code | 55.8% | $7.35 | 7,242 | |
| GPT-5.2 | OpenHands | 53.5% | $18 | 88,133 | |
| Claude Opus 4.6 | thinking | OpenHands | 53.5% | $8.28 | |
| Claude Sonnet 4.6 | OpenHands | 51.5% | $5.91 | ||
| OpenHands | 49.9% | $2.21 | |||
| Composer 2.5 | Cursor CLI | 49.6% | $0.50 | 40,586 | |
| OpenHands | 48.7% | $2.54 | 65,703 | ||
| GPT-5.4 | Codex | 48.5% | $7.51 | 72,205 | |
| GPT-5.4 Mini | OpenHands | 48% | $1.19 | ||
| OpenHands | 47.7% | $11 | 47,095 | ||
| OpenHands | 47.6% | $6.45 | |||
| Kimi K2.7 Code | OpenHands | 47.2% | $3.84 | ||
| OpenHands | 46.4% | $1.08 | |||
| MiMo-V2.5 | OpenHands | 42.2% | $0.07 | ||
| GPT-5.2 Codex | OpenHands | 37.9% | $4.15 | 53,174 | |
| Kimi K2.6 | OpenHands | 37.9% | $1.93 | ||
| OpenHands | 37.2% | $0.83 | 67,200 | ||
| MiMo-V2.5-Pro | OpenHands | 34.1% | $0.17 | ||
| OpenHands | 32% | $3.83 | |||
| GLM-5.1 | OpenHands | 31.5% | $2.89 | ||
| GLM-5.3-Flash | OpenHands | 30.8% | $4.70 | 238,331 | |
| GPT-5.4 Nano | OpenHands | 26.1% | $1.28 | ||
| OpenHands | 25.6% | $5.45 | 53,075 | ||
| GPT-5.1 | OpenHands | 24.6% | $2.57 | ||
| GLM-5 | thinking | OpenHands | 23.4% | $40 | 57,419 |
| Claude Sonnet 4.5 | thinking | OpenHands | 22.6% | $6.66 | |
| GPT-5.1-Codex-Max | OpenHands | 22.2% | $7.32 | ||
| Claude Opus 4.5 | thinking | OpenHands | 20.6% | $33 | |
| OpenHands | 20.2% | $0.94 | |||
| GPT-5 | OpenHands | 20.1% | $1.53 | ||
| OpenHands | 19.7% | 41,618 | |||
| Grok 4.3 | OpenHands | 19.4% | $1.28 | ||
| OpenHands | 19.2% | $1.61 | 45,766 | ||
| OpenHands | 19.1% | $0.43 | 42,713 | ||
| Kimi K2.5 | thinking | OpenHands | 17.5% | $0.88 | |
| thinking | OpenHands | 15.7% | $3.80 | 48,819 | |
| OpenHands | 14.8% | $2.20 | 52,563 | ||
| OpenHands | 14.3% | $6.42 | |||
| GPT-5 mini | OpenHands | 14.2% | $0.25 | 21,744 | |
| Grok Build 0.1 | Grok Build | 13.3% | |||
| GPT-5.1-Codex | OpenHands | 13.1% | $3.80 | ||
| OpenHands | 11.9% | $4.66 | 51,528 | ||
| OpenHands | 11.9% | $2.82 | |||
| Claude Haiku 4.5 | thinking | OpenHands | 11.4% | $1.31 | |
| OpenHands | 11% | 62,251 | |||
| OpenHands | 7.64% | 108,817 | |||
| OpenHands | 5.21% | 51,638 | |||
| thinking | OpenHands | 5.11% | $2.47 | ||
| Grok 4.20 | reasoning | OpenHands | 4.06% | $0.77 | |
| OpenHands | 3.71% | $0.54 | 58,038 | ||
| Mercury 2.5 | OpenHands | 3.68% | $0.38 | 28,520 | |
| OpenHands | 3.51% | $6.02 | |||
| OpenHands | 3.40% | $0.23 | 147,021 | ||
| GLM-4.6 | OpenHands | 3.09% | $11 | ||
| OpenHands | 2.91% | $0.29 | 76,123 | ||
| OpenHands | 2.89% | $17 | 78,622 | ||
| Grok 4.1 Fast | reasoning | OpenHands | 1.20% | $0.21 | 16,637 |
| OpenHands | 0.40% | $1.22 | |||
| Grok 4 Fast | reasoning | OpenHands | 0% | $0.13 | |
| OpenHands | 0% | $0.51 | 20,850 | ||
| OpenHands | 0% | $6.47 | 60,285 | ||
| OpenHands | 0% | $0.13 | 66,932 |
The best score, 93.8%, costs $22 a task
Runs on the cost frontier score higher than any run that's cheaper. Claude Haiku 5.5 comes within 3.3 points of the best for $6.07 a task, 4 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.
Source: Official Vibe Code Bench leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Claude Fable 5.2 | OpenHands | 93.8% | $22 | 257,566 | |
| OpenHands | 93.7% | $6.76 | 159,652 | ||
| Claude Sonnet 5.5 | OpenHands | 92.4% | $20 | 509,821 | |
| OpenHands | 91.9% | $8.11 | 108,727 | ||
| Claude Haiku 5.5 | OpenHands | 90.4% | $6.07 | 477,279 | |
| Claude Fable 5 | OpenHands | 90.3% | $42 | ||
| Claude Opus 5.5 | OpenHands | 90.3% | $36 | 394,450 | |
| Claude Fable 5.1 | OpenHands | 90.3% | $33 | 224,587 | |
| GPT-6.2 Astra | OpenHands | 89.9% | $7.92 | 93,921 | |
| GPT-6 Astra | OpenHands | 89.6% | $39 | 153,442 | |
| OpenHands | 89.1% | $8.25 | 144,698 | ||
| GPT-6.1 Sol | OpenHands | 88.9% | $6.23 | 203,736 | |
| Claude Opus 5 | OpenHands | 88.4% | $34 | 195,337 | |
| GPT-6 Sol | OpenHands | 87.8% | $26 | 136,469 | |
| OpenHands | 87.8% | $4.55 | 184,074 | ||
| OpenHands | 87.7% | $0.58 | 184,924 | ||
| GPT-6.2 Sol | OpenHands | 87.6% | $3.23 | 126,894 | |
| OpenHands | 86.7% | $41 | 114,443 | ||
| Grok 4.7 | OpenHands | 86.2% | $16 | 158,477 | |
| OpenHands | 86% | $2.29 | 41,423 | ||
| max | OpenHands | 85.9% | $2.54 | 60,971 | |
| MiMo-V2.6 Pro | OpenHands | 85.2% | $1.04 | 149,562 | |
| Kimi K3 | OpenHands | 85% | $10 | 100,216 | |
| Kimi K3.1 Pro | OpenHands | 84.9% | $7.49 | 116,139 | |
| OpenHands | 84.7% | $0.41 | 143,729 | ||
| GPT-6.1 Terra | OpenHands | 84% | $6.00 | 118,574 | |
| OpenHands | 83.9% | $8.56 | 81,426 | ||
| OpenHands | 83.7% | $0.05 | 37,758 | ||
| OpenHands | 83.1% | $1.80 | 36,607 | ||
| OpenHands | 82.9% | $2.10 | 54,278 | ||
| Claude Opus 4.8 | OpenHands | 82.7% | $27 | ||
| OpenHands | 82.3% | $0.36 | 154,929 | ||
| GPT-6 Luna | OpenHands | 81.7% | $1.35 | 180,091 | |
| OpenHands | 81.6% | $12 | 127,093 | ||
| OpenHands | 81.5% | $1.90 | 188,867 | ||
| Claude Sonnet 5 | OpenHands | 81.3% | $25 | ||
| OpenHands | 81% | $2.39 | 154,239 | ||
| GPT-5.6 Sol | OpenHands | 80.5% | $33 | ||
| OpenHands | 79.1% | $1.53 | 47,024 | ||
| MiMo-V2.6 Flash | OpenHands | 79% | $0.56 | 165,570 | |
| OpenHands | 78.7% | $6.87 | 122,884 | ||
| OpenHands | 78.4% | $20 | 161,302 | ||
| GLM-5.3 | OpenHands | 78.1% | $12 | 163,467 | |
| Claude Opus 4.8 | Claude Code | 77.5% | $6.86 | 80,284 | |
| OpenHands | 77.5% | $2.18 | 125,264 | ||
| OpenHands | 77.1% | $12 | 166,554 | ||
| GPT-5.6 Luna | OpenHands | 77.1% | $0.73 | 73,204 | |
| Grok 4.6 | OpenHands | 76.2% | $4.88 | 76,097 | |
| OpenHands | 76.2% | $1.66 | 41,718 | ||
| OpenHands | 74.7% | $0.91 | 155,038 | ||
| GPT-5.6 Terra | OpenHands | 74.6% | $7.89 | 97,307 | |
| OpenHands | 73.9% | $1.15 | 169,763 | ||
| OpenHands | 72.2% | $0.92 | |||
| Claude Opus 4.7 | OpenHands | 71% | $21 | ||
| OpenHands | 70.4% | $5.86 | 163,654 | ||
| OpenHands | 70.4% | $4.83 | 117,608 | ||
| GPT-5.5 | OpenHands | 69.8% | $17 | 61,798 | |
| Grok 4.5 | OpenHands | 69% | $4.10 | ||
| GPT-5.4 | xhigh | OpenHands | 67.4% | $11 | 116,452 |
| GPT-5.5 | Factory | 67.4% | $5.93 | 48,868 | |
| Beam 1.0 | OpenHands | 66.4% | 40,097 | ||
| OpenHands | 64.8% | $23 | 176,498 | ||
| OpenHands | 64.7% | $8.24 | 119,118 | ||
| OpenHands | 64% | $3.04 | 81,300 | ||
| GLM-5.2 | OpenHands | 64% | $8.49 | ||
| GPT-5.3 Codex | OpenHands | 61.8% | $12 | 80,188 | |
| Mercury 3 | OpenHands | 60.9% | $0.63 | 129,860 | |
| GPT-5.5 | Codex | 58.2% | $3.63 | 40,368 | |
| Claude Opus 4.6 | non-thinking | OpenHands | 57.6% | $8.69 | |
| Claude Sonnet 4.6 | Claude Code | 55.8% | $7.35 | 7,242 | |
| GPT-5.2 | OpenHands | 53.5% | $18 | 88,133 | |
| Claude Opus 4.6 | thinking | OpenHands | 53.5% | $8.28 | |
| Claude Sonnet 4.6 | OpenHands | 51.5% | $5.91 | ||
| OpenHands | 49.9% | $2.21 | |||
| Composer 2.5 | Cursor CLI | 49.6% | $0.50 | 40,586 | |
| OpenHands | 48.7% | $2.54 | 65,703 | ||
| GPT-5.4 | Codex | 48.5% | $7.51 | 72,205 | |
| GPT-5.4 Mini | OpenHands | 48% | $1.19 | ||
| OpenHands | 47.7% | $11 | 47,095 | ||
| OpenHands | 47.6% | $6.45 | |||
| Kimi K2.7 Code | OpenHands | 47.2% | $3.84 | ||
| OpenHands | 46.4% | $1.08 | |||
| MiMo-V2.5 | OpenHands | 42.2% | $0.07 | ||
| GPT-5.2 Codex | OpenHands | 37.9% | $4.15 | 53,174 | |
| Kimi K2.6 | OpenHands | 37.9% | $1.93 | ||
| OpenHands | 37.2% | $0.83 | 67,200 | ||
| MiMo-V2.5-Pro | OpenHands | 34.1% | $0.17 | ||
| OpenHands | 32% | $3.83 | |||
| GLM-5.1 | OpenHands | 31.5% | $2.89 | ||
| GLM-5.3-Flash | OpenHands | 30.8% | $4.70 | 238,331 | |
| GPT-5.4 Nano | OpenHands | 26.1% | $1.28 | ||
| OpenHands | 25.6% | $5.45 | 53,075 | ||
| GPT-5.1 | OpenHands | 24.6% | $2.57 | ||
| GLM-5 | thinking | OpenHands | 23.4% | $40 | 57,419 |
| Claude Sonnet 4.5 | thinking | OpenHands | 22.6% | $6.66 | |
| GPT-5.1-Codex-Max | OpenHands | 22.2% | $7.32 | ||
| Claude Opus 4.5 | thinking | OpenHands | 20.6% | $33 | |
| OpenHands | 20.2% | $0.94 | |||
| GPT-5 | OpenHands | 20.1% | $1.53 | ||
| OpenHands | 19.7% | 41,618 | |||
| Grok 4.3 | OpenHands | 19.4% | $1.28 | ||
| OpenHands | 19.2% | $1.61 | 45,766 | ||
| OpenHands | 19.1% | $0.43 | 42,713 | ||
| Kimi K2.5 | thinking | OpenHands | 17.5% | $0.88 | |
| thinking | OpenHands | 15.7% | $3.80 | 48,819 | |
| OpenHands | 14.8% | $2.20 | 52,563 | ||
| OpenHands | 14.3% | $6.42 | |||
| GPT-5 mini | OpenHands | 14.2% | $0.25 | 21,744 | |
| Grok Build 0.1 | Grok Build | 13.3% | |||
| GPT-5.1-Codex | OpenHands | 13.1% | $3.80 | ||
| OpenHands | 11.9% | $4.66 | 51,528 | ||
| OpenHands | 11.9% | $2.82 | |||
| Claude Haiku 4.5 | thinking | OpenHands | 11.4% | $1.31 | |
| OpenHands | 11% | 62,251 | |||
| OpenHands | 7.64% | 108,817 | |||
| OpenHands | 5.21% | 51,638 | |||
| thinking | OpenHands | 5.11% | $2.47 | ||
| Grok 4.20 | reasoning | OpenHands | 4.06% | $0.77 | |
| OpenHands | 3.71% | $0.54 | 58,038 | ||
| Mercury 2.5 | OpenHands | 3.68% | $0.38 | 28,520 | |
| OpenHands | 3.51% | $6.02 | |||
| OpenHands | 3.40% | $0.23 | 147,021 | ||
| GLM-4.6 | OpenHands | 3.09% | $11 | ||
| OpenHands | 2.91% | $0.29 | 76,123 | ||
| OpenHands | 2.89% | $17 | 78,622 | ||
| Grok 4.1 Fast | reasoning | OpenHands | 1.20% | $0.21 | 16,637 |
| OpenHands | 0.40% | $1.22 | |||
| Grok 4 Fast | reasoning | OpenHands | 0% | $0.13 | |
| OpenHands | 0% | $0.51 | 20,850 | ||
| OpenHands | 0% | $6.47 | 60,285 | ||
| OpenHands | 0% | $0.13 | 66,932 |
7 models have held number one on the official leaderboard since its release in March 2026 7 models have held number one with claims included since its release in March 2026
Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.
Sources: Official Vibe Code Bench leaderboard and labs’ model cards
Claude Fable 5 on the official leaderboard passed 85% in June 2026
That was 3 months after its release. By the same age, 23% of the benchmarks from 2026 had passed 85%. All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official Vibe Code Bench leaderboard and labs’ model cards
2 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Nov 20, 2026 | 77.9 | Vibe Code Bench v1.1 (openhands, Vals) | |
| Nov 5, 2026 | 81.6 | Vibe Code Bench v1.1 | |
| Oct 13, 2026 | 91.9 | Vibe Code Bench |
2 system cards report it, from 2 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Nov 20, 2026 | | 77.9 | Vibe Code Bench v1.1 (openhands, Vals) | Capabilities |
| Oct 13, 2026 | | 91.9 | Vibe Code Bench (results table, p.5) | Capabilities |
2 lab claims next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 2 of them match, which usually means one side copied the other. Every benchmark.
| Model | Lab says | Board says | Gap |
|---|---|---|---|
| | 81.6% Vibe Code Bench v1.1 | 81.5% Leaderboard, OpenHands | Same |
| | 91.9% Vibe Code Bench | 91.9% Leaderboard, OpenHands | Same |
Versions
We switch the top row to each new version when it comes out. Open it for one row per version. An old version stays in play while people still test it, so whoever first takes it past 85% gets credit for closing it out.
Source: Official leaderboards
More in Coding
- SWE-bench Verified In use 500 human-validated GitHub issues from 12 Python repos. Agent writes a patch that must pass hidden tests. Claude Opus 4.7 83.5%
- LiveCodeBench v6 In use Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests.
DeepSeek-V4-Pro 93.5%
- SWE-bench Multilingual In use 300 GitHub-issue tasks across nine programming languages in SWE-bench format. Patch graded by repository tests. Claude Fable 5.2 96.6%
- DeepSWE In use 113 original long-horizon engineering tasks across 91 repos and five languages, written from scratch. Hand-written verifiers accept alternative solutions. GPT-6 Astra 74.1%
- SciCode In use Scientist-curated research coding problems split into subproblems across natural sciences. Code checked against test cases.
Seed2.1 Pro 59.8%
- Codeforces rating In use Model solves recent Codeforces contest problems. An Elo-style rating is computed from simulated contest performance.
DeepSeek V4.1 Flash 3,471
Data audit
10 of 11 checks pass, 1 warning. Look first at the Confidence check. Likely. Some facts rest on secondary sources. Every benchmark
Catalog record 1 warning 1 pass
- Pass Task access The tasks are private.
- Warning Confidence Likely. Some facts rest on secondary sources.
Scores 4 pass 1 note
- Pass Independent runs Scores from the official leaderboard (126 entries), launch posts (3 scores) and system cards (2 scores).
- Pass Models scored 125 models we track, plus 2 other entries on its leaderboard.
- Pass Newest score The newest is from November 2026, for Inkling 2 Mini.
- Pass Frontier models 10 of the top 10 have a score, led by GPT-6.2 Astra (#1).
- Note Headroom Saturated. The best is 93.8%, past 85% since June 2026.
Leaderboard import 3 pass
- Pass Importer We read the board on vals.ai: 131 rows for models we track and 2 other entries at the last read.
- Pass Last read November 19th, 2026.
- Pass Read worked The last read worked.
Consistency 2 pass
- Pass Lab claims Both pairs agree within 10 points.
- Pass Known issues No published audit found problems.