Vals Finance Agent v2.1
The official leaderboard hasn’t scored a model released after Gemini 4 Neon (November 2026). Labs report their own numbers for one newer model: Inkling 2 Mini at 56.5%.
Agents answer analyst-grade questions on public company filings, scored with dealbreaker-gated partial credit. A three-model jury grades answers and fails hedged ones.
Revises v2 with question and rubric fixes and a jury of GPT-6.1 Sol, Gemini 3.8 Flash and Claude Sonnet 5.5. Vals says scores are not comparable with v2. Part of Vals Index v2.2 from October 19th, 2026.
- Made by
- Vals AI
- Released
- October 2026
- Kind
- Finance
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Agent task
- Tasks
- Public, plus a private test set
- Measures
- Capability
- Subject
- Economics and business
- Language
- English
- Interaction
- Agentic
- Environment
- Browser
- Items from
- Real work and use, Another benchmark
- Refresh
- New versions replace it
- Run by
- A host
- Based on
- Vals Finance Agent v2
- Occupations
- Business and financial operations
- In views
- Agents, Law and finance
- Strongest model tested
- GPT-6.2 Astra #1 on the capability index
- Last in a launch post
- November 2026
- Last model added
- November 2026
- Scores refreshed
- November 19th, 2026
In the authors’ words
Artificial Intelligence (AI) technology has emerged as a transformative force in financial analysis and the finance industry, though significant questions remain about the full capabilities of Large Language Model (LLM) agents in this domain. We present the Finance Agent Benchmark, featuring challenging and diverse real-world finance research problems that require LLMs to perform complex analysis using recent SEC filings. We construct the benchmark using a taxonomy of nine financial task categories, developed in consultation with experts from banks, hedge funds, and private equity firms. The dataset includes 537 expert-authored questions covering tasks from information retrieval to complex financial modeling, each validated through a rigorous review process to ensure accuracy and relevance. Moreover, we implement an agentic harness that equips LLMs with tools sufficient to produce accurate responses, including Google Search and EDGAR database access. Overall, the Finance Agent Benchmark provides a comprehensive testbed for measuring the progress of LLM-driven finance agents. Our evaluation reveals significant limitations in current AI capabilities - even the best-performing model (OpenAI o3) achieved only 46.8% accuracy at an average cost of $3.79 per query. This underscores the need for further advancements before reliable deployment in high-stakes finance settings.
Claude Fable 5.2 leads with 69.5% Claude Fable 5.2 leads with 69.5%
Best score per entry from the benchmark's own leaderboard, read on November 19th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.
Claude Fable 5.2 leads with 69.5%, claims included
Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model. Striped bars are claims, and dotted bars are reruns by Epoch AI or another board.
- 69.5 Claude Fable 5.2
- 68.6
Gemini 4 Neon
- 67.8 Claude Opus 5.5
- 67.7
Gemini 4 Argon
- 67.6
Muse Wonder Full
- 67.5
Inkling 2 Small
- 67.3 Claude Sonnet 5.5
- 67.2
Gemini 4 Carbon
- 66.7
Qwen4-Max
- 65.8
Gemini 3.8 Flash
- 65.5
Muse Wonder
- 65.4
DeepSeek V4.1 Flash
- 65.4 Claude Haiku 5.5
- 65.1
Gemini 4 Hydrogen
- 65.0 GLM-5.3
- 64.7
Tencent Hy4
- 64.3 MiMo-V2.6 Pro
- 63.8
Muse Ember
- 63.3 MiMo-V2.6 Flash
- 62.9
DeepSeek V4.1 Flash 1017
- 61.8 GPT-6.1 Sol
- 61.7
Mistral Large 4
- 61.6
Tencent Hy4 preview
- 61.5 Kimi K3.1 Pro
- 61.4
Mistral Large 4 Preview
- 60.8 Hy4 Flash
- 60.8 GPT-6.2 Astra
- 60.7
Muse Spark Open
- 60.6 GLM-5.3-Flash
- 60.6 Grok 4.7
- 60.4 GPT-6 Astra
- 60.0 Kimi K3
- 58.9 GPT-6.2 Sol
- 58.9
Step 5 Preview
- 58.8
Qwen3.8 Max (0902)
- 58.8
MiniMax-M3.1-Flash
- 57.1
DeepSeek V4 Pro 0813
- 56.8 GPT-6 Luna
- 56.0 GPT-6.1 Terra
- 54.7 Mercury 3
- 54.3
MiniMax-M3
- 51.8 Beam 1.0
- 49.9
Inkling
- 47.7
Nemotron 3.5 Super VL
- 44.8
Inkling-Small
- 1 Claude Fable 5.2 69.5%
- 2
Gemini 4 Neon 68.6%
- 3 Claude Opus 5.5 67.8%
- 4
Gemini 4 Argon 67.7%
- 5
Muse Wonder Full 67.6%
- 6
Inkling 2 Small 67.5%
- 7 Claude Sonnet 5.5 67.3%
- 8
Gemini 4 Carbon 67.2%
- 9
Qwen4-Max 66.7%
- 10
Gemini 3.8 Flash 65.8%
- 11
Muse Wonder 65.5%
- 12
DeepSeek V4.1 Flash 65.4%
- 13 Claude Haiku 5.5 65.4%
- 14
Gemini 4 Hydrogen 65.1%
- 15 GLM-5.3 65%
- 16
Tencent Hy4 64.7%
- 17 MiMo-V2.6 Pro 64.3%
- 18
Muse Ember 63.8%
- 19 MiMo-V2.6 Flash 63.3%
- 20
DeepSeek V4.1 Flash 1017 62.9%
- 21 GPT-6.1 Sol 61.8%
- 22
Mistral Large 4 61.7%
- 23
Tencent Hy4 preview 61.6%
- 24 Kimi K3.1 Pro 61.5%
- 25
Mistral Large 4 Preview 61.4%
- 26 Hy4 Flash 60.8%
- 27 GPT-6.2 Astra 60.8%
- 28
Muse Spark Open 60.7%
- 29 GLM-5.3-Flash 60.6%
- 30 Grok 4.7 60.6%
- 31 GPT-6 Astra 60.4%
- 32 Kimi K3 60%
- 33 GPT-6.2 Sol 58.9%
- 34
Step 5 Preview 58.9%
- 35
Qwen3.8 Max (0902) 58.8%
- 36
MiniMax-M3.1-Flash 58.8%
- 37
DeepSeek V4 Pro 0813 57.1%
- 38 GPT-6 Luna 56.8%
- 39 GPT-6.1 Terra 56%
- 40 Mercury 3 54.7%
- 41
MiniMax-M3 54.3%
- 42 Beam 1.0 51.8%
- 43
Inkling 49.9%
- 44
Nemotron 3.5 Super VL 47.7%
- 45
Inkling-Small 44.8%
Source: Official Vals Finance Agent v2.1 leaderboard
- 69.5 Claude Fable 5.2
- 68.6
Gemini 4 Neon
- 67.8 Claude Opus 5.5
- 67.7
Gemini 4 Argon
- 67.6
Muse Wonder Full
- 67.5
Inkling 2 Small
- 67.3 Claude Sonnet 5.5
- 67.2
Gemini 4 Carbon
- 66.7
Qwen4-Max
- 65.8
Gemini 3.8 Flash
- 65.5
Muse Wonder
- 65.4
DeepSeek V4.1 Flash
- 65.4 Claude Haiku 5.5
- 65.1
Gemini 4 Hydrogen
- 65.0 GLM-5.3
- 64.7
Tencent Hy4
- 64.3 MiMo-V2.6 Pro
- 63.8
Muse Ember
- 63.3 MiMo-V2.6 Flash
- 62.9
DeepSeek V4.1 Flash 1017
- 61.8 GPT-6.1 Sol
- 61.7
Mistral Large 4
- 61.6
Tencent Hy4 preview
- 61.5 Kimi K3.1 Pro
- 61.4
Mistral Large 4 Preview
- 60.8 GPT-6.2 Astra
- 60.7
Muse Spark Open
- 60.6 GLM-5.3-Flash
- 60.6 Grok 4.7
- 60.4 GPT-6 Astra
- 60.0 Kimi K3
- 58.9 GPT-6.2 Sol
- 58.9
Step 5 Preview
- 58.8
Qwen3.8 Max (0902)
- 58.8
MiniMax-M3.1-Flash
- 57.1
DeepSeek V4 Pro 0813
- 56.8 GPT-6 Luna
- 56.0 GPT-6.1 Terra
- 54.7 Mercury 3
- 54.3
MiniMax-M3
- 51.8 Beam 1.0
- 49.9
Inkling
- 47.7
Nemotron 3.5 Super VL
- 44.8
Inkling-Small
- 1 Claude Fable 5.2 69.5%
- 2
Gemini 4 Neon 68.6%
- 3 Claude Opus 5.5 67.8%
- 4
Gemini 4 Argon 67.7%
- 5
Muse Wonder Full 67.6%
- 6
Inkling 2 Small 67.5%
- 7 Claude Sonnet 5.5 67.3%
- 8
Gemini 4 Carbon 67.2%
- 9
Qwen4-Max 66.7%
- 10
Gemini 3.8 Flash 65.8%
- 11
Muse Wonder 65.5%
- 12
DeepSeek V4.1 Flash 65.4%
- 13 Claude Haiku 5.5 65.4%
- 14
Gemini 4 Hydrogen 65.1%
- 15 GLM-5.3 65%
- 16
Tencent Hy4 64.7%
- 17 MiMo-V2.6 Pro 64.3%
- 18
Muse Ember 63.8%
- 19 MiMo-V2.6 Flash 63.3%
- 20
DeepSeek V4.1 Flash 1017 62.9%
- 21 GPT-6.1 Sol 61.8%
- 22
Mistral Large 4 61.7%
- 23
Tencent Hy4 preview 61.6%
- 24 Kimi K3.1 Pro 61.5%
- 25
Mistral Large 4 Preview 61.4%
- 26 GPT-6.2 Astra 60.8%
- 27
Muse Spark Open 60.7%
- 28 GLM-5.3-Flash 60.6%
- 29 Grok 4.7 60.6%
- 30 GPT-6 Astra 60.4%
- 31 Kimi K3 60%
- 32 GPT-6.2 Sol 58.9%
- 33
Step 5 Preview 58.9%
- 34
Qwen3.8 Max (0902) 58.8%
- 35
MiniMax-M3.1-Flash 58.8%
- 36
DeepSeek V4 Pro 0813 57.1%
- 37 GPT-6 Luna 56.8%
- 38 GPT-6.1 Terra 56%
- 39 Mercury 3 54.7%
- 40
MiniMax-M3 54.3%
- 41 Beam 1.0 51.8%
- 42
Inkling 49.9%
- 43
Nemotron 3.5 Super VL 47.7%
- 44
Inkling-Small 44.8%
Source: Official Vals Finance Agent v2.1 leaderboard
- 69.5 Claude Fable 5.2
- 68.6
Gemini 4 Neon
- 67.8 Claude Opus 5.5
- 67.7
Gemini 4 Argon
- 67.6
Muse Wonder Full
- 67.5
Inkling 2 Small
- 67.3 Claude Sonnet 5.5
- 67.2
Gemini 4 Carbon
- 66.7
Qwen4-Max
- 65.8
Gemini 3.8 Flash
- 65.5
Muse Wonder
- 65.4
DeepSeek V4.1 Flash
- 65.4 Claude Haiku 5.5
- 65.1
Gemini 4 Hydrogen
- 65.0 GLM-5.3
- 64.7
Tencent Hy4
- 64.3 MiMo-V2.6 Pro
- 63.8
Muse Ember
- 63.3 MiMo-V2.6 Flash
- 62.9
DeepSeek V4.1 Flash 1017
- 61.8 GPT-6.1 Sol
- 61.7
Mistral Large 4
- 61.6
Tencent Hy4 preview
- 61.5 Kimi K3.1 Pro
- 61.4
Mistral Large 4 Preview
- 60.8 GPT-6.2 Astra
- 60.7
Muse Spark Open
- 60.6 GLM-5.3-Flash
- 60.6 Grok 4.7
- 60.4 GPT-6 Astra
- 60.0 Kimi K3
- 58.9 GPT-6.2 Sol
- 58.9
Step 5 Preview
- 58.8
Qwen3.8 Max (0902)
- 58.8
MiniMax-M3.1-Flash
- 57.1
DeepSeek V4 Pro 0813
- 56.8 GPT-6 Luna
- 56.5
Inkling 2 Mini
- 56.0 GPT-6.1 Terra
- 54.7 Mercury 3
- 54.3
MiniMax-M3
- 51.8 Beam 1.0
- 49.9
Inkling
- 47.7
Nemotron 3.5 Super VL
- 44.8
Inkling-Small
- 1 Claude Fable 5.2 69.5%
- 2
Gemini 4 Neon 68.6%
- 3 Claude Opus 5.5 67.8%
- 4
Gemini 4 Argon 67.7%
- 5
Muse Wonder Full 67.6%
- 6
Inkling 2 Small 67.5%
- 7 Claude Sonnet 5.5 67.3%
- 8
Gemini 4 Carbon 67.2%
- 9
Qwen4-Max 66.7%
- 10
Gemini 3.8 Flash 65.8%
- 11
Muse Wonder 65.5%
- 12
DeepSeek V4.1 Flash 65.4%
- 13 Claude Haiku 5.5 65.4%
- 14
Gemini 4 Hydrogen 65.1%
- 15 GLM-5.3 65%
- 16
Tencent Hy4 64.7%
- 17 MiMo-V2.6 Pro 64.3%
- 18
Muse Ember 63.8%
- 19 MiMo-V2.6 Flash 63.3%
- 20
DeepSeek V4.1 Flash 1017 62.9%
- 21 GPT-6.1 Sol 61.8%
- 22
Mistral Large 4 61.7%
- 23
Tencent Hy4 preview 61.6%
- 24 Kimi K3.1 Pro 61.5%
- 25
Mistral Large 4 Preview 61.4%
- 26 GPT-6.2 Astra 60.8%
- 27
Muse Spark Open 60.7%
- 28 GLM-5.3-Flash 60.6%
- 29 Grok 4.7 60.6%
- 30 GPT-6 Astra 60.4%
- 31 Kimi K3 60%
- 32 GPT-6.2 Sol 58.9%
- 33
Step 5 Preview 58.9%
- 34
Qwen3.8 Max (0902) 58.8%
- 35
MiniMax-M3.1-Flash 58.8%
- 36
DeepSeek V4 Pro 0813 57.1%
- 37 GPT-6 Luna 56.8%
- 38
Inkling 2 Mini 56.5%
- 39 GPT-6.1 Terra 56%
- 40 Mercury 3 54.7%
- 41
MiniMax-M3 54.3%
- 42 Beam 1.0 51.8%
- 43
Inkling 49.9%
- 44
Nemotron 3.5 Super VL 47.7%
- 45
Inkling-Small 44.8%
Sources: Official Vals Finance Agent v2.1 leaderboard and labs’ model cards
| # | Entry | Score ± 95% CI | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 69.5% ±3.9 | Nov 2026 | Official leaderboard | |
| 2 | | 68.6% ±3.8 | Nov 2026 | Official leaderboard | |
| 3 | Claude Opus 5.5 | 67.8% ±4 | Sep 2026 | Official leaderboard | |
| 4 | | 67.7% ±3.9 | Sep 2026 | Official leaderboard | |
| 5 | | 67.6% ±3.9 | Oct 2026 | Official leaderboard | |
| 6 | | 67.5% ±4 | Nov 2026 | Official leaderboard | |
| 7 | Claude Sonnet 5.5 | 67.3% ±4 | Sep 2026 | Official leaderboard | |
| 8 | | 67.2% ±4 | Oct 2026 | Official leaderboard | |
| 9 | | 66.7% ±4 | Nov 2026 | Official leaderboard | |
| 10 | | 65.8% ±4 | Sep 2026 | Official leaderboard | |
| 11 | | 65.5% ±4 | Oct 2026 | Official leaderboard | |
| 12 | | 65.4% ±4 | Sep 2026 | Official leaderboard | |
| 13 | Claude Haiku 5.5 | 65.4% ±4 | Oct 2026 | Official leaderboard | |
| 14 | | 65.1% ±4 | Nov 2026 | Official leaderboard | |
| 15 | GLM-5.3 | 65% ±3.9 | Aug 2026 | Official leaderboard | |
| 16 | | 64.7% ±4 | Nov 2026 | Official leaderboard | |
| 17 | MiMo-V2.6 Pro | 64.3% ±3.9 | Sep 2026 | Official leaderboard | |
| 18 | | 63.8% ±3.9 | Nov 2026 | Official leaderboard | |
| 19 | MiMo-V2.6 Flash | 63.3% ±4.1 | Sep 2026 | Official leaderboard | |
| 20 | | 62.9% ±4 | Oct 2026 | Official leaderboard | |
| 21 | GPT-6.1 Sol | 61.8% ±4.1 | Sep 2026 | Official leaderboard | |
| 22 | | 61.7% ±4 | Oct 2026 | Official leaderboard | |
| 23 | | 61.6% ±4 | Aug 2026 | Official leaderboard | |
| 24 | Kimi K3.1 Pro | 61.5% ±4.1 | Oct 2026 | Official leaderboard | |
| 25 | | 61.4% ±4 | Oct 2026 | Official leaderboard | |
| 26 | Hy4 Flash | 60.8% ±4.1 | Official leaderboard | ||
| 27 | GPT-6.2 Astra | 60.8% ±4.2 | Nov 2026 | Official leaderboard | |
| 28 | | 60.7% ±4 | Oct 2026 | Official leaderboard | |
| 29 | GLM-5.3-Flash | 60.6% ±4 | Aug 2026 | Official leaderboard | |
| 30 | Grok 4.7 | 60.6% ±4.1 | Sep 2026 | Official leaderboard | |
| 31 | GPT-6 Astra | 60.4% ±4.2 | Sep 2026 | Official leaderboard | |
| 32 | Kimi K3 | 60% ±4.1 | Jul 2026 | Official leaderboard | |
| 33 | GPT-6.2 Sol | 58.9% ±4.1 | Nov 2026 | Official leaderboard | |
| 34 | | 58.9% ±4 | Sep 2026 | Official leaderboard | |
| 35 | | 58.8% ±4.1 | Sep 2026 | Official leaderboard | |
| 36 | | 58.8% ±4.1 | Oct 2026 | Official leaderboard | |
| 37 | | 57.1% ±4.1 | Aug 2026 | Official leaderboard | |
| 38 | GPT-6 Luna | 56.8% ±4.2 | Sep 2026 | Official leaderboard | |
| 39 | GPT-6.1 Terra | 56% ±4.1 | Oct 2026 | Official leaderboard | |
| 40 | Mercury 3 | 54.7% ±3.9 | Oct 2026 | Official leaderboard | |
| 41 | | 54.3% ±4 | Jun 2026 | Official leaderboard | |
| 42 | Beam 1.0 | 51.8% ±4.1 | Oct 2026 | Official leaderboard | |
| 43 | | 49.9% ±4.1 | Jul 2026 | Official leaderboard | |
| 44 | | 47.7% ±4.1 | Oct 2026 | Official leaderboard | |
| 45 | | 44.8% ±4.1 | Jul 2026 | Official leaderboard |
| # | Model | Score ± 95% CI | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 69.5% ±3.9 | Nov 2026 | Official leaderboard | |
| 2 | | 68.6% ±3.8 | Nov 2026 | Official leaderboard | |
| 3 | Claude Opus 5.5 | 67.8% ±4 | Sep 2026 | Official leaderboard | |
| 4 | | 67.7% ±3.9 | Sep 2026 | Official leaderboard | |
| 5 | | 67.6% ±3.9 | Oct 2026 | Official leaderboard | |
| 6 | | 67.5% ±4 | Nov 2026 | Official leaderboard | |
| 7 | Claude Sonnet 5.5 | 67.3% ±4 | Sep 2026 | Official leaderboard | |
| 8 | | 67.2% ±4 | Oct 2026 | Official leaderboard | |
| 9 | | 66.7% ±4 | Nov 2026 | Official leaderboard | |
| 10 | | 65.8% ±4 | Sep 2026 | Official leaderboard | |
| 11 | | 65.5% ±4 | Oct 2026 | Official leaderboard | |
| 12 | | 65.4% ±4 | Sep 2026 | Official leaderboard | |
| 13 | Claude Haiku 5.5 | 65.4% ±4 | Oct 2026 | Official leaderboard | |
| 14 | | 65.1% ±4 | Nov 2026 | Official leaderboard | |
| 15 | GLM-5.3 | 65% ±3.9 | Aug 2026 | Official leaderboard | |
| 16 | | 64.7% ±4 | Nov 2026 | Official leaderboard | |
| 17 | MiMo-V2.6 Pro | 64.3% ±3.9 | Sep 2026 | Official leaderboard | |
| 18 | | 63.8% ±3.9 | Nov 2026 | Official leaderboard | |
| 19 | MiMo-V2.6 Flash | 63.3% ±4.1 | Sep 2026 | Official leaderboard | |
| 20 | | 62.9% ±4 | Oct 2026 | Official leaderboard | |
| 21 | GPT-6.1 Sol | 61.8% ±4.1 | Sep 2026 | Official leaderboard | |
| 22 | | 61.7% ±4 | Oct 2026 | Official leaderboard | |
| 23 | | 61.6% ±4 | Aug 2026 | Official leaderboard | |
| 24 | Kimi K3.1 Pro | 61.5% ±4.1 | Oct 2026 | Official leaderboard | |
| 25 | | 61.4% ±4 | Oct 2026 | Official leaderboard | |
| 26 | GPT-6.2 Astra | 60.8% ±4.2 | Nov 2026 | Official leaderboard | |
| 27 | | 60.7% ±4 | Oct 2026 | Official leaderboard | |
| 28 | GLM-5.3-Flash | 60.6% ±4 | Aug 2026 | Official leaderboard | |
| 29 | Grok 4.7 | 60.6% ±4.1 | Sep 2026 | Official leaderboard | |
| 30 | GPT-6 Astra | 60.4% ±4.2 | Sep 2026 | Official leaderboard | |
| 31 | Kimi K3 | 60% ±4.1 | Jul 2026 | Official leaderboard | |
| 32 | GPT-6.2 Sol | 58.9% ±4.1 | Nov 2026 | Official leaderboard | |
| 33 | | 58.9% ±4 | Sep 2026 | Official leaderboard | |
| 34 | | 58.8% ±4.1 | Sep 2026 | Official leaderboard | |
| 35 | | 58.8% ±4.1 | Oct 2026 | Official leaderboard | |
| 36 | | 57.1% ±4.1 | Aug 2026 | Official leaderboard | |
| 37 | GPT-6 Luna | 56.8% ±4.2 | Sep 2026 | Official leaderboard | |
| 38 | GPT-6.1 Terra | 56% ±4.1 | Oct 2026 | Official leaderboard | |
| 39 | Mercury 3 | 54.7% ±3.9 | Oct 2026 | Official leaderboard | |
| 40 | | 54.3% ±4 | Jun 2026 | Official leaderboard | |
| 41 | Beam 1.0 | 51.8% ±4.1 | Oct 2026 | Official leaderboard | |
| 42 | | 49.9% ±4.1 | Jul 2026 | Official leaderboard | |
| 43 | | 47.7% ±4.1 | Oct 2026 | Official leaderboard | |
| 44 | | 44.8% ±4.1 | Jul 2026 | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5.2 | 69.5% | Nov 2026 | Official leaderboard | |
| 2 | 68.6% | Nov 2026 | Official leaderboard | ||
| 3 | Claude Opus 5.5 | 67.8% | Sep 2026 | Official leaderboard | |
| 4 | 67.7% | Sep 2026 | Official leaderboard | ||
| 5 | 67.6% | Oct 2026 | Official leaderboard | ||
| 6 | 67.5% | Nov 2026 | Official leaderboard | ||
| 7 | Claude Sonnet 5.5 | 67.3% | Sep 2026 | Official leaderboard | |
| 8 | 67.2% | Oct 2026 | Official leaderboard | ||
| 9 | 66.7% | Nov 2026 | Official leaderboard | ||
| 10 | 65.8% | Sep 2026 | Official leaderboard | ||
| 11 | 65.5% | Oct 2026 | Official leaderboard | ||
| 12 | 65.4% | Sep 2026 | Official leaderboard | ||
| 13 | Claude Haiku 5.5 | 65.4% | Oct 2026 | Official leaderboard | |
| 14 | 65.1% | Nov 2026 | Official leaderboard | ||
| 15 | GLM-5.3 | 65% | Aug 2026 | Official leaderboard | |
| 16 | 64.7% | Nov 2026 | Official leaderboard | ||
| 17 | MiMo-V2.6 Pro | 64.3% | Sep 2026 | Official leaderboard | |
| 18 | 63.8% | Nov 2026 | Official leaderboard | ||
| 19 | MiMo-V2.6 Flash | 63.3% | Sep 2026 | Official leaderboard | |
| 20 | 62.9% | Oct 2026 | Official leaderboard | ||
| 21 | GPT-6.1 Sol | 61.8% | Sep 2026 | Official leaderboard | |
| 22 | 61.7% | Oct 2026 | Official leaderboard | ||
| 23 | 61.6% | Aug 2026 | Official leaderboard | ||
| 24 | Kimi K3.1 Pro | 61.5% | Oct 2026 | Official leaderboard | |
| 25 | 61.4% | Oct 2026 | Official leaderboard | ||
| 26 | GPT-6.2 Astra | 60.8% | Nov 2026 | Official leaderboard | |
| 27 | 60.7% | Oct 2026 | Official leaderboard | ||
| 28 | GLM-5.3-Flash | 60.6% | Aug 2026 | Official leaderboard | |
| 29 | Grok 4.7 | 60.6% | Sep 2026 | Official leaderboard | |
| 30 | GPT-6 Astra | 60.4% | Sep 2026 | Official leaderboard | |
| 31 | Kimi K3 | 60% | Jul 2026 | Official leaderboard | |
| 32 | GPT-6.2 Sol | 58.9% | Nov 2026 | Official leaderboard | |
| 33 | 58.9% | Sep 2026 | Official leaderboard | ||
| 34 | 58.8% | Sep 2026 | Official leaderboard | ||
| 35 | 58.8% | Oct 2026 | Official leaderboard | ||
| 36 | 57.1% | Aug 2026 | Official leaderboard | ||
| 37 | GPT-6 Luna | 56.8% | Sep 2026 | Official leaderboard | |
| 38 | 56.5% | Nov 2026 | Lab model card | ||
| 39 | GPT-6.1 Terra | 56% | Oct 2026 | Official leaderboard | |
| 40 | Mercury 3 | 54.7% | Oct 2026 | Official leaderboard | |
| 41 | 54.3% | Jun 2026 | Official leaderboard | ||
| 42 | Beam 1.0 | 51.8% | Oct 2026 | Official leaderboard | |
| 43 | 49.9% | Jul 2026 | Official leaderboard | ||
| 44 | 47.7% | Oct 2026 | Official leaderboard | ||
| 45 | 44.8% | Jul 2026 | Official leaderboard |
Labs report scores for 2 models in their cards. Switch the scores above to rank them together.
Accuracy against latency
The Vals scatter chart with its x axis switched from Cost to Latency: mean time per test against accuracy, on a log scale. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Accuracy | Latency (mean per test) |
|---|---|---|---|
| Claude Fable 5.2 | 69.5% | 207.62 s | |
| 68.6% | 1,232 s | ||
| Claude Opus 5.5 | 67.9% | 1,980 s | |
| 67.7% | 793.03 s | ||
| 67.6% | 850.3 s | ||
| 67.5% | 296.33 s | ||
| Claude Sonnet 5.5 | 67.3% | 2,066 s | |
| 67.2% | 1,780 s | ||
| 66.7% | 1,465 s | ||
| 65.8% | 443.89 s | ||
| 65.6% | 310.13 s | ||
| 65.4% | 960.25 s | ||
| Claude Haiku 5.5 | 65.4% | 1,865 s | |
| 65.1% | 1,078 s | ||
| GLM-5.3 | 65% | 1,206 s | |
| 64.7% | 2,239 s | ||
| MiMo-V2.6 Pro | 64.3% | 682.01 s | |
| 63.8% | 89.35 s | ||
| MiMo-V2.6 Flash | 63.3% | 936.35 s | |
| 62.9% | 909.21 s | ||
| GPT-6.1 Sol | 61.8% | 1,145 s | |
| 61.7% | 387.15 s | ||
| 61.6% | 1,503 s | ||
| Kimi K3.1 Pro | 61.5% | 2,099 s | |
| 61.4% | 986.07 s | ||
| Hy4 Flash | 60.8% | 344.74 s | |
| GPT-6.2 Astra | 60.8% | 2,258 s | |
| 60.7% | 1,612 s | ||
| GLM-5.3-Flash | 60.6% | 296.1 s | |
| Grok 4.7 | 60.6% | 652.29 s | |
| GPT-6 Astra | 60.4% | 1,229 s | |
| Kimi K3 | 60% | 875.04 s | |
| GPT-6.2 Sol | 58.9% | 1,318 s | |
| 58.9% | 542.51 s | ||
| 58.8% | 904.2 s | ||
| 58.8% | 3,320 s | ||
| 57.1% | 476.99 s | ||
| GPT-6 Luna | 56.8% | 926.86 s | |
| GPT-6.1 Terra | 56% | 1,787 s | |
| Mercury 3 | 54.7% | 232.76 s | |
| 54.3% | 189.32 s | ||
| Beam 1.0 | 51.8% | 85.43 s | |
| 49.9% | 573.75 s | ||
| 47.7% | 79.47 s | ||
| 44.8% | 314.22 s |
Accuracy against latency
The Vals scatter chart with its x axis switched from Cost to Latency: mean time per test against accuracy, on a log scale. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Accuracy | Latency (mean per test) |
|---|---|---|---|
| Claude Fable 5.2 | 69.5% | 207.62 s | |
| 68.6% | 1,232 s | ||
| Claude Opus 5.5 | 67.9% | 1,980 s | |
| 67.7% | 793.03 s | ||
| 67.6% | 850.3 s | ||
| 67.5% | 296.33 s | ||
| Claude Sonnet 5.5 | 67.3% | 2,066 s | |
| 67.2% | 1,780 s | ||
| 66.7% | 1,465 s | ||
| 65.8% | 443.89 s | ||
| 65.6% | 310.13 s | ||
| 65.4% | 960.25 s | ||
| Claude Haiku 5.5 | 65.4% | 1,865 s | |
| 65.1% | 1,078 s | ||
| GLM-5.3 | 65% | 1,206 s | |
| 64.7% | 2,239 s | ||
| MiMo-V2.6 Pro | 64.3% | 682.01 s | |
| 63.8% | 89.35 s | ||
| MiMo-V2.6 Flash | 63.3% | 936.35 s | |
| 62.9% | 909.21 s | ||
| GPT-6.1 Sol | 61.8% | 1,145 s | |
| 61.7% | 387.15 s | ||
| 61.6% | 1,503 s | ||
| Kimi K3.1 Pro | 61.5% | 2,099 s | |
| 61.4% | 986.07 s | ||
| GPT-6.2 Astra | 60.8% | 2,258 s | |
| 60.7% | 1,612 s | ||
| GLM-5.3-Flash | 60.6% | 296.1 s | |
| Grok 4.7 | 60.6% | 652.29 s | |
| GPT-6 Astra | 60.4% | 1,229 s | |
| Kimi K3 | 60% | 875.04 s | |
| GPT-6.2 Sol | 58.9% | 1,318 s | |
| 58.9% | 542.51 s | ||
| 58.8% | 904.2 s | ||
| 58.8% | 3,320 s | ||
| 57.1% | 476.99 s | ||
| GPT-6 Luna | 56.8% | 926.86 s | |
| GPT-6.1 Terra | 56% | 1,787 s | |
| Mercury 3 | 54.7% | 232.76 s | |
| 54.3% | 189.32 s | ||
| Beam 1.0 | 51.8% | 85.43 s | |
| 49.9% | 573.75 s | ||
| 47.7% | 79.47 s | ||
| 44.8% | 314.22 s |
The best score, 69.5%, costs $4.83 a task
Runs on the cost frontier score higher than any run that's cheaper. Inkling 2 Small comes within 1.9 points of the best for $0.18 a task, 27 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.
Source: Official Vals Finance Agent v2.1 leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Claude Fable 5.2 | 69.5% | $4.83 | 23,032 | ||
| 68.6% | $5.85 | 201,487 | |||
| Claude Opus 5.5 | 67.8% | $8.91 | 240,843 | ||
| 67.7% | $4.32 | 70,441 | |||
| 67.6% | $2.68 | 40,520 | |||
| 67.5% | $0.18 | 55,202 | |||
| Claude Sonnet 5.5 | 67.3% | $6.95 | 332,461 | ||
| 67.2% | $7.29 | 171,664 | |||
| 66.7% | $1.74 | 118,951 | |||
| 65.8% | $1.99 | 58,676 | |||
| 65.5% | $2.62 | 34,084 | |||
| 65.4% | $0.37 | 186,072 | |||
| Claude Haiku 5.5 | 65.4% | $1.64 | 459,542 | ||
| 65.1% | $4.36 | 318,627 | |||
| GLM-5.3 | 65% | $1.03 | 82,474 | ||
| 64.7% | $1.28 | 246,830 | |||
| MiMo-V2.6 Pro | 64.3% | $0.18 | 24,921 | ||
| 63.8% | $0.06 | 30,075 | |||
| MiMo-V2.6 Flash | 63.3% | $0.07 | 32,508 | ||
| 62.9% | $0.47 | 211,457 | |||
| GPT-6.1 Sol | 61.8% | $1.63 | 48,985 | ||
| 61.7% | $0.35 | 38,442 | |||
| 61.6% | $0.67 | 111,268 | |||
| Kimi K3.1 Pro | 61.5% | $2.29 | 109,319 | ||
| 61.4% | $0.52 | 65,158 | |||
| GPT-6.2 Astra | 60.8% | $7.98 | 66,546 | ||
| 60.7% | $2.76 | 31,778 | |||
| GLM-5.3-Flash | 60.6% | $0.07 | 39,147 | ||
| Grok 4.7 | 60.6% | $2.24 | 50,375 | ||
| GPT-6 Astra | 60.4% | $7.82 | 49,378 | ||
| Kimi K3 | 60% | $1.88 | 33,749 | ||
| GPT-6.2 Sol | 58.9% | $2.06 | 60,089 | ||
| 58.9% | $0.58 | 45,002 | |||
| 58.8% | $2.99 | 161,507 | |||
| 58.8% | $0.16 | 121,024 | |||
| 57.1% | $0.82 | 60,196 | |||
| GPT-6 Luna | 56.8% | $0.12 | 102,259 | ||
| GPT-6.1 Terra | 56% | $1.92 | 155,367 | ||
| Mercury 3 | 54.7% | $0.06 | 47,127 | ||
| 54.3% | $0.30 | 22,660 | |||
| Beam 1.0 | 51.8% | 33,555 | |||
| 49.9% | $0.89 | 59,596 | |||
| 47.7% | $0.11 | 30,828 | |||
| 44.8% | $0.21 | 52,337 |
The best score, 69.5%, costs $4.83 a task
Runs on the cost frontier score higher than any run that's cheaper. Inkling 2 Small comes within 1.9 points of the best for $0.18 a task, 27 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.
Source: Official Vals Finance Agent v2.1 leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Claude Fable 5.2 | 69.5% | $4.83 | 23,032 | ||
| 68.6% | $5.85 | 201,487 | |||
| Claude Opus 5.5 | 67.8% | $8.91 | 240,843 | ||
| 67.7% | $4.32 | 70,441 | |||
| 67.6% | $2.68 | 40,520 | |||
| 67.5% | $0.18 | 55,202 | |||
| Claude Sonnet 5.5 | 67.3% | $6.95 | 332,461 | ||
| 67.2% | $7.29 | 171,664 | |||
| 66.7% | $1.74 | 118,951 | |||
| 65.8% | $1.99 | 58,676 | |||
| 65.5% | $2.62 | 34,084 | |||
| 65.4% | $0.37 | 186,072 | |||
| Claude Haiku 5.5 | 65.4% | $1.64 | 459,542 | ||
| 65.1% | $4.36 | 318,627 | |||
| GLM-5.3 | 65% | $1.03 | 82,474 | ||
| 64.7% | $1.28 | 246,830 | |||
| MiMo-V2.6 Pro | 64.3% | $0.18 | 24,921 | ||
| 63.8% | $0.06 | 30,075 | |||
| MiMo-V2.6 Flash | 63.3% | $0.07 | 32,508 | ||
| 62.9% | $0.47 | 211,457 | |||
| GPT-6.1 Sol | 61.8% | $1.63 | 48,985 | ||
| 61.7% | $0.35 | 38,442 | |||
| 61.6% | $0.67 | 111,268 | |||
| Kimi K3.1 Pro | 61.5% | $2.29 | 109,319 | ||
| 61.4% | $0.52 | 65,158 | |||
| GPT-6.2 Astra | 60.8% | $7.98 | 66,546 | ||
| 60.7% | $2.76 | 31,778 | |||
| GLM-5.3-Flash | 60.6% | $0.07 | 39,147 | ||
| Grok 4.7 | 60.6% | $2.24 | 50,375 | ||
| GPT-6 Astra | 60.4% | $7.82 | 49,378 | ||
| Kimi K3 | 60% | $1.88 | 33,749 | ||
| GPT-6.2 Sol | 58.9% | $2.06 | 60,089 | ||
| 58.9% | $0.58 | 45,002 | |||
| 58.8% | $2.99 | 161,507 | |||
| 58.8% | $0.16 | 121,024 | |||
| 57.1% | $0.82 | 60,196 | |||
| GPT-6 Luna | 56.8% | $0.12 | 102,259 | ||
| GPT-6.1 Terra | 56% | $1.92 | 155,367 | ||
| Mercury 3 | 54.7% | $0.06 | 47,127 | ||
| 54.3% | $0.30 | 22,660 | |||
| Beam 1.0 | 51.8% | 33,555 | |||
| 49.9% | $0.89 | 59,596 | |||
| 47.7% | $0.11 | 30,828 | |||
| 44.8% | $0.21 | 52,337 |
2 models have held number one on the official leaderboard since its release in October 2026 2 models have held number one with claims included since its release in October 2026
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official Vals Finance Agent v2.1 leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official Vals Finance Agent v2.1 leaderboard and labs’ model cards
One lab put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Nov 5, 2026 | 67.5 | Finance Agent v2.1, 67.5% |
One system card reports it
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Nov 20, 2026 | | 56.5 | Finance Agent v2.1 | Capabilities |
One lab claim next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 1 of them match, which usually means one side copied the other. Every benchmark.
| Model | Lab says | Board says | Gap |
|---|---|---|---|
| | 67.5% Finance Agent v2.1, 67.5% | 67.5% Leaderboard | Same |
Versions
We switch the top row to each new version when it comes out. Open it for one row per version. An old version stays in play while people still test it, so whoever first takes it past 85% gets credit for closing it out.
Source: Official leaderboards
More in Law, finance and medicine
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4%
- HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy.
Ling-3.1-flash 81.7%
- KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024. o1-preview 92.7%
- Harvey LAB-AA v1.1 In use Artificial Analysis's run of Harvey's Legal Agent Benchmark on Harvey's newer private set of 120 tasks across 24 practice areas. A deliverable with a material hallucination scores zero, and the headline is the share of judges who find every rubric criterion passed. GPT-6.2 Astra 15%
Data audit
All 12 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access Public tasks, plus a private test set.
- Pass Confidence Checked against a primary source.
Scores 5 pass
- Pass Independent runs Scores from the official leaderboard (45 entries), launch posts (1 score) and system cards (1 score).
- Pass Models scored 45 models we track, plus 1 other entry on its leaderboard.
- Pass Newest score The newest is from November 2026, for Inkling 2 Mini.
- Pass Frontier models 9 of the top 10 have a score, led by GPT-6.2 Astra (#1).
- Pass Headroom The best is 69.5%, under 85%, so it still separates models.
Leaderboard import 3 pass
- Pass Importer We read the board on vals.ai: 44 rows for models we track and 1 other entry at the last read.
- Pass Last read November 19th, 2026.
- Pass Read worked The last read worked.
Consistency 2 pass
- Pass Lab claims The one pair agrees within 10 points.
- Pass Known issues No published audit found problems.