FrontierFinance
Agents answer 220 investment research queries from finance experts across six use cases of the investor workflow. Three judge models check each answer against 11,543 source-attributed rubrics.
The score is the rubric qualification rate, macro-averaged over queries. Results are reported per harness: web search only, the open Finance Agent v2 harness, and Samaya in-house harness.
- Made by
- Samaya AI
- Released
- July 2026
- Kind
- Finance
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Open-ended
- Tasks
- All public
- Strongest model tested
- Claude Opus 5.5 #4 on the capability index
- Last in a launch post
- October 2026
- Last model added
- October 2026
- Scores refreshed
- November 12th, 2026
In the authors’ words
AI agents are increasingly deployed for professional investment research, yet no benchmark captures the complexity of the full investor workflow. Existing benchmarks mainly target financial data extraction, a narrow slice that current models have largely saturated, while reference-based metrics and generic LLM-as-a-judge scoring fall short on the open-ended, long-form answers that real analyst queries demand. We introduce FrontierFinance, a fully open benchmark of 220 expert-crafted queries and 11,543 source-attributed rubrics spanning six crucial use cases across the full investor workflow. FrontierFinance is both broader and harder than existing public finance benchmarks. Evaluating frontier models and agent systems under a common harness restricted to publicly available data, we find that the tool harness, not the model alone, strongly shapes quality and efficiency; that Samaya's in-house system leads at 56.0%, ahead of the strongest frontier model (Claude Fable 5, 49.2%) at roughly 2.2x lower cost; and that the best open-weight model (Kimi K3, 46.4%) nearly matches the best proprietary model at 4.5x lower cost. Screening & Discovery and Sector, Industry & Macro remain the hardest use cases across all systems, where even the best systems reach only 33% and 39%. We make the dataset and grading code publicly available.
Samaya Sterling tops the leaderboard with 58.9%
Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Claude Fable 5.1, at 55.9%.
Step 5 Preview leads with 66.4%, claims included
Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model.
- 58.9 Samaya Sterling
- 56.0 Legacy Samaya System (high effort)
- 55.9 Claude Fable 5.1
- 53.7
Muse Spark Open
- 52.9 Legacy Samaya System
- 52.6
Muse Wonder
- 51.7 Kimi K3.1 Pro
- 50.9 Claude Opus 5.5
- 50.0
Gemini 3.8 Flash
- 49.2 Claude Fable 5
- 46.8 GPT-5.6 Sol
- 46.6
Ling-3.0-flash-Fin
- 46.4 Kimi K3
- 46.3
Gemini 3.6 Flash
- 45.0 Claude Opus 4.8
- 43.5 GPT-5.5
- 42.8 GLM-5.2
- 40.5
DeepSeek-V4-Pro
- 32.3 Kimi K2.6
- 30.7
Gemini 3.1 Pro
- 1 Samaya Sterling 58.9%
- 2 Legacy Samaya System (high effort) 56%
- 3 Claude Fable 5.1 high 55.9%
- 4
Muse Spark Open xhigh 53.7%
- 5 Legacy Samaya System 52.9%
- 6
Muse Wonder 52.6%
- 7 Kimi K3.1 Pro max 51.7%
- 8 Claude Opus 5.5 high 50.9%
- 9
Gemini 3.8 Flash medium 50%
- 10 Claude Fable 5 high 49.2%
- 11 GPT-5.6 Sol medium 46.8%
- 12
Ling-3.0-flash-Fin 46.6%
- 13 Kimi K3 max 46.4%
- 14
Gemini 3.6 Flash medium 46.3%
- 15 Claude Opus 4.8 high 45%
- 16 GPT-5.5 medium 43.5%
- 17 GLM-5.2 max 42.8%
- 18
DeepSeek-V4-Pro high 40.5%
- 19 Kimi K2.6 on; level not supported 32.3%
- 20
Gemini 3.1 Pro high 30.7%
Source: Official FrontierFinance leaderboard
- 66.4
Step 5 Preview
- 58.6 Kimi K3.1 Pro
- 55.9 Claude Fable 5.1
- 53.7
Muse Spark Open
- 52.6
Muse Wonder
- 50.9 Claude Opus 5.5
- 50.0
Gemini 3.8 Flash
- 49.2 Claude Fable 5
- 46.8 GPT-5.6 Sol
- 46.6
Ling-3.0-flash-Fin
- 46.4 Kimi K3
- 46.3
Gemini 3.6 Flash
- 45.0 Claude Opus 4.8
- 43.5 GPT-5.5
- 42.8 GLM-5.2
- 40.5
DeepSeek-V4-Pro
- 32.3 Kimi K2.6
- 30.7
Gemini 3.1 Pro
- 1
Step 5 Preview 66.4%
- 2 Kimi K3.1 Pro 58.6%
- 3 Claude Fable 5.1 high 55.9%
- 4
Muse Spark Open xhigh 53.7%
- 5
Muse Wonder 52.6%
- 6 Claude Opus 5.5 high 50.9%
- 7
Gemini 3.8 Flash medium 50%
- 8 Claude Fable 5 high 49.2%
- 9 GPT-5.6 Sol medium 46.8%
- 10
Ling-3.0-flash-Fin 46.6%
- 11 Kimi K3 max 46.4%
- 12
Gemini 3.6 Flash medium 46.3%
- 13 Claude Opus 4.8 high 45%
- 14 GPT-5.5 medium 43.5%
- 15 GLM-5.2 max 42.8%
- 16
DeepSeek-V4-Pro high 40.5%
- 17 Kimi K2.6 on; level not supported 32.3%
- 18
Gemini 3.1 Pro high 30.7%
Sources: Labs’ model cards and official FrontierFinance leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Samaya Sterling | 58.9% | Official leaderboard | ||
| 2 | Legacy Samaya System (high effort) | 56% | Official leaderboard | ||
| 3 | Claude Fable 5.1 | 55.9% | high, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 4 | | 53.7% | xhigh, Finance Agent v2 | Oct 2026 | Official leaderboard |
| 5 | Legacy Samaya System | 52.9% | Official leaderboard | ||
| 6 | | 52.6% | Finance Agent v2 | Oct 2026 | Official leaderboard |
| 7 | Kimi K3.1 Pro | 51.7% | max, Finance Agent v2 | Oct 2026 | Official leaderboard |
| 8 | Claude Opus 5.5 | 50.9% | high, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 9 | | 50% | medium, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 10 | Claude Fable 5 | 49.2% | high, Finance Agent v2 | Jun 2026 | Official leaderboard |
| 11 | GPT-5.6 Sol | 46.8% | medium, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 12 | | 46.6% | Finance Agent v2 | Sep 2026 | Official leaderboard |
| 13 | Kimi K3 | 46.4% | max, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 14 | | 46.3% | medium, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 15 | Claude Opus 4.8 | 45% | high, Finance Agent v2 | May 2026 | Official leaderboard |
| 16 | GPT-5.5 | 43.5% | medium, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 17 | GLM-5.2 | 42.8% | max, Finance Agent v2 | Jun 2026 | Official leaderboard |
| 18 | | 40.5% | high, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 19 | Kimi K2.6 | 32.3% | on; level not supported, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 20 | | 30.7% | high, Web Search | Feb 2026 | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 66.4% | Sep 2026 | Lab model card | |
| 2 | Kimi K3.1 Pro | 58.6% | Oct 2026 | Lab model card | |
| 3 | Claude Fable 5.1 | 55.9% | high, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 4 | | 53.7% | xhigh, Finance Agent v2 | Oct 2026 | Official leaderboard |
| 5 | | 52.6% | Finance Agent v2 | Oct 2026 | Official leaderboard |
| 6 | Claude Opus 5.5 | 50.9% | high, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 7 | | 50% | medium, Finance Agent v2 | Sep 2026 | Official leaderboard |
| 8 | Claude Fable 5 | 49.2% | high, Finance Agent v2 | Jun 2026 | Official leaderboard |
| 9 | GPT-5.6 Sol | 46.8% | medium, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 10 | | 46.6% | Finance Agent v2 | Sep 2026 | Official leaderboard |
| 11 | Kimi K3 | 46.4% | max, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 12 | | 46.3% | medium, Finance Agent v2 | Jul 2026 | Official leaderboard |
| 13 | Claude Opus 4.8 | 45% | high, Finance Agent v2 | May 2026 | Official leaderboard |
| 14 | GPT-5.5 | 43.5% | medium, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 15 | GLM-5.2 | 42.8% | max, Finance Agent v2 | Jun 2026 | Official leaderboard |
| 16 | | 40.5% | high, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 17 | Kimi K2.6 | 32.3% | on; level not supported, Finance Agent v2 | Apr 2026 | Official leaderboard |
| 18 | | 30.7% | high, Web Search | Feb 2026 | Official leaderboard |
Labs report scores for 2 models in their cards. Switch the scores above to rank them together.
Score against latency per query
The page plots the overall rubrics qualification rate against the mean latency of one query, for the top systems in each harness. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Score | Avg. latency |
|---|---|---|---|
| Samaya Sterling | 58.9% | 282 s | |
| Legacy Samaya System (high effort) | 56% | 278 s | |
| Claude Fable 5.1 | high, Finance Agent v2 | 55.9% | 268 s |
| | xhigh, Finance Agent v2 | 53.7% | 234 s |
| Legacy Samaya System | 52.9% | 214 s | |
| | Finance Agent v2 | 52.6% | 292 s |
| Kimi K3.1 Pro | max, Finance Agent v2 | 51.7% | 449 s |
| Claude Opus 5.5 | high, Finance Agent v2 | 50.9% | 148 s |
| | medium, Finance Agent v2 | 50% | 247 s |
| Claude Fable 5 | high, Finance Agent v2 | 49.2% | 165 s |
| GPT-5.6 Sol | medium, Finance Agent v2 | 46.8% | 171 s |
| | Finance Agent v2 | 46.6% | 318 s |
| Kimi K3 | max, Finance Agent v2 | 46.4% | 336 s |
| | medium, Finance Agent v2 | 46.3% | 164 s |
| Claude Opus 4.8 | high, Finance Agent v2 | 45% | 156 s |
| GPT-5.5 | medium, Finance Agent v2 | 43.5% | 233 s |
| GLM-5.2 | max, Finance Agent v2 | 42.8% | 297 s |
| | high, Finance Agent v2 | 40.5% | 203 s |
| Claude Opus 4.8 | high, Web Search | 33% | 54 s |
| Kimi K2.6 | on; level not supported, Finance Agent v2 | 32.3% | 201 s |
| | high, Web Search | 30.7% | 91 s |
| | high, Finance Agent v2 | 30.5% | 222 s |
| GPT-5.5 | medium, Web Search | 20.7% | 192 s |
The best score, 55.9%, costs $6.89 a task
Runs on the cost frontier score higher than any run that's cheaper. Muse Spark Open at xhigh comes within 2.2 points of the best for $1.38 a task, 5 times cheaper. The costs are the leaderboard's own estimates, so compare them only within this benchmark.
Source: Official FrontierFinance leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Claude Fable 5.1 | high | Finance Agent v2 | 55.9% | $6.89 | |
| | xhigh | Finance Agent v2 | 53.7% | $1.38 | |
| | Finance Agent v2 | 52.6% | $3.35 | ||
| Kimi K3.1 Pro | max | Finance Agent v2 | 51.7% | $1.56 | |
| Claude Opus 5.5 | high | Finance Agent v2 | 50.9% | $1.87 | |
| | medium | Finance Agent v2 | 50% | $1.21 | |
| Claude Fable 5 | high | Finance Agent v2 | 49.2% | $4.06 | |
| GPT-5.6 Sol | medium | Finance Agent v2 | 46.8% | $3.03 | |
| | Finance Agent v2 | 46.6% | $0.05 | ||
| Kimi K3 | max | Finance Agent v2 | 46.4% | $0.90 | |
| | medium | Finance Agent v2 | 46.3% | $2.41 | |
| Claude Opus 4.8 | high | Finance Agent v2 | 45% | $2.61 | |
| GPT-5.5 | medium | Finance Agent v2 | 43.5% | $2.80 | |
| GLM-5.2 | max | Finance Agent v2 | 42.8% | $0.63 | |
| | high | Finance Agent v2 | 40.5% | $0.68 | |
| Claude Opus 4.8 | high | Web Search | 33% | $1.47 | |
| Kimi K2.6 | on; level not supported | Finance Agent v2 | 32.3% | $0.95 | |
| | high | Web Search | 30.7% | $0.24 | |
| | high | Finance Agent v2 | 30.5% | $1.72 | |
| GPT-5.5 | medium | Web Search | 20.7% | $0.55 |
2 models have held number one on the official leaderboard since its release in July 2026 3 models have held number one with claims included since its release in July 2026
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official FrontierFinance leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official FrontierFinance leaderboard and labs’ model cards
2 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Oct 24, 2026 | Kimi K3.1 Pro | 58.6 | Frontier Finance |
| Sep 20, 2026 | 66.4 | FrontierFinance |
One lab claim next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. Every benchmark.
| Model | Lab says | Board says | Gap |
|---|---|---|---|
| Kimi K3.1 Pro | 58.6% Frontier Finance | 51.7% Leaderboard, max, Finance Agent v2 | +6.9 pts |
More in Law, finance and medicine
- MedXpertQA-MM In use Models answer expert-level medical exam questions that combine images with clinical records and test results. Scoring is accuracy.
Qwen 3.8 Max 80.4%
- HealthBench Professional In use 525 physician-authored tasks from real clinician chats (care consult, documentation, research) with physician-adjudicated rubrics. Claude Sonnet 5.5 69.2%
- HealthBench In use 5,000 realistic health conversations graded against physician-written rubrics. A length-adjusted variant penalizes verbosity. GPT-5 67.2%
- FinSearchComp In use Agents search the web to fetch live financial data, look up history, and run multi-step investigations, across 635 expert-written questions. Scored by answer accuracy.
Ling-3.1-flash 81.7%
- KBL In use Models answer Korean legal knowledge and reasoning tasks and Korean bar exam questions. It has 7 knowledge tasks, 4 reasoning tasks and 2,510 bar exam items.
Solar Pro 4 77.5%
- KorMedMCQA In use Models answer 7,469 multiple-choice questions from Korean licensing exams for doctors, nurses, pharmacists and dentists, held from 2012 to 2024.
Solar Pro 4 93.2%