GDPval-AA
Agents complete GDPval occupational tasks. Artificial Analysis compares the outputs in pairs and ranks models by Elo.
Versions 2 and 2.1 changed the task set, so their Elo scores have their own records.
- Made by
- Artificial Analysis
- Released
- December 2025
- Kind
- Tasks from real jobs
- Level
- Expert
- Scored
- Graded by a model
- Answers
- Open-ended
- Tasks
- All public
- Strongest model tested
- Claude Fable 5 #11 on the capability index
- Last in a launch post
- June 2026, dropped for a newer version
- Last model added
- June 2026
Claude Fable 5 leads with 1,932 among models released by June 2026
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
The newest model with a score here came out in June 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- Claude Opus 5.5
- and 15 more
- 1,932 Claude Fable 5
- 1,890 Claude Opus 4.8
- 1,753 Claude Opus 4.7
- 1,656
Gemini 3.5 Flash
- 1,633 Claude Sonnet 4.6
- 1,606 Claude Opus 4.6
- 1,581 MiMo-V2.5-Pro
- 1,554
DeepSeek-V4-Pro
- 1,495
MiniMax-M2.7
- 1,444
Muse Spark
- 1,426 MiMo-V2-Pro
- 1,416
Step 3.7 Flash
- 1,410 MiMo-V2-Omni
- 1,409 GLM-5
- 1,395
DeepSeek-V4-Flash
- 1,317
Gemini 3.1 Pro
Bars start at 1,200.
- 1 Claude Fable 5 1,932
- 2 Claude Opus 4.8 1,890
- 3 Claude Opus 4.7 1,753
- 4
Gemini 3.5 Flash 1,656
- 5 Claude Sonnet 4.6 1,633
- 6 Claude Opus 4.6 1,606
- 7 MiMo-V2.5-Pro 1,581
- 8
DeepSeek-V4-Pro 1,554
- 9
MiniMax-M2.7 1,495
- 10
Muse Spark 1,444
- 11 MiMo-V2-Pro 1,426
- 12
Step 3.7 Flash 1,416
- 13 MiMo-V2-Omni 1,410
- 14 GLM-5 1,409
- 15
DeepSeek-V4-Flash 1,395
- 16
Gemini 3.1 Pro 1,317
Source: Labs’ model cards
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Claude Fable 5 | 1,932 | Jun 2026 | Lab model card | |
| 2 | Claude Opus 4.8 | 1,890 | May 2026 | Lab model card | |
| 3 | Claude Opus 4.7 | 1,753 | Apr 2026 | Lab model card | |
| 4 | | 1,656 | May 2026 | Lab model card | |
| 5 | Claude Sonnet 4.6 | 1,633 | Feb 2026 | Lab model card | |
| 6 | Claude Opus 4.6 | 1,606 | Feb 2026 | Lab model card | |
| 7 | MiMo-V2.5-Pro | 1,581 | Apr 2026 | Lab model card | |
| 8 | | 1,554 | Apr 2026 | Lab model card | |
| 9 | | 1,495 | Mar 2026 | Lab model card | |
| 10 | | 1,444 | Apr 2026 | Lab model card | |
| 11 | MiMo-V2-Pro | 1,426 | Mar 2026 | Lab model card | |
| 12 | | 1,416 | May 2026 | Lab model card | |
| 13 | MiMo-V2-Omni | 1,410 | Mar 2026 | Lab model card | |
| 14 | GLM-5 | 1,409 | Feb 2026 | Lab model card | |
| 15 | | 1,395 | Apr 2026 | Lab model card | |
| 16 | | 1,317 | Feb 2026 | Lab model card |
5 models have held number one in labs’ own numbers since its release in December 2025
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Labs’ model cards
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Labs’ model cards
Labs headline it less often now, last in June 2026
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Jun 9, 2026 | Claude Fable 5 | 1932 | Knowledge work GDPval-AA |
| May 29, 2026 | 1415.8 | GDPval-Stirrup 1415.8 (ii 45.8%) | |
| May 28, 2026 | Claude Opus 4.8 | 1890 | Knowledge work GDPval-AA |
| May 19, 2026 | 1656 | GDPval-AA (Elo) | |
| Apr 27, 2026 | MiMo-V2.5-Pro | 1581 | GDPVal-AA (Elo) |
| Apr 24, 2026 | 1395 | GDPval-AA (Elo), V4-Flash Max | |
| Apr 24, 2026 | 1554 | GDPval-AA (Elo) | |
| Apr 20, 2026 | 51 | GDPval-AA Real-World Valuable Task (51.0, scale not stated) | |
| Apr 8, 2026 | 1444 | GDPval-AA Elo (Office Tasks (Artificial Analysis)) | |
| Mar 18, 2026 | MiMo-V2-Omni | 1410 | GDPVal (Elo) |
| Mar 18, 2026 | MiMo-V2-Pro | 1426 | GDPVal-AA |
| Mar 18, 2026 | 1495 | GDPval-AA (ELO score, text) | |
| Feb 19, 2026 | 1317 | GDPval-AA Elo | |
| Feb 17, 2026 | Claude Sonnet 4.6 | 1633 | Office tasks GDPval-AA Elo |
| Feb 5, 2026 | Claude Opus 4.6 | 1606 | Office tasks GDPVal-AA Elo |
14 system cards report it, from 6 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Jun 9, 2026 | Claude Fable 5 system card | 1932 | GDPval-AA Elo as of June 6, 2026, no version named, run by Artificial Analysis, about 42 Elo ahead of Opus 4.8 (56% pairwise win rate) (Table 8.1.A, 8.17.7) | Capabilities |
| May 28, 2026 | Claude Opus 4.8 system card | 1890 | GDPval-AA Elo, run by Artificial Analysis (Table 8.1.A, 8.13.6) | Capabilities |
| May 26, 2026 | | 34 | GDPval-AA, MiniMax-M2 bar, printed label (Figure 9) | Capabilities |
| May 26, 2026 | | 50 | GDPval-AA, Artificial Analysis re-evaluation, score as printed (metric not stated) (Table 4) | Capabilities |
| May 26, 2026 | | 35 | GDPval-AA, Artificial Analysis re-evaluation, score as printed (metric not stated) (Table 4) | Capabilities |
| May 19, 2026 | | 1656 | GDPval-AA, Elo (results table, p.4) | Capabilities |
| Apr 26, 2026 | | 1554 | GDPval-AA (Elo), DS-V4-Pro Max (Table 6) | Capabilities |
| Apr 26, 2026 | | 1395 | GDPval-AA (Elo), DeepSeek-V4-Flash Max (Table 7) | Capabilities |
| Apr 16, 2026 | Claude Opus 4.7 system card | 1753 | GDPval-AA Elo, run by Artificial Analysis, printed on chart (8.10.5, Figure 8.10.5.A) | Capabilities |
| Feb 19, 2026 | | 1317 | GDPval-AA Elo (results table, p.4) | Capabilities |
| Feb 17, 2026 | GLM-5 technical report | 1409 | GDPval-AA Elo, recorded 15 Feb 2026 (Table 7) | Capabilities |
| Feb 17, 2026 | Claude Sonnet 4.6 system card | 1633 | GDPval-AA Elo, run by Artificial Analysis (Table 2.1.A, 2.8) | Capabilities |
| Feb 5, 2026 | Claude Opus 4.6 system card | 1606 | GDPval-AA Elo, run independently by Artificial Analysis, value printed on chart (Figure 2.10.A) | Capabilities |
| Jan 30, 2026 | Kimi K2.5 technical report | 41 | GDPVal-AA, Artificial Analysis leaderboard metric as of 2026-01-28 (Table 4, E.9) | Capabilities |
Versions
More in Economic work
- JobBench In use 130 tasks from 35 occupations workers most want delegated. Agent works through messy reference files, graded by fact-anchored binary rubrics. GLM-5.3 61.4%
- GDPval In use Real work tasks from 44 occupations with reference files. Experts blindly compare model deliverables with expert work. Metric is win-or-tie rate.
Seed2.1 Pro 87.9%
- AA-Briefcase v1.1 In use Version 1.1 of Artificial Analysis's multi-hour office work evaluation, with Elo ratings fitted by Crowd-BT. Claude Opus 5.5 1,822
- CoWorkBench In use Agent completes long-horizon productivity tasks across computer science, finance, law and medicine. Qwen in-house scoring (method unpublished). Claude Fable 5 75.9%
- OfficeQA In use Grounded reasoning over a large corpus of U.S. Treasury Bulletin documents: locate tables and compute precise numeric answers. Claude Opus 4.7 86.3%
- SpreadsheetBench In use Real spreadsheet manipulation questions from Excel forums. Output workbook is checked cell-by-cell against reference solutions.
MiniMax-M3 89.3%