Benchmark Almanac

Artificial Analysis Intelligence Index v3

Dropped

Version 3 of Artificial Analysis's index, ten evaluations that added agentic terminal and tool-use tasks to the knowledge, math and coding tests.

In use from 2 September to December 2025. Components: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, AIME 2025, SciCode, LiveCodeBench, IFBench, AA-LCR, Terminal-Bench Hard and τ²-Bench Telecom. Top models scored about 73.

Released
September 2025
Kind
Composite indices
Scored
Checked automatically
Answers
Agent task
Last in a launch post
October 2025, dropped for a newer version
Last model added
October 2025
1
Model scored in lab cards
2
Launch posts list it, from 2 labs

MiniMax-M2 leads with 61.0

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

  1. 1 MiniMax-M2 61.0

Source: Labs’ model cards

#ModelScoreSettingDateSource
1 MiniMax-M2 61.0 Oct 2025 Lab model card

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card
61 2026 61 2026

Source: Labs’ model cards

Labs moved on to Artificial Analysis Intelligence Index v4.0

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Google DeepMind
MiniMax
DateLaunch postScoreAs the post writes it
Oct 27, 2025 MiniMax-M2 61 AA Intelligence
Sep 25, 2025 Gemini 2.5 Flash Artificial Analysis Intelligence Index (scatter chart, no printed value)

Versions

More in Other

All 43 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. sonar 42%
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output. Nemotron 3 Ultra 5.15
  • Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports. Qwen2-72B 72.9%