Benchmark Almanac

Artificial Analysis Intelligence Index v5

In use

Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness.

Released 27 October 2026. Knowledge Work: AA-Briefcase v1.1 15%, AutomationBench-AA 5%, GDP.pdf 5%. Coding: FrontierCode 2.0 15%, Terminal-Bench 4.0 10%. Science: Terminal-Bench-Science 15%, CritPt v2 hard subset 10%. General: AA-Omniscience v1.1 15% (accuracy 10%, non-hallucination 5%), HLE-Diamond 10%. Dropped GDPval-AA, SciCode, AA-LCR and Humanity's Last Exam. Earlier versions have their own records. Scores do not compare across versions. The almanac imports no Artificial Analysis data: its scores here are what labs quote.

Released
October 2026
Kind
Composite indices
Scored
Checked automatically
Answers
Agent task
Strongest model tested
Gemini 4 Carbon #2 on the capability index
Last in a launch post
November 2026
Last model added
November 2026
2
Models scored in lab cards
2
Launch posts list it, from 2 labs

Gemini 4 Carbon leads with 59.0

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

  1. 1 Gemini 4 Carbon 59.0
  2. 2 Inkling 2 Small 30.6

Source: Labs’ model cards

#ModelScoreSettingDateSource
1 Gemini 4 Carbon 59.0 Oct 2026 Lab model card
2 Inkling 2 Small 30.6 Nov 2026 Lab model card

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card
30 40 50 60 2027 30 40 50 60 2027

Source: Labs’ model cards

2 labs put it in a launch post in the last six months

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Google DeepMind
Thinking Machines
DateLaunch postScoreAs the post writes it
Nov 5, 2026 Inkling 2 Small 30.6 AA Index (v5.0)
Oct 28, 2026 Gemini 4 Carbon 59 AA Index v5.0

Versions

More in Other

All 43 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. sonar 42%
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output. Nemotron 3 Ultra 5.15
  • Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports. Qwen2-72B 72.9%