Benchmark Almanac

CAIS Vision Capabilities Index

Gemini 4 Argon 83.3 leads since September 2026
Not in model cards

Averages model scores on five vision tests run by the Center for AI Safety: ERQA, MindCube, SpatialViz-Bench, IntPhys 2 and EnigmaEval.

One of three CAIS dashboard indexes, next to the Text Capabilities Index and the Risk Index. CAIS announced the dashboard in AI Safety Newsletter 66 on December 2nd, 2025. 52 models had scores on October 23rd, 2026.

Released
December 2025
Kind
Composite indices
Level
Research frontier
Scored
Checked automatically
Answers
Short answer
Tasks
All public
Strongest model tested
GPT-6 Astra #3 on the capability index
Last model added
October 2026
Scores refreshed
November 12th, 2026
53
Models scored on its own leaderboard

Gemini 4 Argon leads with 83.3

Best score per model from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best.

  1. 1 Gemini 4 Argon high 83.3
  2. 2 GPT-6 Astra high 83.0
  3. 3 GPT-6.1 Sol high 77.9
  4. 4 Claude Opus 5.5 high 76.8
  5. 5 Muse Wonder high 71.2
  6. 6 Gemini 3.8 Flash high 69.9
  7. 7 Claude Fable 5.1 high 68.9
  8. 8 Gemini 3.7 Flash high 68.7
  9. 9 Claude Opus 5 high 68.0
  10. 10 Claude Fable 5 high 66.6
  11. 11 GPT-5.6 Sol high 66.4
  12. 12 Gemini 3.5 Flash 64.6
  13. 13 GPT-5.5 high 64.3
  14. 14 Gemini 3.1 Pro high 62.1
  15. 15 Kimi K3 high 60.6
  16. 16 Muse Spark 1.1 high 60.1
  17. 17 Muse Spark Open high 59.4
  18. 18 Gemini 3 Flash high 59.3
  19. 19 GPT-5.4 high 57.7
  20. 20 Gemini 3 Pro high 57.1
  21. 21 Grok 4.5 56.2
  22. 22 Kimi K2.6 55.3
  23. 23 GPT-5.6 Terra high 55.1
  24. 24 GPT-5.6 Luna high 53.7
  25. 25 Claude Opus 4.8 high 53.0
  26. 26 GPT-5.2 high 52.2
  27. 27 Claude Opus 4.7 51.2
  28. 28 Grok 4.20 48.5
  29. 29 Grok 4.3 48.4
  30. 30 GPT-5 high 47.8
  31. 31 Claude Opus 4.6 47.7
  32. 32 GPT-5 mini high 47.5
  33. 33 GPT-5.1 high 47.4
  34. 34 GPT-5.4 Mini high 46.6
  35. 35 o3 high 46.5
  36. 36 Claude Sonnet 4.6 46.3
  37. 37 Gemini 2.5 Pro Jun 2025, high 45.7
  38. 38 Claude Opus 4.5 thinking 45.4
  39. 39 Gemini 3.1 Flash-Lite high 44.7
  40. 40 Grok 4 42.5
  41. 41 Claude Sonnet 4.5 thinking 42.1
  42. 42 Gemini 2.5 Flash Jun 2025, high 41.1
  43. 43 o1 40.9
  44. 44 Grok 4.1 Fast 39.5
  45. 45 GPT-5.4 Nano high 38.9
  46. 46 Gemini 2.5 Flash-Lite Jun 2025, high 38.1
  47. 47 Grok 4 Fast 37.7
  48. 48 Claude Haiku 4.5 thinking 37.5
  49. 49 o4-mini high 36.8
  50. 50 GPT-4o Nov 2024 36.0
  51. 51 GPT-5 nano high 34.3
  52. 52 Claude 3.7 Sonnet thinking 33.9
  53. 53 Claude Sonnet 4 thinking 26.4

Source: Official CAIS Vision Capabilities Index leaderboard

#ModelScoreSettingDateSource
1 Gemini 4 Argon 83.3 high Sep 2026 Official leaderboard
2 GPT-6 Astra 83.0 high Sep 2026 Official leaderboard
3 GPT-6.1 Sol 77.9 high Sep 2026 Official leaderboard
4 Claude Opus 5.5 76.8 high Sep 2026 Official leaderboard
5 Muse Wonder 71.2 high Oct 2026 Official leaderboard
6 Gemini 3.8 Flash 69.9 high Sep 2026 Official leaderboard
7 Claude Fable 5.1 68.9 high Sep 2026 Official leaderboard
8 Gemini 3.7 Flash 68.7 high Aug 2026 Official leaderboard
9 Claude Opus 5 68.0 high Jul 2026 Official leaderboard
10 Claude Fable 5 66.6 high Jun 2026 Official leaderboard
11 GPT-5.6 Sol 66.4 high Jul 2026 Official leaderboard
12 Gemini 3.5 Flash 64.6 May 2026 Official leaderboard
13 GPT-5.5 64.3 high Apr 2026 Official leaderboard
14 Gemini 3.1 Pro 62.1 high Feb 2026 Official leaderboard
15 Kimi K3 60.6 high Jul 2026 Official leaderboard
16 Muse Spark 1.1 60.1 high Jul 2026 Official leaderboard
17 Muse Spark Open 59.4 high Oct 2026 Official leaderboard
18 Gemini 3 Flash 59.3 high Dec 2025 Official leaderboard
19 GPT-5.4 57.7 high Mar 2026 Official leaderboard
20 Gemini 3 Pro 57.1 high Nov 2025 Official leaderboard
21 Grok 4.5 56.2 Jul 2026 Official leaderboard
22 Kimi K2.6 55.3 Apr 2026 Official leaderboard
23 GPT-5.6 Terra 55.1 high Jul 2026 Official leaderboard
24 GPT-5.6 Luna 53.7 high Jul 2026 Official leaderboard
25 Claude Opus 4.8 53.0 high May 2026 Official leaderboard
26 GPT-5.2 52.2 high Dec 2025 Official leaderboard
27 Claude Opus 4.7 51.2 Apr 2026 Official leaderboard
28 Grok 4.20 48.5 Feb 2026 Official leaderboard
29 Grok 4.3 48.4 Apr 2026 Official leaderboard
30 GPT-5 47.8 high Aug 2025 Official leaderboard
31 Claude Opus 4.6 47.7 Feb 2026 Official leaderboard
32 GPT-5 mini 47.5 high Aug 2025 Official leaderboard
33 GPT-5.1 47.4 high Nov 2025 Official leaderboard
34 GPT-5.4 Mini 46.6 high Mar 2026 Official leaderboard
35 o3 46.5 high Apr 2025 Official leaderboard
36 Claude Sonnet 4.6 46.3 Feb 2026 Official leaderboard
37 Gemini 2.5 Pro Jun 2025 45.7 high Jun 2025 Official leaderboard
38 Claude Opus 4.5 45.4 thinking Nov 2025 Official leaderboard
39 Gemini 3.1 Flash-Lite 44.7 high Mar 2026 Official leaderboard
40 Grok 4 42.5 Jul 2025 Official leaderboard
41 Claude Sonnet 4.5 42.1 thinking Sep 2025 Official leaderboard
42 Gemini 2.5 Flash Jun 2025 41.1 high Jun 2025 Official leaderboard
43 o1 40.9 Dec 2024 Official leaderboard
44 Grok 4.1 Fast 39.5 Nov 2025 Official leaderboard
45 GPT-5.4 Nano 38.9 high Mar 2026 Official leaderboard
46 Gemini 2.5 Flash-Lite Jun 2025 38.1 high Jun 2025 Official leaderboard
47 Grok 4 Fast 37.7 Sep 2025 Official leaderboard
48 Claude Haiku 4.5 37.5 thinking Oct 2025 Official leaderboard
49 o4-mini 36.8 high Apr 2025 Official leaderboard
50 GPT-4o Nov 2024 36.0 Nov 2024 Official leaderboard
51 GPT-5 nano 34.3 high Aug 2025 Official leaderboard
52 Claude 3.7 Sonnet 33.9 thinking Feb 2025 Official leaderboard
53 Claude Sonnet 4 26.4 thinking May 2025 Official leaderboard

12 models have held number one on the official leaderboard since its release in December 2025

Lab claims count from the day the card came out, independent runs from the model’s release.

Google DeepMind OpenAI Anthropic
Own leaderboard 12 leaders

Source: Official CAIS Vision Capabilities Index leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard
20.0 40.0 60.0 80.0 100.0 2025 2026 20.0 40.0 60.0 80.0 100.0 2025 2026

Source: Official CAIS Vision Capabilities Index leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Other

All 43 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Gemini 4 Carbon 59.0
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. sonar 42%
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output. Nemotron 3 Ultra 5.15