Artificial Analysis Intelligence Index v2
Artificial Analysis's index of seven public reasoning, knowledge, math and coding benchmarks, each run by Artificial Analysis.
In use from 11 February to 4 August 2025. Components: MMLU-Pro, GPQA Diamond, Humanity's Last Exam, LiveCodeBench, SciCode, AIME 2024 and MATH-500. Z.ai's GLM-4.5 reports print an estimate over these seven.
- Made by
- Artificial Analysis
- Released
- February 2025
- Kind
- Composite indices
- Scored
- Checked automatically
- Answers
- Agent task
- Last in a launch post
- July 2025, dropped before it saturated
- Last model added
- August 2025
GLM-4.5 leads with 67.7
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
- 1 GLM-4.5 67.7
- 2 GLM-4.5-Air 64.8
Source: Labs’ model cards
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GLM-4.5 | 67.7 | Aug 2025 | Lab model card | |
| 2 | GLM-4.5-Air | 64.8 | Aug 2025 | Lab model card |
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Labs’ model cards
No launch post has listed it since July 2025
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Jul 28, 2025 | GLM-4.5 | 67.7 | AA-Index (Estimated) |
2 system cards report it, from 1 lab
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Aug 8, 2025 | GLM-4.5 technical report | 67.7 | AA-Index (Est.), Z.ai estimate over the seven reasoning benchmarks (Table 4) | Capabilities |
| Aug 8, 2025 | GLM-4.5-Air technical report | 64.8 | AA-Index (Est.), Z.ai estimate over the seven reasoning benchmarks (Table 4) | Capabilities |
Versions
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
sonar 42% - Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output.
Nemotron 3 Ultra 5.15 - Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports.
Qwen2-72B 72.9%