Benchmark Almanac

Artificial Analysis Intelligence Index v1

Not in model cards

Artificial Analysis's first composite score, called the Quality Index in 2024, which normalized and combined a few public benchmarks into one number.

Versions 1.0 to 1.3 ran from January 2024 to 10 February 2025. In October 2024 it combined Chatbot Arena Elo, MMLU and MT-Bench. Artificial Analysis advised against citing its values directly.

Released
January 2024
Kind
Composite indices
Scored
Checked automatically
Answers
Agent task

No scores here yet

No lab, leaderboard or Epoch AI run has reported a score for Artificial Analysis Intelligence Index v1 yet.

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

Versions

More in Other

All 43 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. sonar 42%
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output. Nemotron 3 Ultra 5.15
  • Qwen in-house English automatic evaluation Only in system cards Models answer Qwen in-house English datasets on knowledge, comprehension, coding, math and related skills. Skills and weights change between reports. Qwen2-72B 72.9%