Benchmark Almanac

AGI Score (A Definition of AGI)

Not in model cards

Experts test models on ten cognitive domains from Cattell-Horn-Carroll theory, such as reasoning, memory and perception, with adapted human psychometric tests. Each domain counts 10% toward a score out of 100%.

The paper scores GPT-4 at 27% and GPT-5 at 57%. Long-term memory storage was the weakest domain. The CAIS dashboard shows the score under Automation.

Released
October 2025
Kind
Composite indices
Level
Expert
Scored
Graded by people
Answers
Open-ended
Strongest model tested
GPT-5 #70 on the capability index
Last model added
August 2025
Scores refreshed
November 12th, 2026

In the authors’ words

The lack of a concrete definition for Artificial General Intelligence (AGI) obscures the gap between today's specialized AI and human-level cognition. This paper introduces a quantifiable framework to address this, defining AGI as matching the cognitive versatility and proficiency of a well-educated adult. To operationalize this, we ground our methodology in Cattell-Horn-Carroll theory, the most empirically validated model of human cognition. The framework dissects general intelligence into ten core cognitive domains-including reasoning, memory, and perception-and adapts established human psychometric batteries to evaluate AI systems. Application of this framework reveals a highly "jagged" cognitive profile in contemporary models. While proficient in knowledge-intensive domains, current AI systems have critical deficits in foundational cognitive machinery, particularly long-term memory storage. The resulting AGI scores (e.g., GPT-4 at 27%, GPT-5 at 57%) concretely quantify both rapid progress and the substantial gap remaining before AGI.

Abstract of A Definition of AGI (arXiv:2510.18212, CC0)
2
Entries on its own leaderboard, 1 model we track

GPT-5 leads with 57%

Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

  1. 1 GPT-5 57%
  2. 2 GPT-4 (snapshot unspecified) 27%

Source: Official AGI Score (A Definition of AGI) leaderboard

#EntryScoreSettingDateSource
1 GPT-5 57% Aug 2025 Official leaderboard
2 GPT-4 (snapshot unspecified) 27% Official leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard
0% 20% 40% 60% 80% 100% Near the ceiling (85%) GPT-5 0% 20% 40% 60% 80% 100% Near the ceiling (85%) GPT-5

Source: Official AGI Score (A Definition of AGI) leaderboard

No lab model card reports it yet

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.

More in Other

All 43 in Other
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Gemini 4 Carbon 59.0
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. sonar 42%
  • Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
  • SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output. Nemotron 3 Ultra 5.15