How do new models get tested?
Labs named a median of 29 benchmarks for each frontier model of the past year, and others scored the same models on a median of 387. Only 14% of what labs name has an independent run of the same model.
How much of a launch post can anyone check?
Of the benchmarks labs named in launch posts since 2024, an official leaderboard or Epoch AI has scored the same model on 14%, about the same share each year. For another 63%, someone scores the benchmark but hasn't run that model. OpenAI's posts are the easiest to check, at 32%, and Qwen's the hardest of the frontier labs, at 9%.
- OpenAI 32%746
- xAI 30%152
- Moonshot AI 26%300
- Anthropic 25%705
-
Google DeepMind 21%778
-
DeepSeek 19%362
- Z.ai 18%348
-
Meta 16%316
-
Qwen 9%1,645
- Other labs 6%4,060
Sources: Labs’ launch posts, read by Benchmark Almanac, official leaderboards and Epoch AI (CC BY 4.0)
What do others test beyond the launch post?
The 38 frontier models released since November 21st, 2025 have independent scores on a median of 387 benchmarks, about 13 times the 29 in their launch posts. The two lists share a median of ten. Gemini 3.1 Pro has the most independent scores, 719.
- GPT-6.2 Astra 29137
- Claude Fable 5.2 33210
-
Gemini 4 Carbon 16210
- GPT-6.1 Terra 9210
-
Gemini 4 Argon 27445
- GPT-6.1 Sol 9522
- Claude Sonnet 5.5 36449
- Claude Opus 5.5 38648
- GPT-6 Sol 9334
- GPT-6 Astra 33686
-
Gemini 3.8 Flash 13547
- Claude Fable 5.1 37446
-
Gemini 3.7 Flash 18298
- Claude Opus 5 47554
- Kimi K3 66556
- GPT-5.6 Sol 33643
- GPT-5.6 Terra 32356
- Claude Sonnet 5 40405
- Claude Fable 5 30336
- Claude Opus 4.8 48513
-
Qwen3.7-Max 40163
-
Gemini 3.5 Flash 13349
- GPT-5.5 28594
- GPT-5.5 Pro 835
- Claude Opus 4.7 48385
-
Muse Spark 2947
- Grok 4.20 4184
- GPT-5.4 29491
- GPT-5.4 Pro 1132
-
Gemini 3.1 Pro 16719
- Claude Sonnet 4.6 40427
- Claude Opus 4.6 42463
- Kimi K2.5 48305
-
Gemini 3 Flash 21388
- GPT-5.2 19417
- GPT-5.2 Pro 937
-
DeepSeek-V3.2 23269
- Claude Opus 4.5 32325
Sources: Labs’ launch posts, read by Benchmark Almanac, official leaderboards and Epoch AI (CC BY 4.0)
How long does a model stay at the frontier?
Since 2024, a model that came in at number one on Epoch AI's Capabilities Index stayed in the top ten for a median of 203 days, about seven months. One that came in second to fifth stayed 117 days, and one that came in lower, 35.
Epoch Capabilities Index, Epoch AI (CC BY 4.0)
How this is counted
A launch post counts with the system cards, model cards and technical reports published with it, as on What labs report. A benchmark counts once per release, and versions stay apart, so SWE-bench Verified and SWE-bench Pro are two benchmarks. Safety, alignment, bio and cyber evaluations are left out, since few labs publish them and few boards run them.
An independent score is one from a benchmark's official leaderboard, from Epoch AI's own runs, or from another board Epoch AI copied. It has to be the model itself. An agent someone else built around the model doesn't count. We read 4,766 leaderboards but not every one, and from Artificial Analysis we read only its index numbers. A benchmark that only boards we don't read have run counts as having no independent score.
The frontier labs are the nine that the reporting page follows. Other labs are grouped. A frontier model is one in the top ten on Epoch AI's Capabilities Index among the models out the day its launch post came out.
A model stays in the top ten until ten models released after it score higher on the index, counted by release date, so a model scored later still counts from the day it came out. Models still in the top ten haven't left yet, so each line is a survival estimate, and a line stops when fewer than five models are left to follow. Of the nine models that came in at number one in 2026, five are still in the top ten.
More insights
-
What labs report
In the first half of 2024, 34% of the benchmarks labs named had come out in the year before the release. In the second half of 2026 so far, 63% had.
-
How are evals changing?
Agent tasks made up 6% of the new benchmarks in 2023 and 48% in 2026. Multiple-choice tests fell from 24% to 5%.
-
How fast is the frontier moving?
The best open model today, Kimi K3.1 Pro, scores what the best closed model scored seven months ago. Since 2024 the median gap has been six months.