Past IMO (Seed-Prover formal set)
Provers write Lean proofs for 155 past IMO problems, mostly adapted from Compfiles and MiniF2F.
Seed curated this set for the Seed-Prover report.
- Made by
- ByteDance Seed
- Released
- July 2025
- Kind
- Formal proofs
- Level
- Competition
- Scored
- Checked automatically
- Answers
- Written proof
- Tasks
- Kept private
- Last in a launch post
- July 2025, dropped before it saturated
- Last model added
- July 2025
- Scores refreshed
- November 12th, 2026
Seed-Prover leads with 78.1%
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
Seed-Prover leads with 79% across all independent runs
Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.
- 1
Seed-Prover 78.1%
Source: Labs’ model cards
Source: Official Past IMO (Seed-Prover formal set) leaderboard
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Seed-Prover | 78.1% | Jul 2025 | Lab model card |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Seed-Prover | 79% | Heavy, Seed Prover multi-agent inference | Jul 2025 | Official leaderboard |
The benchmark's own leaderboard has 1 model. Switch the scores above to rank them together.
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official Past IMO (Seed-Prover formal set) leaderboard and labs’ model cards
No launch post has listed it since July 2025
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Jul 31, 2025 | Seed-Prover | 78.1 | Past IMO (Heavy), 155 problems |
One lab claim next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. Every benchmark.
| Model | Lab says | Board says | Gap |
|---|---|---|---|
| Seed-Prover | 78.1% Past IMO (Heavy), 155 problems | 79% Leaderboard, Heavy, Seed Prover multi-agent inference | −0.9 pts |
More in Math
- AIME 2026 In use Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. GPT-5.5 100%
- IMO-AnswerBench In use 400 olympiad problems with short verifiable answers, robustified against memorization. Scored by answer match. GLM-5.2 91%
- HMMT 2026 In use Models solve the 33 final-answer problems from the February 2026 Harvard-MIT Mathematics Tournament. Scored by exact answer match. GPT-5.5 98.5%
- PolyMath In use Models solve 9,000 parallel math problems in 18 languages across four difficulty levels, from school math to frontier math. Final answers are checked.
Qwen3.7-Max 86.5% - MathArena (Apex, IMO, USAMO) In use Evaluates models on newly released math competitions after release. Final-answer or human/LLM-judged proof scores. Claude Opus 4.8 81.3%
- MathArena Apex Shortlist In use Models solve 47 hard final-answer problems that MathArena selected from 2025 competitions, where the best models scored about 50% at selection. Scored by accuracy over repeated attempts. GPT-5.5 98.4%