Benchmark Almanac

Mathematical Association of America

We track 15 benchmarks that Mathematical Association of America made or helped make.

3 in use 4 with public code 8 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AIME 2025 Models answer the 30 problems from the 2025 AIME I and II exams. Each answer is an integer from 0 to 999, scored by match. Competition problems with answers Feb 2025 100% In use
AIME 2024 Models solve the 30 problems of the 2024 AIME I and II. Answers are integers from 0 to 999, scored by exact match. Competition problems with answers Feb 2024 96.6% Fading
AIME 2026 Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. Competition problems with answers Feb 2026 100% In use
USAMO 2026 Models write full proofs for the six problems of the 2026 USA Mathematical Olympiad. Judges grade each proof from 0 to 7 against rubrics. Written proofs Mar 2026 98.2% In use
Putnam 2025 Models solve the 12 problems of the 2025 William Lowell Putnam competition with full proofs. Scored out of 120 points. Written proofs Dec 2025 120.0 Fading
AMC Models solve problems from the AMC 8, 10, and 12 competitions. Gemini 1.5 used 250 problems from 2022 and 2023, scored by accuracy. Competition problems with answers Feb 2024 69.4% Fading
AMC 10 2023 Models take the 2023 AMC 10 A and B exams. Scored out of 150 points. Competition problems with answers Nov 2023 72.0 System cards only
AMC 12 2023 Models take the 2023 AMC 12 A and B exams. Scored out of 150 points. Competition problems with answers Nov 2023 63.0 System cards only
AMC 8 2023 Models take the 25 question 2023 AMC 8 exam. Scored out of 150 points. Competition problems with answers Jan 2023 84.0 System cards only
Putnam 2024 Models write full proofs for the 12 problems of the December 2024 William Lowell Putnam competition. Proofs are graded out of 120 points. Written proofs Dec 2024 98.3% Dropped
AMC 10 2022 Models take a 2022 AMC 10 exam. Scored out of 150 points. Competition problems with answers Nov 2022 30.0 System cards only
AMC 10/12 (November 2024) Models take the four November 2024 AMC 10 and 12 contests, 78 questions in all. Scored in contest points out of 150, averaged over tests. Competition problems with answers Nov 2024 91.8 System cards only
AMC 12 2022 Models take a 2022 AMC 12 exam. Scored out of 150 points. Competition problems with answers Nov 2022 60.0 System cards only
AMC 12 2024 Models answer the 25 multiple-choice problems of the 2024 AMC 12 contests. Scored on the official 150-point scale. Competition problems with answers Nov 2024 143.7 System cards only
AIME 2023 Models solve the 30 problems of the 2023 AIME I and II. Answers are integers from 0 to 999, scored by exact match. Competition problems with answers Feb 2023 Not in cards