Mathematical Association of America
We track 15 benchmarks that Mathematical Association of America made or helped make.
3 in use 4 with public code 8 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| AIME 2025 Models answer the 30 problems from the 2025 AIME I and II exams. Each answer is an integer from 0 to 999, scored by match. | Competition problems with answers | Feb 2025 | 100% | In use |
| AIME 2024 Models solve the 30 problems of the 2024 AIME I and II. Answers are integers from 0 to 999, scored by exact match. | Competition problems with answers | Feb 2024 | 96.6% | Fading |
| AIME 2026 Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. | Competition problems with answers | Feb 2026 | 100% | In use |
| USAMO 2026 Models write full proofs for the six problems of the 2026 USA Mathematical Olympiad. Judges grade each proof from 0 to 7 against rubrics. | Written proofs | Mar 2026 | 98.2% | In use |
| Putnam 2025 Models solve the 12 problems of the 2025 William Lowell Putnam competition with full proofs. Scored out of 120 points. | Written proofs | Dec 2025 | | Fading |
| AMC Models solve problems from the AMC 8, 10, and 12 competitions. Gemini 1.5 used 250 problems from 2022 and 2023, scored by accuracy. | Competition problems with answers | Feb 2024 | | Fading |
| AMC 10 2023 Models take the 2023 AMC 10 A and B exams. Scored out of 150 points. | Competition problems with answers | Nov 2023 | 72.0 | System cards only |
| AMC 12 2023 Models take the 2023 AMC 12 A and B exams. Scored out of 150 points. | Competition problems with answers | Nov 2023 | 63.0 | System cards only |
| AMC 8 2023 Models take the 25 question 2023 AMC 8 exam. Scored out of 150 points. | Competition problems with answers | Jan 2023 | 84.0 | System cards only |
| Putnam 2024 Models write full proofs for the 12 problems of the December 2024 William Lowell Putnam competition. Proofs are graded out of 120 points. | Written proofs | Dec 2024 | | Dropped |
| AMC 10 2022 Models take a 2022 AMC 10 exam. Scored out of 150 points. | Competition problems with answers | Nov 2022 | 30.0 | System cards only |
| AMC 10/12 (November 2024) Models take the four November 2024 AMC 10 and 12 contests, 78 questions in all. Scored in contest points out of 150, averaged over tests. | Competition problems with answers | Nov 2024 | | System cards only |
| AMC 12 2022 Models take a 2022 AMC 12 exam. Scored out of 150 points. | Competition problems with answers | Nov 2022 | 60.0 | System cards only |
| AMC 12 2024 Models answer the 25 multiple-choice problems of the 2024 AMC 12 contests. Scored on the official 150-point scale. | Competition problems with answers | Nov 2024 | | System cards only |
| AIME 2023 Models solve the 30 problems of the 2023 AIME I and II. Answers are integers from 0 to 999, scored by exact match. | Competition problems with answers | Feb 2023 | Not in cards |