Benchmark Almanac

GMAT Quantitative

Llama 3.1-405B 96% leads since November 2024
Llama 3.1-405B 96% leads since July 2024
Only in system cards

Models answer the quantitative section of the official GMAT online exam. Scored as accuracy.

Llama 3 uses one official GMAT online exam, so the confidence interval is wide.

Made by
GMAC
Kind
Word problems
Level
University
Scored
Checked automatically
Answers
Multiple choice
Strongest model tested
Llama 3.1-405B #162 on the capability index
Last in a system card
November 2024
Last model added
November 2024
Scores refreshed
November 12th, 2026
3
Models scored in lab cards
3
System cards report it, from 1 lab

Llama 3.1-405B leads with 96% among models released by July 2024

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

Llama 3.1-405B leads with 96% across all independent runs

Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.

The newest model with a score here came out in July 2024, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

  1. 96.0 Llama 3.1-405B
  2. 84.0 Llama 3.1-70B
  3. 56.0 Llama 3.1-8B
  1. 1 Llama 3.1-405B 96%
  2. 2 Llama 3.1-70B 84%
  3. 3 Llama 3.1-8B 56%

Source: Labs’ model cards

Source: Official GMAT Quantitative leaderboard

#ModelScoreSettingDateSource
1 Llama 3.1-405B 96% Nov 2024 Lab model card
2 Llama 3.1-70B 84% Nov 2024 Lab model card
3 Llama 3.1-8B 56% Nov 2024 Lab model card
#ModelScoreSettingDateSource
1 Llama 3.1-405B 96% Jul 2024 Official leaderboard
2 Llama 3.1-70B 84% Jul 2024 Official leaderboard
3 Nemotron-4-340B-Instruct 76% Jun 2024 Official leaderboard
4 Llama 3.1-8B 56% Jul 2024 Official leaderboard

The benchmark's own leaderboard has 7 entries, 4 of them models we track. Switch the scores above to rank them together.

Number one over time 2 models have held number one across all independent runs since 2023

Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.

NVIDIA Meta
Own leaderboard Passed 85% in Jul 2024, by Llama 3.1-405B
Llama 3.1-405B 96%
Lab claims Passed 85% in Nov 2024, by Llama 3.1-405B
Llama 3.1-405B 96%

Sources: Official GMAT Quantitative leaderboard and labs’ model cards

Llama 3.1-405B on the official leaderboard passed 85% in July 2024

All the scores we have, one dot each, so a model tested at several settings appears more than once.

On the benchmark’s own leaderboard Reported by the lab in its model card Best so far
0% 20% 40% 60% 80% 100% 2024 2025 Near the ceiling (85%) Llama 3.1-405B Nemotron-4-340B-Instruct 0% 20% 40% 60% 80% 100% 2024 2025 Near the ceiling (85%) Llama 3.1-405B Nemotron-4-340B-Instruct

Sources: Official GMAT Quantitative leaderboard and labs’ model cards

Labs report it only in system cards

We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark. Some system cards do, below.

3 system cards report it, from 1 lab

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
Nov 23, 2024 Llama 3.1-8B technical report 56 GMAT Quant., accuracy (Table 17) Capabilities
Nov 23, 2024 Llama 3.1-70B technical report 84 GMAT Quant., accuracy (Table 17) Capabilities
Nov 23, 2024 Llama 3.1-405B technical report 96 GMAT Quant., accuracy (Table 17) Capabilities

3 lab claims next to the leaderboard

Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. 3 of them match, which usually means one side copied the other. Every benchmark.

Model Lab says Board says Gap
Llama 3.1-405B 96% GMAT Quant., accuracy (Table 17) 96% Leaderboard Same
Llama 3.1-70B 84% GMAT Quant., accuracy (Table 17) 84% Leaderboard Same
Llama 3.1-8B 56% GMAT Quant., accuracy (Table 17) 56% Leaderboard Same

More in Math

All 113 in Math
  • AIME 2026 In use Models solve the 30 integer-answer problems from the 2026 AIME I and II math competitions. Scored by exact answer match. GPT-5.5 100%
  • IMO-AnswerBench In use 400 olympiad problems with short verifiable answers, robustified against memorization. Scored by answer match. GLM-5.2 91%
  • HMMT 2026 In use Models solve the 33 final-answer problems from the February 2026 Harvard-MIT Mathematics Tournament. Scored by exact answer match. GPT-5.5 98.5%
  • PolyMath In use Models solve 9,000 parallel math problems in 18 languages across four difficulty levels, from school math to frontier math. Final answers are checked. Qwen3.7-Max 86.5%
  • MathArena (Apex, IMO, USAMO) In use Evaluates models on newly released math competitions after release. Final-answer or human/LLM-judged proof scores. Claude Opus 4.8 81.3%
  • MathArena Apex Shortlist In use Models solve 47 hard final-answer problems that MathArena selected from 2025 competitions, where the best models scored about 50% at selection. Scored by accuracy over repeated attempts. GPT-5.5 98.4%