Benchmark Almanac

Phi-4-reasoning

Phi-4-reasoning places in the top three on HumanEval+.

Microsoft Released April 30th, 2025 Family Phi-4 The lab's model card Compare with others
20
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Microsoft Apr 2025

Phi-4-reasoning

Open weights Small

129.8 #276 of 404
Self-Reported Index, from the lab's own numbers. No Epoch Capabilities Index score yet.
  • LiveCodeBench v5 53.8% #36 /47
  • MMLU-Pro 74.3% #111 /167
  • AIME 2025 63.1% #122 /143

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Arena-Hard-Auto 73.3% #24 of 39 Lab model card
MMLU-Pro 74.3% #111 of 167 Lab model card
IFEval 83.4% #93 of 135 Lab model card
FlenQA 97.7% #2 of 2 Lab model card

Math and science

BenchmarkScoreRankSource
3SAT-Search 78% #1 of 2 Lab model card
BA-Calendar 67.7% #1 of 2 Lab model card
AIME 2024 75.3% #53 of 88 Lab model card
GPQA Diamond 67.1% #193 of 302 Lab model card
Omni-MATH 76.6% #3 of 4 Lab model card
AIME 2025 63.1% #122 of 143 Lab model card
HMMT 2025 43.8% #52 of 54 Lab model card
AIME 1983-2024 83.1% #2 of 2 Lab model card
TSP-Opt 37.5% #2 of 2 Lab model card

Coding

BenchmarkScoreRankSource
HumanEval+ 92.9% #3 of 27 Lab model card
Codeforces rating 1,736 #34 of 47 Lab model card
LiveCodeBench v5 53.8% #36 of 47 Lab model card

Vision, audio and robotics

BenchmarkScoreRankSource
SpatialEval Maze-Nav 55.1% #1 of 2 Lab model card
SpatialEval Spatial-Map 73.7% #1 of 2 Lab model card

Safety and security

BenchmarkScoreRankSource
ToxiGen (discriminative) 85.5% #1 of 2 Lab model card

Other

BenchmarkScoreRankSource
PhiBench 70.6% #2 of 3 Lab model card

Its lab's numbers put it at 129.8, number 276 of 404

The Self-Reported Index fits one score to the 9 capability results Microsoft reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 127.7 to 131.9. How we compute it.

Its lab's number next to a leaderboard

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
MMLU-Pro 74.3% MMLUPro 74.3% Leaderboard Same

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it. 9 of them aren't in the launch post.