Benchmark Almanac

Seed1.6-Thinking

Seed1.6-Thinking ranks first on MathCanvas-Bench.

ByteDance Seed Released June 15th, 2025 Family Seed 1 The lab's model card Compare with others
17
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
ByteDance Seed Jun 2025

Seed1.6-Thinking

Closed weights Flagship

138.5 #189 of 404
Self-Reported Index, from the lab's own numbers. No Epoch Capabilities Index score yet.
  • MMMU-Pro 66.4% #57 /90
  • VisFactor 21.5% #17 /26
  • MathCanvas-Bench 44.1% #1 /16

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 86.6% #21 of 212 Official leaderboard
WritingBench 78.8 #11 of 45 Official leaderboard

Math and science

BenchmarkScoreRankSource
AIME 2024 90% #19 of 88 Lab model card
GPQA Diamond 81.5% #106 of 302 Lab model card
AIME 2025 86% #69 of 143 Lab model card
Beyond AIME 56.3% #11 of 14 Lab model card

Coding

BenchmarkScoreRankSource
LiveCodeBench 64% #19 of 54 Lab model card
AutoCodeBench 44.7% #17 of 34 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MathCanvas-Bench 44.1% #1 of 16 Official leaderboard
MMMU 74.8% #22 of 136 Official leaderboard
InfographicVQA 88% #6 of 26 Lab model card
Math-VR 58.4% #6 of 26 Official leaderboard
ChartQA 89.1% #10 of 37 Lab model card
RealWorldQA 77.8% #20 of 38 Lab model card
MATH-Vision (MathVision) 70.3% #32 of 51 Lab model card
MMMU-Pro 66.4% #57 of 90 Lab model card
VisFactor 21.5% #17 of 26 Official leaderboard

Its lab's numbers put it at 138.5, number 189 of 404

The Self-Reported Index fits one score to the 11 capability results ByteDance Seed reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 136.4 to 140.6. How we compute it.

Its lab's numbers next to 3 leaderboards

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
MATH-Vision (MathVision) 70.3% MathVision 77.2% Leaderboard −6.9 pts
MMMU 74.8% MMMU 74.8% Leaderboard Same
MMMU-Pro 66.4% MMMU-pro 66.4% Leaderboard Same

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.