Benchmark Almanac

Intern-S1

Intern-S1 places in the top three on CompassArena Multimodal.

Shanghai AI Lab Released July 24th, 2025 Family Intern-S1 The lab's model card Compare with others
21
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Shanghai AI Lab Jul 2025

Intern-S1

Open weights Flagship

137.8 #196 of 404
Self-Reported Index, from the lab's own numbers. No Epoch Capabilities Index score yet.
  • HiPhO 52.2% #21 /36
  • Scientists' First Exam (SFE) 44.3% #5 /5
  • SGI-Bench 28.1% #13 /15

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMLU-Pro 83.5% #47 of 167 Lab model card
IFEval 86.7% #66 of 135 Lab model card

Math and science

BenchmarkScoreRankSource
GPQA Diamond 77.3% #134 of 302 Lab model card
AIME 2025 86% #70 of 143 Lab model card
Matbench 75.0 #1 of 2 Lab model card
HiPhO 52.2% #21 of 36 Official leaderboard
SGI-Bench 28.1% #13 of 15 Official leaderboard
ChemBench 83.4% #1 of 1 Lab model card
PHYSICS 44% #1 of 1 Lab model card

Vision, audio and robotics

BenchmarkScoreRankSource
MMMU 77.7% #15 of 136 Official leaderboard
CompassArena Multimodal 1,155 #2 of 8 Official leaderboard
XLRS-Bench 55% #1 of 4 Lab model card
MathVista 81.5% #27 of 70 Lab model card
MSEarth 65.7% #1 of 2 Lab model card
MMStar 74.9% #21 of 36 Lab model card
MicroVQA 63.9% #2 of 3 Lab model card
MATH-Vision (MathVision) 62.5% #38 of 51 Lab model card
Scientists' First Exam (SFE) 44.3% #5 of 5 Lab model card

Safety and security

BenchmarkScoreRankSource
LiveSecBench 31.5 #25 of 34 Official leaderboard
SMolInstruct 51% #2 of 2 Lab model card
ProteinLMBench 63.1% #1 of 1 Lab model card

Its lab's numbers put it at 137.8, number 196 of 404

The Self-Reported Index fits one score to the 8 capability results Shanghai AI Lab reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 135.1 to 140.5. How we compute it.

Its lab's numbers next to 2 leaderboards

Where the benchmark's own leaderboard, or Epoch AI's run, also has this model. Gaps mostly come from different harnesses, effort levels and task subsets. Every pair.

Benchmark Lab says Board says Gap
MMLU-Pro 83.5% MMLU-Pro 83.5% Leaderboard Same
MMMU 77.7% MMMU 77.7% Leaderboard Same

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.

Its system card

Every result in the longer documents the lab published with it.