Benchmark Almanac

Gemini 2.5 Flash-Lite Jun 2025

Gemini 2.5 Flash-Lite.

Google DeepMind Released June 17th, 2025 Compare with others
29
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Google DeepMind Jun 2025

Gemini 2.5 Flash-Lite

Jun 2025 snapshot Closed weights

133.1 #150 of 256
Epoch Capabilities Index
Self-Reported Index 127.6 #295 of 404
  • LiveCodeBench v5 34.3% #41 /47
  • ProfBench 44.3% #49 /72
  • StructEval 72% #18 /28

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
Vectara Hallucination Leaderboard (HHEM) 2.90% #43 of 148 Official leaderboard
FACTS Grounding 86.8% #5 of 15 Lab model card
LMArena (Elo) 1,375 #157 of 335 Official leaderboard
Global MMLU Lite 84.5% #8 of 16 Lab model card
Wer wird Millionär? LLM Benchmark 700.0 #50 of 77 Official leaderboard
SimpleQA 13% #45 of 60 Lab model card
Fiction.LiveBench 47.2% #44 of 57 Fiction.live leaderboard, via Epoch AI
MRCR v2 30.6% #27 of 30 Lab model card
Humanity's Last Exam 6.90% #149 of 154 Lab model card

Math and science

BenchmarkScoreRankSource
GPQA Diamond 66.7% #196 of 302 Lab model card
DTBench 62.8% #131 of 180 Official leaderboard
AIME 2025 63.1% #123 of 143 Lab model card

Coding

BenchmarkScoreRankSource
StructEval 72% #18 of 28 Official leaderboard
WeirdML 35.2% #93 of 112 Official leaderboard
LiveCodeBench v5 34.3% #41 of 47 Lab model card
SWE-bench Verified 44.9% #138 of 155 Lab model card
Aider Polyglot 27.1% #28 of 30 Lab model card

Agents and tools

BenchmarkScoreRankSource
Galileo Agent Leaderboard v2 47% #8 of 21 Official leaderboard
LisanBench 122.3 #111 of 133 Official leaderboard

Professional work

BenchmarkScoreRankSource
ProfBench 44.3% #49 of 72 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MMMU 72.9% #52 of 103 Lab model card
Vision Arena 1,189 #85 of 136 Official leaderboard
Vibe-Eval 57.5% #8 of 9 Lab model card

Safety and security

BenchmarkScoreRankSource
Lakera B3 (Backbone Breaker Benchmark) 49.9% #26 of 35 Official leaderboard

Other

BenchmarkScoreRankSource
Conceptual Reasoning Index 25.1 #127 of 151 Official leaderboard
CAIS Vision Capabilities Index 38.1 #46 of 53 Official leaderboard
ACCoRD 33.4 #140 of 152 Official leaderboard
CAIS Text Capabilities Index 9.20 #64 of 68 Official leaderboard
CAIS Risk Index 77.1 #67 of 67 Official leaderboard

Its lab's numbers put it at 127.6, 5.4 points below its ECI

The Self-Reported Index fits one score to the 12 capability results Google DeepMind reported for this model, on the scale of the Epoch Capabilities Index. Labs choose which benchmarks to show and how to run them, so read it as the lab's claim, not an independent measurement. The 90% interval runs from 125.2 to 130.0. How we compute it.

Google DeepMind's models over time

Google DeepMind's models in color, against every other model on the Epoch Capabilities Index, by release date.

50 100 150 2023 2024 2025 2026 2027 Gemini 4 Carbon Gemini 3.8 Flash Gemini 3.5 Flash-Lite Gemini 3 Pro Gemini 2.5 Flash Gemini 2.5 Flash-Lite Gemini 1.5 Pro 50 100 150 2023 2024 2025 2026 2027 Gemini 4 Carbon Gemini 3.8 Flash

Source: Epoch Capabilities Index, Epoch AI (CC BY 4.0)

Its launch post

The benchmarks the lab chose to headline, with the scores it gave.