Benchmark Almanac

Tulu 3 (Tülu 3) 70B

Tulu 3 (Tülu 3) 70B.

Ai2 Released November 21st, 2024 Compare with others
4
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Ai2 Nov 2024

Tulu 3 (Tülu 3) 70B

Open weights

No Epoch Capabilities Index score yet
  • GPQA Diamond 46.3% #172 /229
  • OTIS Mock AIME 2024-2025 4.44% #184 /212
  • MATH Level 5 42.7% #59 /94

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
LMArena (Elo) 1,286 #244 of 335 Official leaderboard

Math and science

BenchmarkScoreRankSource
MATH Level 5 42.7% #59 of 94 Epoch AI run
GPQA Diamond 46.3% #172 of 229 Epoch AI run
OTIS Mock AIME 2024-2025 4.44% #184 of 212 Epoch AI run