Benchmark Almanac

T5-3B

T5-3B places in the top three on 3 benchmarks.

Google DeepMind Released October 23rd, 2019 Compare with others
5
Benchmarks with a score
0
Ranked first, out of five or more models
3
In the top three
Google DeepMind Oct 2019

T5-3B

Open weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
BoolQ 89.9% #3 of 61 Claim in Exploring the Limits of Transfer Learning with a Unified…, via Epoch AI
SuperGLUE 86.4% #2 of 8 Claim in Exploring the Limits of Transfer Learning with a Unified…, via Epoch AI
CommonsenseQA 2.0 60.2% #2 of 6 Claim in Decker: Double Check with Heterogeneous Knowledge for Com…, via Epoch AI

Coding

BenchmarkScoreRankSource
Spider 78% #1 of 2 Official leaderboard
Bird-SQL 24.1% #11 of 13 Official leaderboard