Benchmark Almanac

T5-11B

T5-11B ranks first on CommonsenseQA 2.0.

Google DeepMind Released October 23rd, 2019 Compare with others
8
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
Google DeepMind Oct 2019

T5-11B

Open weights

No Epoch Capabilities Index score yet

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
CommonsenseQA 2.0 67.8% #1 of 6 Claim in CommonsenseQA 2.0: Exposing the Limits of AI through Gami…, via Epoch AI
CB 96.8% #1 of 3 Official leaderboard
RTE 92.8% #1 of 2 Official leaderboard
BoolQ 91.2% #2 of 3 Official leaderboard
MultiRC 88.1% #2 of 3 Official leaderboard
SuperGLUE 89.3% #2 of 3 Official leaderboard
WSC 93.8% #2 of 3 Official leaderboard

Other

BenchmarkScoreRankSource
HELM Classic 13.1 #17 of 17 Official leaderboard