Benchmark Almanac

InstructBLIP FLAN-T5-XL

InstructBLIP FLAN-T5-XL.

Salesforce Released May 28th, 2023 Family InstructBLIP The lab's model card Compare with others
5
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Salesforce May 2023

InstructBLIP FLAN-T5-XL

Open weights Small

No Epoch Capabilities Index score yet
  • CoreCognition 52.1% #81 /121
  • MMCircuitEval 10.8% #20 /21
  • NOTA 15% #6 /10

Where has it been number one?

InstructBLIP FLAN-T5-XL led 1 benchmark at some point, for a median of 62 days. It last lost Q-Bench to mPLUG-Owl2 on November 2nd, 2023.

Source: Official leaderboards

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Professional work

BenchmarkScoreRankSource
MMCircuitEval 10.8% #20 of 21 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
Q-Bench 61.9% #5 of 10 Official leaderboard
NOTA 15% #6 of 10 Official leaderboard
CoreCognition 52.1% #81 of 121 Official leaderboard
MMMU 32.9% #133 of 137 Official leaderboard

Who measured it?

Independent runs cover all 5 of its benchmarks.

  • An independent run only 5
Official leaderboards scored it on 5.

Sources: Official leaderboards, Epoch AI (CC BY 4.0) and labs’ model cards