IDEFICS-80B-Instruct
IDEFICS-80B-Instruct.
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Jul 2023 IDEFICS-80B-Instruct
Open weights Flagship
No Epoch Capabilities Index score yet
- MM-Vet 39.7% #125 /164
- SEED-Bench-2-Plus 41.5% #125 /136
- CoreCognition 48.9% #98 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 44.4% | #166 of 178 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| VisualWebArena | 0.99% | #6 of 7 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MM-Vet | 39.7% | #125 of 164 | Official leaderboard | |
| CoreCognition | 48.9% | #98 of 119 | Official leaderboard | |
| SEED-Bench-2-Plus | 41.5% | #125 of 136 | Official leaderboard | |
| MMBench | 54.6% | #145 of 155 | Official leaderboard | |
| VHELM | 9.06 | #39 of 41 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 10.6% | #145 of 152 | Official leaderboard | |
| MMStar | 26.1% | #171 of 173 | Official leaderboard | |
| MMBench-EN v1.1 | 11.3% | #176 of 178 | Official leaderboard | |
| Image2Struct | 7.02 | #18 of 18 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 31.6 | #167 of 173 | Official leaderboard |