SmolVLM-Instruct
SmolVLM-Instruct.
9
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Hugging Face Nov 2024 SmolVLM-Instruct
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 33.8% #140 /164
- SEED-Bench-2-Plus 57.5% #87 /136
- A-Bench 65% #96 /116
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 50.3% | #163 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 57.5% | #87 of 136 | Official leaderboard | |
| MMStar | 41.7% | #135 of 173 | Official leaderboard | |
| MMBench | 67.5% | #124 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 64.4% | #146 of 178 | Official leaderboard | |
| A-Bench | 65% | #96 of 116 | Official leaderboard | |
| MM-Vet | 33.8% | #140 of 164 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 20.8% | #136 of 152 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 48.1 | #133 of 173 | Official leaderboard |