VITA-1.5
VITA-1.5.
Released December 20th, 2024 Compare with others
20
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Dec 2024
VITA-1.5
No Epoch Capabilities Index score yet
- OmniVideoBench 30.5% #5 /8
- MM-Vet 52.7% #77 /164
- SEED-Bench-2-Plus 66.9% #41 /136
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 76.1% | #75 of 178 | Official leaderboard | |
| Creation-MMBench | -53.31 | #19 of 19 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 66.9% | #41 of 136 | Official leaderboard | |
| MMStar | 60.2% | #59 of 173 | Official leaderboard | |
| MMBench | 79.8% | #58 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 77.5% | #75 of 178 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 48.2% | #70 of 152 | Official leaderboard | |
| MM-Vet | 52.7% | #77 of 164 | Official leaderboard | |
| OpenAudioBench AlpacaEval | 6.82 | #2 of 4 | Official leaderboard | |
| OpenAudioBench Reasoning QA | 41% | #2 of 4 | Official leaderboard | |
| VoiceBench | 64.5% | #9 of 15 | Official leaderboard | |
| A-Bench | 70.3% | #70 of 116 | Official leaderboard | |
| OmniVideoBench | 30.5% | #5 of 8 | Official leaderboard | |
| OpenAudioBench Llama Questions | 74.2% | #3 of 4 | Official leaderboard | |
| OpenAudioBench TriviaQA | 4.68 | #3 of 4 | Official leaderboard | |
| OpenAudioBench Web Questions | 5.73 | #3 of 4 | Official leaderboard | |
| Video-MME | 58.7% | #20 of 26 | Official leaderboard | |
| VideoMME v2 (with subtitles) | 11.3% | #30 of 31 | Official leaderboard | |
| VideoFDB | 2.00 | #2 of 2 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 63.3 | #71 of 173 | Official leaderboard |