VideoLLAMA3-7B
VideoLLAMA3-7B ranks first on MLVU.
Released January 22nd, 2024 Compare with others
10
Benchmarks with a score
1
Ranked first, out of five or more models
1
In the top three
Unknown lab Jan 2024
VideoLLAMA3-7B
No Epoch Capabilities Index score yet
- JointAVBench 50% #4 /6
- CrossVid 15.3% #13 /13
- VCR-Bench 32.5% #4 /9
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MLVU | 47.7% | #1 of 9 | Official leaderboard | |
| QIVD | 56.4% | #1 of 4 | Official leaderboard | |
| VCR-Bench | 32.5% | #4 of 9 | Official leaderboard | |
| MMVU | 45% | #17 of 28 | Official leaderboard | |
| Video-MMMU | 47% | #15 of 24 | Official leaderboard | |
| JointAVBench | 50% | #4 of 6 | Official leaderboard | |
| VideoMME v2 (with subtitles) | 14.2% | #26 of 31 | Official leaderboard | |
| CrossVid | 15.3% | #13 of 13 | Official leaderboard | |
| Perception Test MCVQA | 72.8% | #1 of 1 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Video-SafetyBench | 2.20 | #9 of 15 | Official leaderboard |