VILA1.5-40B
VILA1.5-40B.
15
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
NVIDIA Apr 2024 VILA1.5-40B
Open weights Mid-size
No Epoch Capabilities Index score yet
- MicroVQA 47.5% #10 /19
- MM-Vet 51.2% #85 /164
- CoreCognition 58.3% #41 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 79.4% | #52 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench | 81.7% | #42 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 79.9% | #54 of 178 | Official leaderboard | |
| CoreCognition | 58.3% | #41 of 119 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 50.8% | #64 of 152 | Official leaderboard | |
| MLVU | 44.2% | #4 of 9 | Official leaderboard | |
| MMStar | 55.2% | #81 of 173 | Official leaderboard | |
| MMBench-Video | 1.61 | #14 of 28 | Official leaderboard | |
| MM-Vet | 51.2% | #85 of 164 | Official leaderboard | |
| MicroVQA | 47.5% | #10 of 19 | Official leaderboard | |
| VSI-Bench | 31.2% | #5 of 9 | Official leaderboard | |
| CharXiv | 24% | #60 of 77 | Official leaderboard | |
| Video-MMMU | 34% | #20 of 24 | Official leaderboard | |
| CharXiv (DQ) | 38.7% | #57 of 67 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 58.5 | #90 of 173 | Official leaderboard |