Benchmark Almanac

VILA1.5-13B

VILA1.5-13B places in the top three on MuirBench.

NVIDIA Released April 29th, 2024 Family VILA The lab's model card Compare with others
14
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
NVIDIA Apr 2024

VILA1.5-13B

Open weights Small

No Epoch Capabilities Index score yet
  • MicroVQA 41.8% #18 /19
  • MM-Vet 45% #101 /164
  • SEED-Bench-2-Plus 50.2% #105 /136

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 65.2% #120 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
MuirBench 33.1% #3 of 8 Official leaderboard
MMBench 74.4% #86 of 155 Official leaderboard
CoreCognition 54.1% #70 of 119 Official leaderboard
MMBench-EN v1.1 71.8% #106 of 178 Official leaderboard
MM-Vet 45% #101 of 164 Official leaderboard
MMBench-Video 1.36 #20 of 28 Official leaderboard
MMStar 44.2% #130 of 173 Official leaderboard
SEED-Bench-2-Plus 50.2% #105 of 136 Official leaderboard
ERQA 33.6% #14 of 17 Official leaderboard
CCBench (MMBench Chinese Culture) 24.3% #128 of 152 Official leaderboard
LEGO-Puzzles 27.7% #15 of 16 Official leaderboard
MicroVQA 41.8% #18 of 19 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 49.5 #127 of 173 Official leaderboard