Benchmark Almanac

llama3-llava-next-8b

llama3-llava-next-8b.

Released April 20th, 2024 Compare with others
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Unknown lab Apr 2024

llama3-llava-next-8b

No Epoch Capabilities Index score yet
  • MM-Vet 44.4% #104 /164
  • SEED-Bench-2-Plus 56.9% #90 /136
  • A-Bench 69.7% #75 /116

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 67.5% #109 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
3DSRBench 49.6% #1 of 4 Official leaderboard
ScienceQA 73.7% #5 of 17 Claim in Phi-3 Technical Report: A Highly Capable Language Model L…, via Epoch AI
MMBench 74.8% #80 of 155 Official leaderboard
MMBench-EN v1.1 72.1% #103 of 178 Official leaderboard
VCR (Visual Caption Restoration) 19.7% #26 of 42 Official leaderboard
MM-Vet 44.4% #104 of 164 Official leaderboard
A-Bench 69.7% #75 of 116 Official leaderboard
SEED-Bench-2-Plus 56.9% #90 of 136 Official leaderboard
CCBench (MMBench Chinese Culture) 32.7% #105 of 152 Official leaderboard
MMStar 43.9% #131 of 173 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 49.7 #126 of 173 Official leaderboard