Benchmark Almanac

Ovis1.6-Llama3.2-3B

Ovis1.6-Llama3.2-3B.

12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Alibaba International Digital Commerce (AIDC-AI) Oct 2024

Ovis1.6-Llama3.2-3B

Open weights Small

No Epoch Capabilities Index score yet
  • MM-Vet 57.6% #67 /164
  • SEED-Bench-2-Plus 63.7% #63 /136
  • CoreCognition 56.7% #52 /119

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 71.9% #88 of 178 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
A-Bench 75.2% #33 of 116 Official leaderboard
MM-Vet 57.6% #67 of 164 Official leaderboard
MMBench 78.5% #67 of 155 Official leaderboard
CoreCognition 56.7% #52 of 119 Official leaderboard
SEED-Bench-2-Plus 63.7% #63 of 136 Official leaderboard
MMBench-EN v1.1 76.2% #83 of 178 Official leaderboard
MMStar 52% #95 of 173 Official leaderboard
CCBench (MMBench Chinese Culture) 36.3% #102 of 152 Official leaderboard
ChartQA Pro 16.2% #5 of 7 Official leaderboard
KRETA 52.2% #13 of 17 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 61.4 #75 of 173 Official leaderboard