Benchmark Almanac

Yi-VL-6B

Yi-VL-6B places in the top three on CMMMU.

01.AI Released December 25th, 2023 Family Yi-VL The lab's model card Compare with others
19
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
01.AI Dec 2023

Yi-VL-6B

Open weights Small

No Epoch Capabilities Index score yet
  • MM-Vet 32.1% #148 /164
  • SEED-Bench-2-Plus 46.2% #112 /136
  • CoreCognition 55.3% #65 /119

Where it ranks

Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.

Knowledge and language

BenchmarkScoreRankSource
MMBench-CN v1.1 63.1% #133 of 178 Official leaderboard

Agents and tools

BenchmarkScoreRankSource
VisualWebBench 16.2% #6 of 7 Official leaderboard

Professional work

BenchmarkScoreRankSource
GMAI-MMBench 34.3% #11 of 13 Official leaderboard

Vision, audio and robotics

BenchmarkScoreRankSource
CMMMU 35% #3 of 9 Official leaderboard
MMT-Bench 53.2% #7 of 15 Official leaderboard
MuirBench 28.7% #4 of 8 Official leaderboard
CCBench (MMBench Chinese Culture) 42.9% #83 of 152 Official leaderboard
CoreCognition 55.3% #65 of 119 Official leaderboard
BLINK 41.2% #7 of 11 Official leaderboard
A-Bench 69.8% #74 of 116 Official leaderboard
MMBench 68.4% #119 of 155 Official leaderboard
MMDU 33.2 #4 of 5 Official leaderboard
MMBench-EN v1.1 65.2% #144 of 178 Official leaderboard
SEED-Bench-2-Plus 46.2% #112 of 136 Official leaderboard
MMMU 39.1% #117 of 136 Official leaderboard
MMStar 37.7% #155 of 173 Official leaderboard
MM-Vet 32.1% #148 of 164 Official leaderboard
VCR (Visual Caption Restoration) 4.70% #40 of 42 Official leaderboard

Other

BenchmarkScoreRankSource
OpenVLM Leaderboard 41.1 #156 of 173 Official leaderboard