Yi-VL-34B
Yi-VL-34B places in the top three on CMMMU.
20
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
01.AI Dec 2023 Yi-VL-34B
Open weights Mid-size
No Epoch Capabilities Index score yet
- PhyX 3.40% #10 /10
- MM-Vet 32.7% #146 /164
- SEED-Bench-2-Plus 47.5% #111 /136
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 66.8% | #111 of 178 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OlympicArena | 15.1% | #22 of 25 | Official leaderboard | |
| PhyX | 3.40% | #10 of 10 | Official leaderboard | |
| OlympiadBench | 3.42% | #6 of 6 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CMMMU | 36.5% | #2 of 9 | Official leaderboard | |
| MMT-Bench | 54.2% | #5 of 15 | Official leaderboard | |
| CoreCognition | 57.5% | #46 of 119 | Official leaderboard | |
| BLINK | 42.8% | #5 of 11 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 46.1% | #73 of 152 | Official leaderboard | |
| A-Bench | 70% | #73 of 116 | Official leaderboard | |
| MME-RealWorld | 31% | #7 of 11 | Official leaderboard | |
| MMBench | 72.4% | #99 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 68.7% | #127 of 178 | Official leaderboard | |
| MMMU | 45.9% | #100 of 136 | Official leaderboard | |
| MMStar | 40.5% | #139 of 173 | Official leaderboard | |
| SEED-Bench-2-Plus | 47.5% | #111 of 136 | Official leaderboard | |
| MM-Vet | 32.7% | #146 of 164 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 4.80% | #39 of 42 | Official leaderboard | |
| MTVQA-Test | 6.80% | #18 of 18 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 43.5 | #150 of 173 | Official leaderboard |