Ovis1.6-Gemma2-27B
Ovis1.6-Gemma2-27B.
Alibaba International Digital Commerce (AIDC-AI) Released November 26th, 2024 Family Ovis1.6 The lab's model card Compare with others 10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Alibaba International Digital Commerce (AIDC-AI) Nov 2024 Ovis1.6-Gemma2-27B
Open weights Mid-size
No Epoch Capabilities Index score yet
- MM-Vet 68% #26 /164
- SEED-Bench-2-Plus 71.1% #10 /136
- CoreCognition 61.3% #20 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 81.5% | #35 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 71.1% | #10 of 136 | Official leaderboard | |
| MMBench | 84.8% | #18 of 155 | Official leaderboard | |
| A-Bench | 76.5% | #18 of 116 | Official leaderboard | |
| MM-Vet | 68% | #26 of 164 | Official leaderboard | |
| CoreCognition | 61.3% | #20 of 119 | Official leaderboard | |
| MMBench-EN v1.1 | 82.8% | #32 of 178 | Official leaderboard | |
| MMStar | 63.5% | #40 of 173 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 53.1% | #58 of 152 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 71.3 | #28 of 173 | Official leaderboard |