Ovis1.6-Gemma2-9B
Ovis1.6-Gemma2-9B places in the top three on ChartQA Pro.
Alibaba International Digital Commerce (AIDC-AI) Released September 18th, 2024 Family Ovis1.6 The lab's model card Compare with others 14
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Alibaba International Digital Commerce (AIDC-AI) Sep 2024 Ovis1.6-Gemma2-9B
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 65% #39 /164
- SEED-Bench-2-Plus 67.9% #29 /136
- CoreCognition 60.9% #24 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 79.5% | #50 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench | 83.4% | #28 of 155 | Official leaderboard | |
| CoreCognition | 60.9% | #24 of 119 | Official leaderboard | |
| SEED-Bench-2-Plus | 67.9% | #29 of 136 | Official leaderboard | |
| MM-Vet | 65% | #39 of 164 | Official leaderboard | |
| MMBench-EN v1.1 | 81.5% | #44 of 178 | Official leaderboard | |
| MMStar | 62.9% | #44 of 173 | Official leaderboard | |
| ChartQA Pro | 26.8% | #2 of 7 | Official leaderboard | |
| MathVista | 67.2% | #14 of 43 | Official leaderboard | |
| A-Bench | 74.4% | #38 of 116 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 51.8% | #63 of 152 | Official leaderboard | |
| KRETA | 58.4% | #10 of 17 | Official leaderboard | |
| MATH-Vision (MathVision) | 18.8% | #91 of 105 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 68.8 | #41 of 173 | Official leaderboard |