Ovis1.5-Gemma2-9B
Ovis1.5-Gemma2-9B.
Alibaba International Digital Commerce (AIDC-AI) Released July 30th, 2024 Family Ovis1.5 The lab's model card Compare with others 14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Alibaba International Digital Commerce (AIDC-AI) Jul 2024 Ovis1.5-Gemma2-9B
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 53.8% #74 /164
- SEED-Bench-2-Plus 67.4% #34 /136
- CoreCognition 56.7% #51 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 76.2% | #73 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 67.4% | #34 of 136 | Official leaderboard | |
| MMBench | 80.9% | #47 of 155 | Official leaderboard | |
| MMStar | 58.1% | #65 of 173 | Official leaderboard | |
| MMBench-EN v1.1 | 78.4% | #68 of 178 | Official leaderboard | |
| A-Bench | 73.5% | #47 of 116 | Official leaderboard | |
| CoreCognition | 56.7% | #51 of 119 | Official leaderboard | |
| CharXiv (DQ) | 62.6% | #30 of 67 | Official leaderboard | |
| MM-Vet | 53.8% | #74 of 164 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 24.6% | #19 of 42 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 44.1% | #81 of 152 | Official leaderboard | |
| CharXiv | 28.4% | #48 of 77 | Official leaderboard | |
| MMMU | 49.8% | #86 of 136 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 64.0 | #65 of 173 | Official leaderboard |