OmniLMM-12B
OmniLMM-12B.
OpenBMB (ModelBest) Released January 31st, 2024 Family OmniLMM The lab's model card Compare with others 13
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
OpenBMB (ModelBest) Jan 2024 OmniLMM-12B
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 47.4% #95 /164
- SEED-Bench-2-Plus 46.1% #114 /136
- CoreCognition 32.2% #119 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 59.4% | #145 of 178 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GMAI-MMBench | 39.3% | #5 of 13 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MM-Vet | 47.4% | #95 of 164 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 19% | #27 of 42 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 37.1% | #98 of 152 | Official leaderboard | |
| MMBench | 71.7% | #103 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 69.2% | #124 of 178 | Official leaderboard | |
| MMMU | 41.1% | #112 of 136 | Official leaderboard | |
| SEED-Bench-2-Plus | 46.1% | #114 of 136 | Official leaderboard | |
| MMStar | 39.6% | #146 of 173 | Official leaderboard | |
| MathVista | 34.9% | #38 of 43 | Official leaderboard | |
| CoreCognition | 32.2% | #119 of 119 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 46.2 | #142 of 173 | Official leaderboard |