MiniCPM-V-2_6
MiniCPM-V-2_6 ranks first on OCRBench.
Released August 3rd, 2024 Compare with others
32
Benchmarks with a score
1
Ranked first, out of five or more models
2
In the top three
Unknown lab Aug 2024
MiniCPM-V-2_6
No Epoch Capabilities Index score yet
- VideoReasonBench 0.80% #9 /14
- CG-Bench 29.9% #3 /6
- MM-IFEval 37.4% #8 /9
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 76.9% | #66 of 178 | Official leaderboard | |
| MM-IFEval | 37.4% | #8 of 9 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OCRBench | 85.2% | #1 of 11 | Official leaderboard | |
| MMBench | 81.5% | #43 of 155 | Official leaderboard | |
| MME | 1668.0 | #5 of 17 | Official leaderboard | |
| TempCompass | 66.3% | #4 of 13 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 55.7% | #47 of 152 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 33.7% | #13 of 42 | Official leaderboard | |
| A-Bench | 74.6% | #36 of 116 | Official leaderboard | |
| MMBench-Video | 1.70 | #9 of 28 | Official leaderboard | |
| MM-Vet | 60% | #54 of 164 | Official leaderboard | |
| MMBench-EN v1.1 | 79% | #61 of 178 | Official leaderboard | |
| MMStar | 57.5% | #66 of 173 | Official leaderboard | |
| SEED-Bench-2-Plus | 65.7% | #52 of 136 | Official leaderboard | |
| TemporalBench | 20.4% | #4 of 10 | Official leaderboard | |
| CoreCognition | 56% | #56 of 119 | Official leaderboard | |
| CG-Bench | 29.9% | #3 of 6 | Official leaderboard | |
| LongVideoBench | 57.7% | #12 of 23 | Official leaderboard | |
| Video-MME | 63.7% | #15 of 26 | Official leaderboard | |
| MMMU | 49.8% | #87 of 136 | Official leaderboard | |
| VideoReasonBench | 0.80% | #9 of 14 | Official leaderboard | |
| MEGA-Bench | 25.4% | #15 of 22 | Official leaderboard | |
| LEGO-Puzzles | 32.2% | #11 of 16 | Official leaderboard | |
| MATH-Vision (MathVision) | 23.4% | #82 of 105 | Official leaderboard | |
| MMMU-Pro | 27.2% | #45 of 57 | Official leaderboard | |
| MME-CoT | 39.8% | #8 of 10 | Official leaderboard | |
| Vision Arena | 963 | #133 of 136 | Official leaderboard | |
| KRETA | 41% | #17 of 17 | Official leaderboard | |
| MotionBench | 53% | #12 of 12 | Official leaderboard | |
| OVBench | 39.1% | #7 of 7 | Official leaderboard | |
| ODV-Bench | 49.8% | #5 of 5 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 65.2 | #54 of 173 | Official leaderboard |