Monkey
Monkey.
Huazhong University of Science and Technology Released November 22nd, 2023 Family Monkey The lab's model card Compare with others
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Huazhong University of Science and Technology Nov 2023
Monkey
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 38.1% #131 /164
- SEED-Bench-2-Plus 52% #100 /136
- CoreCognition 53.9% #71 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 52.5% | #161 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MME-RealWorld | 35.3% | #6 of 11 | Official leaderboard | |
| CoreCognition | 53.9% | #71 of 119 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 37.1% | #97 of 152 | Official leaderboard | |
| SEED-Bench-2-Plus | 52% | #100 of 136 | Official leaderboard | |
| MM-Vet | 38.1% | #131 of 164 | Official leaderboard | |
| OCRBench | 51.4% | #9 of 11 | Official leaderboard | |
| A-Bench | 61.9% | #107 of 116 | Official leaderboard | |
| MMBench | 59.6% | #143 of 155 | Official leaderboard | |
| MMStar | 37% | #160 of 173 | Official leaderboard | |
| MMBench-EN v1.1 | 57.4% | #166 of 178 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 43.9 | #149 of 173 | Official leaderboard |