Monkey-Chat
Monkey-Chat.
Huazhong University of Science and Technology Released January 8th, 2024 Family Monkey The lab's model card Compare with others
14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Huazhong University of Science and Technology Jan 2024
Monkey-Chat
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 41% #118 /164
- SEED-Bench-2-Plus 54.9% #93 /136
- CoreCognition 57.1% #47 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 65.1% | #122 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CoreCognition | 57.1% | #47 of 119 | Official leaderboard | |
| MMT-Bench | 53.4% | #6 of 15 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 48% | #71 of 152 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 23.1% | #21 of 42 | Official leaderboard | |
| MME | 1522.4 | #10 of 17 | Official leaderboard | |
| MMBench | 72.4% | #100 of 155 | Official leaderboard | |
| SEED-Bench-2-Plus | 54.9% | #93 of 136 | Official leaderboard | |
| MMBench-EN v1.1 | 69.6% | #123 of 178 | Official leaderboard | |
| MM-Vet | 41% | #118 of 164 | Official leaderboard | |
| MMStar | 40.7% | #137 of 173 | Official leaderboard | |
| A-Bench | 63.2% | #104 of 116 | Official leaderboard | |
| MMIU | 13.7% | #9 of 10 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 48.4 | #129 of 173 | Official leaderboard |