Emu2-Chat
Emu2-Chat.
Beijing Academy of Artificial Intelligence Released December 19th, 2023 Family Emu The lab's model card Compare with others
14
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Beijing Academy of Artificial Intelligence Dec 2023
Emu2-Chat
Open weights Mid-size
No Epoch Capabilities Index score yet
- MM-Vet 31% #153 /164
- SEED-Bench-2-Plus 42.1% #123 /136
- CoreCognition 45.7% #107 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 44.3% | #167 of 178 | Official leaderboard | |
| MM-NIAH | 7.70% | #2 of 2 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GMAI-MMBench | 37.6% | #7 of 13 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMStar | 40.7% | #136 of 173 | Official leaderboard | |
| MIRB | 27.2% | #6 of 7 | Official leaderboard | |
| MMBench | 63.6% | #136 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 61.3% | #157 of 178 | Official leaderboard | |
| CMMMU | 24.5% | #8 of 9 | Official leaderboard | |
| CoreCognition | 45.7% | #107 of 119 | Official leaderboard | |
| MMMU | 36.3% | #123 of 136 | Official leaderboard | |
| SEED-Bench-2-Plus | 42.1% | #123 of 136 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 18.8% | #140 of 152 | Official leaderboard | |
| MM-Vet | 31% | #153 of 164 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 39.2 | #163 of 173 | Official leaderboard |