Emu3-Chat
Emu3-Chat.
Beijing Academy of Artificial Intelligence Released September 26th, 2024 Family Emu The lab's model card Compare with others
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Beijing Academy of Artificial Intelligence Sep 2024
Emu3-Chat
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 29.1% #157 /164
- SEED-Bench-2-Plus 44.9% #118 /136
- CoreCognition 46.6% #103 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 46.1% | #165 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMStar | 46.6% | #119 of 173 | Official leaderboard | |
| CoreCognition | 46.6% | #103 of 119 | Official leaderboard | |
| SEED-Bench-2-Plus | 44.9% | #118 of 136 | Official leaderboard | |
| MMBench | 63.8% | #135 of 155 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 19% | #139 of 152 | Official leaderboard | |
| MMBench-EN v1.1 | 59.3% | #163 of 178 | Official leaderboard | |
| A-Bench | 61.2% | #108 of 116 | Official leaderboard | |
| MM-Vet | 29.1% | #157 of 164 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 47.5 | #138 of 173 | Official leaderboard |