Chameleon-30B
Chameleon-30B.
10
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Meta Jun 2024 Chameleon-30B
Open weights Mid-size
No Epoch Capabilities Index score yet
- HumanEval-V 0.40% #24 /24
- MM-Vet 9.70% #163 /164
- SEED-Bench-2-Plus 39.4% #128 /136
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 27.8% | #172 of 178 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval-V | 0.40% | #24 of 24 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 39.4% | #128 of 136 | Official leaderboard | |
| MMStar | 31.8% | #168 of 173 | Official leaderboard | |
| MMBench-EN v1.1 | 37.6% | #173 of 178 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 5.90% | #148 of 152 | Official leaderboard | |
| MMBench | 32.5% | #152 of 155 | Official leaderboard | |
| MM-Vet | 9.70% | #163 of 164 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 0.30% | #42 of 42 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 26.5 | #171 of 173 | Official leaderboard |