MolmoE-1B
MolmoE-1B.
12
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
Ai2 Sep 2024 MolmoE-1B
Open weights Small
No Epoch Capabilities Index score yet
- MM-Vet 37.8% #132 /164
- SEED-Bench-2-Plus 57% #89 /136
- CoreCognition 52.1% #78 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 44.2% | #168 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 57% | #89 of 136 | Official leaderboard | |
| CoreCognition | 52.1% | #78 of 119 | Official leaderboard | |
| MMStar | 43.1% | #133 of 173 | Official leaderboard | |
| MM-Vet | 37.8% | #132 of 164 | Official leaderboard | |
| CharXiv (DQ) | 40.8% | #56 of 67 | Official leaderboard | |
| MMBench | 64.6% | #132 of 155 | Official leaderboard | |
| A-Bench | 63.3% | #103 of 116 | Official leaderboard | |
| MMBench-EN v1.1 | 60.5% | #159 of 178 | Official leaderboard | |
| CharXiv | 18% | #71 of 77 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 17.5% | #142 of 152 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 46.1 | #144 of 173 | Official leaderboard |