Molmo-7B-D
Molmo-7B-D places in the top three on xMMMU.
17
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Ai2 Sep 2024 Molmo-7B-D
Open weights Small
No Epoch Capabilities Index score yet
- HumanEval-V 2.80% #22 /24
- Point-Bench 61.6% #5 /17
- MM-Vet 41.5% #116 /164
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 71.6% | #91 of 178 | Official leaderboard | |
| Kaleidoscope | 32.9% | #7 of 7 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval-V | 2.80% | #22 of 24 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SEED-Bench-2-Plus | 67.6% | #32 of 136 | Official leaderboard | |
| CoreCognition | 59.9% | #31 of 119 | Official leaderboard | |
| Point-Bench | 61.6% | #5 of 17 | Official leaderboard | |
| A-Bench | 73.8% | #43 of 116 | Official leaderboard | |
| MMStar | 56.1% | #74 of 173 | Official leaderboard | |
| MMBench | 73.6% | #93 of 155 | Official leaderboard | |
| xMMMU | 40.4% | #3 of 5 | Official leaderboard | |
| MMBench-EN v1.1 | 70.3% | #117 of 178 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 36.7% | #101 of 152 | Official leaderboard | |
| CharXiv | 26.4% | #53 of 77 | Official leaderboard | |
| CharXiv (DQ) | 52.7% | #47 of 67 | Official leaderboard | |
| MM-Vet | 41.5% | #116 of 164 | Official leaderboard | |
| Vision Arena | 994 | #130 of 136 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 57.4 | #97 of 173 | Official leaderboard |