Cambrian-1-8B
Cambrian-1-8B.
New York University Released June 16th, 2024 Family Cambrian-1 The lab's model card Compare with others 17
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
New York University Jun 2024 Cambrian-1-8B
Open weights Small
No Epoch Capabilities Index score yet
- VisualPuzzles 28.9% #25 /29
- MM-Vet 48% #94 /164
- SEED-Bench-2-Plus 59.7% #82 /136
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 64.9% | #125 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CoreCognition | 60.3% | #28 of 119 | Official leaderboard | |
| 3DSRBench | 44.1% | #2 of 4 | Official leaderboard | |
| MMBench | 74.6% | #82 of 155 | Official leaderboard | |
| MM-Vet | 48% | #94 of 164 | Official leaderboard | |
| MMStar | 50.7% | #100 of 173 | Official leaderboard | |
| SEED-Bench-2-Plus | 59.7% | #82 of 136 | Official leaderboard | |
| MMBench-EN v1.1 | 71.6% | #110 of 178 | Official leaderboard | |
| A-Bench | 68.6% | #81 of 116 | Official leaderboard | |
| OmniBench | 42.1% | #12 of 16 | Official leaderboard | |
| MMMU | 42.7% | #110 of 136 | Official leaderboard | |
| VisualPuzzles | 28.9% | #25 of 29 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 23.7% | #132 of 152 | Official leaderboard | |
| SpaCE-10 | 29.5% | #34 of 36 | Official leaderboard | |
| All-Angles Bench | 39.2% | #17 of 18 | Official leaderboard | |
| xMMMU | 33.2% | #5 of 5 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 52.9 | #118 of 173 | Official leaderboard |