Cambrian-1-34B
Cambrian-1-34B.
New York University Released June 16th, 2024 Family Cambrian-1 The lab's model card Compare with others 16
Benchmarks with a score
0
Ranked first, out of five or more models
0
In the top three
New York University Jun 2024 Cambrian-1-34B
Open weights Mid-size
No Epoch Capabilities Index score yet
- MM-Vet 53.2% #75 /164
- SEED-Bench-2-Plus 65.1% #58 /136
- CoreCognition 63.1% #9 /119
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 77.3% | #63 of 178 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CoreCognition | 63.1% | #9 of 119 | Official leaderboard | |
| VCR (Visual Caption Restoration) | 35.1% | #12 of 42 | Official leaderboard | |
| MMBench | 80.4% | #51 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 78.3% | #69 of 178 | Official leaderboard | |
| SEED-Bench-2-Plus | 65.1% | #58 of 136 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 49.2% | #67 of 152 | Official leaderboard | |
| MM-Vet | 53.2% | #75 of 164 | Official leaderboard | |
| A-Bench | 72.3% | #58 of 116 | Official leaderboard | |
| OmniBench | 46.8% | #8 of 16 | Official leaderboard | |
| MMStar | 54.2% | #90 of 173 | Official leaderboard | |
| CharXiv (DQ) | 59.7% | #35 of 67 | Official leaderboard | |
| MMMU | 49.7% | #88 of 136 | Official leaderboard | |
| CharXiv | 27.3% | #51 of 77 | Official leaderboard | |
| All-Angles Bench | 41.9% | #15 of 18 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 58.3 | #92 of 173 | Official leaderboard |