Qwen-VL-Max
Qwen-VL-Max ranks first on 2 of the 36 benchmarks with five or more models scored.
Released January 18th, 2024 Compare with others
36
Benchmarks with a score
2
Ranked first, out of five or more models
9
In the top three
Unknown lab Jan 2024
Qwen-VL-Max
No Epoch Capabilities Index score yet
- Video SimpleQA 39.9% #4 /27
- HR-Bench 55.5% #7 /8
- CC-OCR-Bench-V2 57.6% #12 /15
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Video SimpleQA | 39.9% | #4 of 27 | Official leaderboard | |
| MMBench-CN v1.1 | 73.7% | #83 of 178 | Official leaderboard |
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OlympiadBench | 10.1% | #2 of 6 | Official leaderboard | |
| OlympicArena | 21.4% | #12 of 25 | Official leaderboard |
Agents and tools
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| SnakeBench | 28 | #55 of 188 | Official leaderboard | |
| VisualAgentBench | 2.70% | #5 of 5 | Official leaderboard |
Professional work
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| GMAI-MMBench | 42.2% | #3 of 13 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| CoreCognition | 67.9% | #3 of 119 | Official leaderboard | |
| MME | 1790.0 | #1 of 17 | Official leaderboard | |
| MMT-Bench | 62.4% | #1 of 15 | Official leaderboard | |
| SpatialViz-Bench | 36.1% | #2 of 14 | Official leaderboard | |
| MathVerse | 25.3% | #2 of 9 | Official leaderboard | |
| CCBench (MMBench Chinese Culture) | 63.5% | #34 of 152 | Official leaderboard | |
| MM-Vet | 61.8% | #47 of 164 | Official leaderboard | |
| ERQA | 39.3% | #6 of 17 | Official leaderboard | |
| LongDocURL | 49.5% | #2 of 5 | Official leaderboard | |
| MMBench | 77.6% | #71 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 75.4% | #87 of 178 | Official leaderboard | |
| SEED-Bench-2-Plus | 61.6% | #70 of 136 | Official leaderboard | |
| BLINK | 41.9% | #6 of 11 | Official leaderboard | |
| OCRBench | 72.3% | #6 of 11 | Official leaderboard | |
| MTVQA-Test | 21.1% | #10 of 18 | Official leaderboard | |
| MMMU | 51.4% | #79 of 136 | Official leaderboard | |
| MMStar | 49.5% | #107 of 173 | Official leaderboard | |
| Vision Arena | 1,185 | #88 of 136 | Official leaderboard | |
| MLVU | 34.2% | #6 of 9 | Official leaderboard | |
| CharXiv | 24.7% | #57 of 77 | Official leaderboard | |
| CompassArena Multimodal | 1,071 | #6 of 8 | Official leaderboard | |
| CC-OCR-Bench-V2 | 57.6% | #12 of 15 | Official leaderboard | |
| CharXiv (DQ) | 41.5% | #55 of 67 | Official leaderboard | |
| HR-Bench | 55.5% | #7 of 8 | Official leaderboard | |
| Video-MME | 51.3% | #23 of 26 | Official leaderboard | |
| We-Math | 10.5% | #19 of 21 | Official leaderboard | |
| MATH-Vision (MathVision) | 15.6% | #96 of 105 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Video-SafetyBench | 1.80 | #3 of 15 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 58.4 | #91 of 173 | Official leaderboard |