InternVL2_5-78B
InternVL2_5-78B ranks first on MTVQA-Test.
35
Benchmarks with a score
1
Ranked first, out of five or more models
7
In the top three
Shanghai AI Lab Dec 2024 InternVL2_5-78B
Open weights
No Epoch Capabilities Index score yet
- HumanEval-V 21.7% #5 /24
- VCR-Bench 30.9% #5 /9
- EMMA 33.5% #4 /7
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Knowledge and language
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench-CN v1.1 | 87.8% | #3 of 178 | Official leaderboard | |
| Creation-MMBench | -16.43 | #10 of 19 | Official leaderboard | |
| SimpleVQA | 41.5% | #7 of 13 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| HumanEval-V | 21.7% | #5 of 24 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| MMBench | 88.2% | #4 of 155 | Official leaderboard | |
| MMBench-EN v1.1 | 87.3% | #5 of 178 | Official leaderboard | |
| MTVQA-Test | 31.9% | #1 of 18 | Official leaderboard | |
| CoreCognition | 63.6% | #8 of 119 | Official leaderboard | |
| MMStar | 69.5% | #12 of 173 | Official leaderboard | |
| MMBench-Video | 1.98 | #2 of 28 | Official leaderboard | |
| VRBench | 62.3% | #2 of 19 | Official leaderboard | |
| EmbodiedBench EB-Habitat | 49% | #3 of 17 | Official leaderboard | |
| MMMU | 70.1% | #33 of 136 | Official leaderboard | |
| Video-MME | 74% | #7 of 26 | Official leaderboard | |
| CharXiv | 42.4% | #21 of 77 | Official leaderboard | |
| All-Angles Bench | 52.5% | #5 of 18 | Official leaderboard | |
| EmbodiedBench EB-ALFRED | 37.7% | #5 of 17 | Official leaderboard | |
| SpaCE-10 | 47.1% | #11 of 36 | Official leaderboard | |
| LVBench | 43.6% | #3 of 9 | Official leaderboard | |
| OST-Bench | 51.1% | #2 of 6 | Official leaderboard | |
| EmbodiedBench EB-Manipulation | 18% | #6 of 17 | Official leaderboard | |
| LEGO-Puzzles | 45.7% | #6 of 16 | Official leaderboard | |
| CSVQA | 28.4% | #5 of 12 | Official leaderboard | |
| MMMU-Pro | 48.6% | #26 of 57 | Official leaderboard | |
| MMSI-Bench | 28.5% | #13 of 28 | Official leaderboard | |
| VisuLogic | 27.3% | #8 of 17 | Official leaderboard | |
| MotionBench | 61% | #6 of 12 | Official leaderboard | |
| EmbodiedBench EB-Navigation | 30.7% | #9 of 17 | Official leaderboard | |
| VCR-Bench | 30.9% | #5 of 9 | Official leaderboard | |
| EMMA | 33.5% | #4 of 7 | Official leaderboard | |
| MATH-Vision (MathVision) | 32.2% | #70 of 105 | Official leaderboard | |
| EmoBench-M | 52.4% | #12 of 15 | Official leaderboard | |
| MM-Vet | 16.9% | #162 of 164 | Official leaderboard |
Safety and security
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Video-SafetyBench | 1.90 | #5 of 15 | Official leaderboard |
Other
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OpenVLM Leaderboard | 68.3 | #42 of 173 | Official leaderboard |