Gemini 1.0 Pro Vision
Gemini 1.0 Pro Vision places in the top three on ScienceQA.
8
Benchmarks with a score
0
Ranked first, out of five or more models
1
In the top three
Google DeepMind Jan 2024 Gemini 1.0 Pro Vision
Closed weights
No Epoch Capabilities Index score yet
- ZeroBench 2.00% #62 /76
- OlympicArena 21% #13 /25
- OlympiadBench 4.22% #4 /6
Where it ranks
Its best score on each benchmark, and where that ranks among every model with a score there. We rank each model once, at its best setting.
Math and science
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| OlympicArena | 21% | #13 of 25 | Official leaderboard | |
| OlympiadBench | 4.22% | #4 of 6 | Official leaderboard |
Coding
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| Design2Code | 84.4 | #4 of 5 | Official leaderboard |
Vision, audio and robotics
| Benchmark | Score | Rank | Source | |
|---|---|---|---|---|
| ScienceQA | 79.7% | #3 of 17 | Claim in Phi-3 Technical Report: A Highly Capable Language Model L…, via Epoch AI | |
| OpenEQA | 44.9 | #1 of 2 | Official leaderboard | |
| Image2Struct | 47.4 | #10 of 18 | Official leaderboard | |
| VHELM | 32.1 | #31 of 41 | Official leaderboard | |
| ZeroBench | 2.00% | #62 of 76 | Official leaderboard |