OCRBench
Models answer 1,000 checked questions on text recognition, scene text, documents, key information extraction, and handwritten math. The score counts correct answers.
OCRBench v2, released in December 2024 with 10,000 pairs, is a separate version.
- Made by
- Yuliang Liu, Xiang Bai et al.
- Released
- May 2023
- Kind
- Documents, charts and text in images
- Level
- Everyday
- Scored
- Checked automatically
- Answers
- Short answer
- Tasks
- All public
- Strongest model tested
- Kimi K2.5 #75 on the capability index
- Last in a launch post
- August 2026
- Last model added
- August 2026
- Scores refreshed
- November 12th, 2026
In the authors’ words
Large models have recently played a dominant role in natural language processing and multimodal vision-language learning. However, their effectiveness in text-related visual tasks remains relatively unexplored. In this paper, we conducted a comprehensive evaluation of Large Multimodal Models, such as GPT4V and Gemini, in various text-related visual tasks including Text Recognition, Scene Text-Centric Visual Question Answering (VQA), Document-Oriented VQA, Key Information Extraction (KIE), and Handwritten Mathematical Expression Recognition (HMER). To facilitate the assessment of Optical Character Recognition (OCR) capabilities in Large Multimodal Models, we propose OCRBench, a comprehensive evaluation benchmark. OCRBench contains 29 datasets, making it the most comprehensive OCR evaluation benchmark available. Furthermore, our study reveals both the strengths and weaknesses of these models, particularly in handling multilingual text, handwritten text, non-semantic text, and mathematical expression recognition. Most importantly, the baseline results presented in this study could provide a foundational framework for the conception and assessment of innovative strategies targeted at enhancing zero-shot multimodal techniques. The evaluation pipeline and benchmark are available at https://github.com/Yuliang-Liu/MultimodalOCR.
GLM-OCR leads with 94% among models released by August 2026
Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.
MiniCPM-V-2_6 leads with 85.2% across all independent runs
Best score per model across the official leaderboard, Epoch AI’s own runs and any board Epoch AI copied. Each bar and row names its source.
GLM-OCR leads with 94%, claims included
Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model.
The newest model with a score here came out in August 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- Claude Opus 5.5
- and 16 more
- 94.0 GLM-OCR
- 93.1
Qwen3.5 397B-A17B
- 92.3 Kimi K2.5
- 92.1
Qwen3.5-122B-A10B
- 91.3
Qwen3.5-Omni-Plus
- 91.0
Qwen3.5-35B-A3B
- 90.7
InternVL3.5-241B-A28B
- 89.4
Qwen3.5-27B
- 89.4
Qwen3.6 27B
- 89.2
Qwen3.5-9B
- 88.5
Qwen2.5-VL-72B
- 87.8
ERNIE 5.0
- 87.5
Qwen3-VL-235B-A22B
- 86.9 Kimi-VL-A3B-Thinking-2506
- 86.9
Command A Vision
- 86.8
STEP3-VL-10B
- 86.6
Nemotron 3 Nano Omni 30B-A3B
- 86.5 GLM-4.5V
- 86.5 GLM-4.6V
- 86.1
Seed1.5-VL
- 85.8
ERNIE-4.5-VL-28B-A3B-Thinking
- 85.7
Keye-VL-2.0-30B-A3B
- 85.6
Nemotron Nano 12B v2 VL
- 85.0
Qwen3.5-4B
- 84.9
LongCat-Flash-Omni
- 84.5
Qwen3.5-2B
- 84.4
Phi-4-multimodal
- 84.2 GLM-4.1V-9B-Thinking
- 84.2 LFM2.5-VL-3B
- 83.9
Llama-3.1-Nemotron-Nano-VL-8B-V1
- 79.2
North Micro Vision Instruct
- 76.0
Phi-4-Reasoning-Vision-15B
- 74.5
Qwen3.5-0.8B
- 74.2 LFM2-VL-1.6B
- 1 GLM-OCR 94%
- 2
Qwen3.5 397B-A17B 93.1%
- 3 Kimi K2.5 92.3%
- 4
Qwen3.5-122B-A10B 92.1%
- 5
Qwen3.5-Omni-Plus 91.3%
- 6
Qwen3.5-35B-A3B 91%
- 7
InternVL3.5-241B-A28B 90.7%
- 8
Qwen3.5-27B 89.4%
- 9
Qwen3.6 27B 89.4%
- 10
Qwen3.5-9B 89.2%
- 11
Qwen2.5-VL-72B 88.5%
- 12
ERNIE 5.0 87.8%
- 13
Qwen3-VL-235B-A22B 87.5%
- 14 Kimi-VL-A3B-Thinking-2506 86.9%
- 15
Command A Vision 86.9%
- 16
STEP3-VL-10B 86.8%
- 17
Nemotron 3 Nano Omni 30B-A3B 86.6%
- 18 GLM-4.5V 86.5%
- 19 GLM-4.6V 86.5%
- 20
Seed1.5-VL 86.1%
- 21
ERNIE-4.5-VL-28B-A3B-Thinking 85.8%
- 22
Keye-VL-2.0-30B-A3B 85.7%
- 23
Nemotron Nano 12B v2 VL 85.6%
- 24
Qwen3.5-4B 85%
- 25
LongCat-Flash-Omni 84.9%
- 26
Qwen3.5-2B 84.5%
- 27
Phi-4-multimodal 84.4%
- 28 GLM-4.1V-9B-Thinking 84.2%
- 29 LFM2.5-VL-3B 84.2%
- 30
Llama-3.1-Nemotron-Nano-VL-8B-V1 83.9%
- 31
North Micro Vision Instruct 79.2%
- 32
Phi-4-Reasoning-Vision-15B 76%
- 33
Qwen3.5-0.8B 74.5%
- 34 LFM2-VL-1.6B 74.2%
Source: Labs’ model cards
- 1 MiniCPM-V-2_6 85.2%
- 2 Granite Vision 3.3 2B 82.4%
- 3
InternVL2-1B 77.9%
- 4
InternVL2-4B 77.6%
- 5
InternVL2-2B 76.8%
- 6 Qwen-VL-Max 72.3%
- 7
Qwen-VL-Plus 69.4%
- 8
MiniCPM-V 2.0 60.5%
- 9 Monkey 51.4%
- 10
mPLUG-Owl2 36.6%
- 11
LLaVA-v1.5-13B 33.1%
Source: Official OCRBench leaderboard
- 94.0 GLM-OCR
- 93.1
Qwen3.5 397B-A17B
- 92.3 Kimi K2.5
- 92.1
Qwen3.5-122B-A10B
- 91.3
Qwen3.5-Omni-Plus
- 91.0
Qwen3.5-35B-A3B
- 90.7
InternVL3.5-241B-A28B
- 89.4
Qwen3.5-27B
- 89.4
Qwen3.6 27B
- 89.2
Qwen3.5-9B
- 88.5
Qwen2.5-VL-72B
- 87.8
ERNIE 5.0
- 87.5
Qwen3-VL-235B-A22B
- 86.9 Kimi-VL-A3B-Thinking-2506
- 86.9
Command A Vision
- 86.8
STEP3-VL-10B
- 86.6
Nemotron 3 Nano Omni 30B-A3B
- 86.5 GLM-4.5V
- 86.5 GLM-4.6V
- 86.1
Seed1.5-VL
- 85.8
ERNIE-4.5-VL-28B-A3B-Thinking
- 85.7
Keye-VL-2.0-30B-A3B
- 85.6
Nemotron Nano 12B v2 VL
- 85.2 MiniCPM-V-2_6
- 85.0
Qwen3.5-4B
- 84.9
LongCat-Flash-Omni
- 84.5
Qwen3.5-2B
- 84.4
Phi-4-multimodal
- 84.2 GLM-4.1V-9B-Thinking
- 84.2 LFM2.5-VL-3B
- 83.9
Llama-3.1-Nemotron-Nano-VL-8B-V1
- 82.4 Granite Vision 3.3 2B
- 79.2
North Micro Vision Instruct
- 77.9
InternVL2-1B
- 77.6
InternVL2-4B
- 76.8
InternVL2-2B
- 76.0
Phi-4-Reasoning-Vision-15B
- 74.5
Qwen3.5-0.8B
- 74.2 LFM2-VL-1.6B
- 72.3 Qwen-VL-Max
- 69.4
Qwen-VL-Plus
- 60.5
MiniCPM-V 2.0
- 51.4 Monkey
- 36.6
mPLUG-Owl2
- 33.1
LLaVA-v1.5-13B
- 1 GLM-OCR 94%
- 2
Qwen3.5 397B-A17B 93.1%
- 3 Kimi K2.5 92.3%
- 4
Qwen3.5-122B-A10B 92.1%
- 5
Qwen3.5-Omni-Plus 91.3%
- 6
Qwen3.5-35B-A3B 91%
- 7
InternVL3.5-241B-A28B 90.7%
- 8
Qwen3.5-27B 89.4%
- 9
Qwen3.6 27B 89.4%
- 10
Qwen3.5-9B 89.2%
- 11
Qwen2.5-VL-72B 88.5%
- 12
ERNIE 5.0 87.8%
- 13
Qwen3-VL-235B-A22B 87.5%
- 14 Kimi-VL-A3B-Thinking-2506 86.9%
- 15
Command A Vision 86.9%
- 16
STEP3-VL-10B 86.8%
- 17
Nemotron 3 Nano Omni 30B-A3B 86.6%
- 18 GLM-4.5V 86.5%
- 19 GLM-4.6V 86.5%
- 20
Seed1.5-VL 86.1%
- 21
ERNIE-4.5-VL-28B-A3B-Thinking 85.8%
- 22
Keye-VL-2.0-30B-A3B 85.7%
- 23
Nemotron Nano 12B v2 VL 85.6%
- 24 MiniCPM-V-2_6 85.2%
- 25
Qwen3.5-4B 85%
- 26
LongCat-Flash-Omni 84.9%
- 27
Qwen3.5-2B 84.5%
- 28
Phi-4-multimodal 84.4%
- 29 GLM-4.1V-9B-Thinking 84.2%
- 30 LFM2.5-VL-3B 84.2%
- 31
Llama-3.1-Nemotron-Nano-VL-8B-V1 83.9%
- 32 Granite Vision 3.3 2B 82.4%
- 33
North Micro Vision Instruct 79.2%
- 34
InternVL2-1B 77.9%
- 35
InternVL2-4B 77.6%
- 36
InternVL2-2B 76.8%
- 37
Phi-4-Reasoning-Vision-15B 76%
- 38
Qwen3.5-0.8B 74.5%
- 39 LFM2-VL-1.6B 74.2%
- 40 Qwen-VL-Max 72.3%
- 41
Qwen-VL-Plus 69.4%
- 42
MiniCPM-V 2.0 60.5%
- 43 Monkey 51.4%
- 44
mPLUG-Owl2 36.6%
- 45
LLaVA-v1.5-13B 33.1%
Sources: Labs’ model cards and official OCRBench leaderboard
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GLM-OCR | 94% | Jan 2026 | Lab model card | |
| 2 | | 93.1% | Feb 2026 | Lab model card | |
| 3 | Kimi K2.5 | 92.3% | Jan 2026 | Lab model card | |
| 4 | | 92.1% | Feb 2026 | Lab model card | |
| 5 | | 91.3% | Mar 2026 | Lab model card | |
| 6 | | 91% | Feb 2026 | Lab model card | |
| 7 | | 90.7% | Aug 2025 | Lab model card | |
| 8 | | 89.4% | Feb 2026 | Lab model card | |
| 9 | | 89.4% | Apr 2026 | Lab model card | |
| 10 | | 89.2% | Mar 2026 | Lab model card | |
| 11 | | 88.5% | Jan 2025 | Lab model card | |
| 12 | | 87.8% | Feb 2026 | Lab model card | |
| 13 | | 87.5% | Sep 2025 | Lab model card | |
| 14 | Kimi-VL-A3B-Thinking-2506 | 86.9% | Jun 2025 | Lab model card | |
| 15 | | 86.9% | Jul 2025 | Lab model card | |
| 16 | | 86.8% | Jan 2026 | Lab model card | |
| 17 | | 86.6% | Apr 2026 | Lab model card | |
| 18 | GLM-4.5V | 86.5% | Aug 2025 | Lab model card | |
| 19 | GLM-4.6V | 86.5% | Dec 2025 | Lab model card | |
| 20 | | 86.1% | May 2025 | Lab model card | |
| 21 | | 85.8% | Nov 2025 | Lab model card | |
| 22 | | 85.7% | May 2026 | Lab model card | |
| 23 | | 85.6% | Oct 2025 | Lab model card | |
| 24 | | 85% | Mar 2026 | Lab model card | |
| 25 | | 84.9% | Oct 2025 | Lab model card | |
| 26 | | 84.5% | Mar 2026 | Lab model card | |
| 27 | | 84.4% | Feb 2025 | Lab model card | |
| 28 | GLM-4.1V-9B-Thinking | 84.2% | Jul 2025 | Lab model card | |
| 29 | LFM2.5-VL-3B | 84.2% | Aug 2026 | Lab model card | |
| 30 | | 83.9% | Jun 2025 | Lab model card | |
| 31 | | 79.2% | Aug 2026 | Lab model card | |
| 32 | | 76% | Mar 2026 | Lab model card | |
| 33 | | 74.5% | Mar 2026 | Lab model card | |
| 34 | LFM2-VL-1.6B | 74.2% | Aug 2025 | Lab model card |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | MiniCPM-V-2_6 | 85.2% | Aug 2024 | Official leaderboard | |
| 2 | Granite Vision 3.3 2B | 82.4% | Jun 2025 | Official leaderboard | |
| 3 | | 77.9% | Jul 2024 | Official leaderboard | |
| 4 | | 77.6% | Jul 2024 | Official leaderboard | |
| 5 | | 76.8% | Jul 2024 | Official leaderboard | |
| 6 | Qwen-VL-Max | 72.3% | Jan 2024 | Official leaderboard | |
| 7 | | 69.4% | Jan 2024 | Official leaderboard | |
| 8 | | 60.5% | Apr 2024 | Official leaderboard | |
| 9 | Monkey | 51.4% | Nov 2023 | Official leaderboard | |
| 10 | | 36.6% | Nov 2023 | Official leaderboard | |
| 11 | | 33.1% | Oct 2023 | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | GLM-OCR | 94% | Jan 2026 | Lab model card | |
| 2 | | 93.1% | Feb 2026 | Lab model card | |
| 3 | Kimi K2.5 | 92.3% | Jan 2026 | Lab model card | |
| 4 | | 92.1% | Feb 2026 | Lab model card | |
| 5 | | 91.3% | Mar 2026 | Lab model card | |
| 6 | | 91% | Feb 2026 | Lab model card | |
| 7 | | 90.7% | Aug 2025 | Lab model card | |
| 8 | | 89.4% | Feb 2026 | Lab model card | |
| 9 | | 89.4% | Apr 2026 | Lab model card | |
| 10 | | 89.2% | Mar 2026 | Lab model card | |
| 11 | | 88.5% | Jan 2025 | Lab model card | |
| 12 | | 87.8% | Feb 2026 | Lab model card | |
| 13 | | 87.5% | Sep 2025 | Lab model card | |
| 14 | Kimi-VL-A3B-Thinking-2506 | 86.9% | Jun 2025 | Lab model card | |
| 15 | | 86.9% | Jul 2025 | Lab model card | |
| 16 | | 86.8% | Jan 2026 | Lab model card | |
| 17 | | 86.6% | Apr 2026 | Lab model card | |
| 18 | GLM-4.5V | 86.5% | Aug 2025 | Lab model card | |
| 19 | GLM-4.6V | 86.5% | Dec 2025 | Lab model card | |
| 20 | | 86.1% | May 2025 | Lab model card | |
| 21 | | 85.8% | Nov 2025 | Lab model card | |
| 22 | | 85.7% | May 2026 | Lab model card | |
| 23 | | 85.6% | Oct 2025 | Lab model card | |
| 24 | MiniCPM-V-2_6 | 85.2% | Aug 2024 | Official leaderboard | |
| 25 | | 85% | Mar 2026 | Lab model card | |
| 26 | | 84.9% | Oct 2025 | Lab model card | |
| 27 | | 84.5% | Mar 2026 | Lab model card | |
| 28 | | 84.4% | Feb 2025 | Lab model card | |
| 29 | GLM-4.1V-9B-Thinking | 84.2% | Jul 2025 | Lab model card | |
| 30 | LFM2.5-VL-3B | 84.2% | Aug 2026 | Lab model card | |
| 31 | | 83.9% | Jun 2025 | Lab model card | |
| 32 | Granite Vision 3.3 2B | 82.4% | Jun 2025 | Official leaderboard | |
| 33 | | 79.2% | Aug 2026 | Lab model card | |
| 34 | | 77.9% | Jul 2024 | Official leaderboard | |
| 35 | | 77.6% | Jul 2024 | Official leaderboard | |
| 36 | | 76.8% | Jul 2024 | Official leaderboard | |
| 37 | | 76% | Mar 2026 | Lab model card | |
| 38 | | 74.5% | Mar 2026 | Lab model card | |
| 39 | LFM2-VL-1.6B | 74.2% | Aug 2025 | Lab model card | |
| 40 | Qwen-VL-Max | 72.3% | Jan 2024 | Official leaderboard | |
| 41 | | 69.4% | Jan 2024 | Official leaderboard | |
| 42 | | 60.5% | Apr 2024 | Official leaderboard | |
| 43 | Monkey | 51.4% | Nov 2023 | Official leaderboard | |
| 44 | | 36.6% | Nov 2023 | Official leaderboard | |
| 45 | | 33.1% | Oct 2023 | Official leaderboard |
The benchmark's own leaderboard has 29 entries, 11 of them models we track. Switch the scores above to rank them together.
4 models have held number one in labs’ own numbers since its release in May 2023 6 models have held number one across all independent runs since its release in May 2023 10 models have held number one with claims included since its release in May 2023
Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.
Sources: Official OCRBench leaderboard and labs’ model cards
MiniCPM-V-2_6 on the official leaderboard passed 85% in August 2024
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official OCRBench leaderboard and labs’ model cards
2 labs put it in a launch post in the last six months
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Aug 12, 2026 | LFM2.5-VL-3B | 84.2 | OCRBench v1 |
| Aug 12, 2026 | 79.2 | OCRBench (0.792) | |
| May 25, 2026 | 85.7 | OCRBench | |
| Apr 22, 2026 | 89.4 | OCRBench | |
| Mar 30, 2026 | 91.3 | OCRBench | |
| Mar 4, 2026 | 76 | OCRBench (default mode) | |
| Mar 2, 2026 | 74.5 | OCRBench 74.5/79.1 (with CI / without CI) | |
| Mar 2, 2026 | 84.5 | OCRBench 84.5/85.4 (with CI / without CI) | |
| Mar 2, 2026 | 85 | OCRBench | |
| Mar 2, 2026 | 89.2 | OCRBench | |
| Feb 24, 2026 | 91 | OCRBench | |
| Feb 24, 2026 | 89.4 | OCRBench | |
| Feb 24, 2026 | 92.1 | OCRBench | |
| Feb 16, 2026 | 93.1 | OCRBench | |
| Feb 6, 2026 | 87.8 | OCRBench 878 (out of 1000) | |
| Jan 30, 2026 | GLM-OCR | 94 | OCRBench (Text) |
| Jan 27, 2026 | Kimi K2.5 | 92.3 | OCRBench |
| Jan 13, 2026 | 86.8 | OCRBench | |
| Dec 8, 2025 | GLM-4.6V | 86.5 | OCRBench |
| Nov 11, 2025 | 85.8 | OCRBench 858 (out of 1000) | |
| Oct 31, 2025 | 84.9 | OCRBench | |
| Oct 28, 2025 | 85.6 | OCRBench | |
| Sep 23, 2025 | 87.5 | OCRBench 875.0 (out of 1000) | |
| Aug 25, 2025 | 90.7 | OCRBench | |
| Aug 12, 2025 | LFM2-VL-1.6B | 74.2 | OCRBench 742 of 1000 |
| Aug 11, 2025 | GLM-4.5V | 86.5 | OCRBench |
| Jul 31, 2025 | 86.9 | OCRBench | |
| Jul 1, 2025 | GLM-4.1V-9B-Thinking | 84.2 | OCRBench |
| Jun 21, 2025 | Kimi-VL-A3B-Thinking-2506 | 86.9 | OCRBench (Acc) 869 |
| Jun 3, 2025 | 83.9 | OCRBench 839 (out of 1000) | |
| May 12, 2025 | 86.1 | OCRBench | |
| Mar 16, 2025 | OCRBench | ||
| Feb 26, 2025 | 84.4 | OCR Bench | |
| Jan 28, 2025 | 88.5 | OCRBench 885 (out of 1000) |
20 system cards report it, from 12 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Jun 9, 2026 | | 85.7 | OCRBench (Figure 5, printed value) | Capabilities |
| Apr 27, 2026 | | 86.6 | OCRBench, reasoning on, 88.3 reasoning off (Table 7) | Capabilities |
| Apr 17, 2026 | | 91.3 | OCRBench (Table 6) | Capabilities |
| Mar 11, 2026 | GLM-OCR technical report | OCRBench (Text), text recognition part only, 94.0, no full OCRBench score (Table 3) | Capabilities | |
| Mar 4, 2026 | | 76 | OCRBench, default mode, 75.6 force nothink, 73.7 force thinking (Tables 5 and 6) | Capabilities |
| Feb 4, 2026 | | 87.8 | OCRBench 878 out of 1000 (Table 3) | Capabilities |
| Jan 30, 2026 | Kimi K2.5 technical report | 92.3 | OCRBench (Table 4) | Capabilities |
| Jan 14, 2026 | | 86.8 | OCRBench, SeRe (Tables 1 and 3). PaCoRe 89.00 | Capabilities |
| Jan 1, 2026 | GLM-4.6V technical report | 86.5 | OCRBench, GLM-4.6V thinking (Table 2) | Capabilities |
| Nov 28, 2025 | LFM2-VL-1.6B technical report | 72.9 | OCRBench 729 of 1000, LFM2-VL-1.6B (Table 8) | Capabilities |
| Nov 26, 2025 | | 87.5 | OCRBench 875 of 1000, recorded as 87.5% (Table 2) | Capabilities |
| Nov 6, 2025 | | 83.5 | OCRBench, reasoning on (Table 3). Reasoning off 85.6 | Capabilities |
| Oct 31, 2025 | | 84.9 | OCRBench (Table 5) | Capabilities |
| Aug 25, 2025 | | 90.7 | OCRBench 907 out of 1000 (Table 2, Table 4) | Capabilities |
| Aug 13, 2025 | GLM-4.5V technical report | 86.5 | OCRBench, GLM-4.5V thinking (Table 2) | Capabilities |
| Jul 1, 2025 | GLM-4.1V-9B-Thinking technical report | 84.2 | OCRBench, GLM-4.1V-9B-Thinking thinking (Table 2) | Capabilities |
| Jun 23, 2025 | Kimi-VL-A3B-Thinking-2506 technical report | 86.9 | OCRBench (Acc) 869 out of 1000 (Table 5) | Capabilities |
| May 11, 2025 | | 86.1 | OCRBench 861 of 1000, thinking, recorded as 86.1% (Table 6). Non-thinking 881 | Capabilities |
| Mar 3, 2025 | | 84.4 | OCRBench (Table 1) | Capabilities |
| Feb 19, 2025 | | 88.5 | OCRBench 885 of 1000, recorded as 88.5% (Table 5) | Capabilities |
Versions
We switch the top row to each new version when it comes out. Open it for one row per version. An old version stays in play while people still test it, so whoever first takes it past 85% gets credit for closing it out.
Sources: Official leaderboards and labs’ model cards
More in Vision
- MMMU In use 11.5K college-level multimodal questions across 30 subjects. Multiple-choice and open accuracy. GPT-5.1 85.4%
- MMMU-Pro In use Harder MMMU: college-level multimodal questions with more options and vision-only inputs to remove text shortcuts. GPT-5.6 Sol 84.6%
- CharXiv In use Chart understanding on real arXiv figures. Reasoning questions require synthesizing information from complex charts. Claude Fable 5 93.5%
- MATH-Vision (MathVision) In use 3,040 competition math problems with visual context. Answer accuracy.
Qwen 3.8 Max 97.7%
- MMStar In use Models answer 1,500 human-curated image questions that cannot be solved without the image, across 6 core capabilities. Scored by accuracy.
Qwen 3.8 Max 85.9%
- ChartQA In use Models answer human-written and generated questions about chart images that need visual and arithmetic reasoning. Scored by relaxed accuracy with a 5 percent numeric tolerance.
Command A Vision 90.9%