Benchmark Almanac

InfographicVQA

Kimi K2.5 92.6% leads since January 2026
In use

Models answer about 30,000 questions on about 5,000 infographics that mix text, layout, charts, and graphics. Scoring is ANLS.

Released
April 2021
Kind
Documents, charts and text in images
Level
School
Scored
Checked automatically
Answers
Short answer
Tasks
All public
Strongest model tested
Kimi K2.5 #75 on the capability index
Last in a launch post
August 2026
Last model added
August 2026

In the authors’ words

Infographics are documents designed to effectively communicate information using a combination of textual, graphical and visual elements. In this work, we explore the automatic understanding of infographic images by using Visual Question Answering technique.To this end, we present InfographicVQA, a new dataset that comprises a diverse collection of infographics along with natural language questions and answers annotations. The collected questions require methods to jointly reason over the document layout, textual content, graphical elements, and data visualizations. We curate the dataset with emphasis on questions that require elementary reasoning and basic arithmetic skills. Finally, we evaluate two strong baselines based on state of the art multi-modal VQA models, and establish baseline performance for the new task. The dataset, code and leaderboard will be made available at http://docvqa.org

Abstract of InfographicVQA (arXiv:2104.12756, CC0)
26
Models scored in lab cards
15
Launch posts list it, from 9 labs
18
System cards report it, from 8 labs

Kimi K2.5 leads with 92.6% among models released by August 2026

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

The newest model with a score here came out in August 2026, and nobody has reported a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

26 models. Scroll sideways for the rest.

  1. 92.6 Kimi K2.5
  2. 92.0 Gemma 4 31B IT
  3. 91.2 Seed1.5-VL
  4. 89.5 Qwen3-VL-235B-A22B
  5. 89.3 Gemma 4 26B A4B
  6. 88.0 Seed1.6-Thinking
  7. 87.3 Qwen2.5-VL-72B
  8. 86.8 Nemotron 3 Nano Omni 30B-A3B
  9. 82.9 Command A Vision
  10. 82.0 InternVL3.5-241B-A28B
  11. 81.8 Cosmos3-Nano
  12. 81.0 Gemini 1.5 Pro
  13. 80.4 Nemotron Nano 12B v2 VL
  14. 80.3 Gemini 1.0 Ultra
  15. 77.4 Llama-3.1-Nemotron-Nano-VL-8B-V1
  16. 72.7 Gemini 1.5 Pro
  17. 72.7 Phi-4-multimodal
  18. 70.6 Gemma 3 27B
  19. 70.2 LFM2.5-VL-3B
  20. 70.0 Gemma 4 E4B
  21. 65.2 North Micro Vision Instruct
  22. 64.9 Gemma 3 12B
  23. 63.9 Gemma 4 E2B
  24. 60.1 Cosmos3-Edge
  25. 58.7 LFM2-VL-1.6B
  26. 50.0 Gemma 3 4B
  1. 1 Kimi K2.5 92.6%
  2. 2 Gemma 4 31B IT 92%
  3. 3 Seed1.5-VL 91.2%
  4. 4 Qwen3-VL-235B-A22B 89.5%
  5. 5 Gemma 4 26B A4B 89.3%
  6. 6 Seed1.6-Thinking 88%
  7. 7 Qwen2.5-VL-72B 87.3%
  8. 8 Nemotron 3 Nano Omni 30B-A3B 86.8%
  9. 9 Command A Vision 82.9%
  10. 10 InternVL3.5-241B-A28B 82%
  11. 11 Cosmos3-Nano 81.8%
  12. 12 Gemini 1.5 Pro May 2024 81%
  13. 13 Nemotron Nano 12B v2 VL 80.4%
  14. 14 Gemini 1.0 Ultra 80.3%
  15. 15 Llama-3.1-Nemotron-Nano-VL-8B-V1 77.4%
  16. 16 Gemini 1.5 Pro Feb 2024 72.7%
  17. 17 Phi-4-multimodal 72.7%
  18. 18 Gemma 3 27B 70.6%
  19. 19 LFM2.5-VL-3B 70.2%
  20. 20 Gemma 4 E4B 70%
  21. 21 North Micro Vision Instruct 65.2%
  22. 22 Gemma 3 12B 64.9%
  23. 23 Gemma 4 E2B 63.9%
  24. 24 Cosmos3-Edge 60.1%
  25. 25 LFM2-VL-1.6B 58.7%
  26. 26 Gemma 3 4B 50%

Source: Labs’ model cards

#ModelScoreSettingDateSource
1 Kimi K2.5 92.6% Jan 2026 Lab model card
2 Gemma 4 31B IT 92% Jul 2026 Lab model card
3 Seed1.5-VL 91.2% May 2025 Lab model card
4 Qwen3-VL-235B-A22B 89.5% Sep 2025 Lab model card
5 Gemma 4 26B A4B 89.3% Jul 2026 Lab model card
6 Seed1.6-Thinking 88% Jun 2025 Lab model card
7 Qwen2.5-VL-72B 87.3% Feb 2025 Lab model card
8 Nemotron 3 Nano Omni 30B-A3B 86.8% Apr 2026 Lab model card
9 Command A Vision 82.9% Jul 2025 Lab model card
10 InternVL3.5-241B-A28B 82% Aug 2025 Lab model card
11 Cosmos3-Nano 81.8% May 2026 Lab model card
12 Gemini 1.5 Pro May 2024 81% May 2024 Lab model card
13 Nemotron Nano 12B v2 VL 80.4% Nov 2025 Lab model card
14 Gemini 1.0 Ultra 80.3% Dec 2023 Lab model card
15 Llama-3.1-Nemotron-Nano-VL-8B-V1 77.4% Jun 2025 Lab model card
16 Gemini 1.5 Pro Feb 2024 72.7% Feb 2024 Lab model card
17 Phi-4-multimodal 72.7% Feb 2025 Lab model card
18 Gemma 3 27B 70.6% Mar 2025 Lab model card
19 LFM2.5-VL-3B 70.2% Aug 2026 Lab model card
20 Gemma 4 E4B 70% Jul 2026 Lab model card
21 North Micro Vision Instruct 65.2% Aug 2026 Lab model card
22 Gemma 3 12B 64.9% Mar 2025 Lab model card
23 Gemma 4 E2B 63.9% Jul 2026 Lab model card
24 Cosmos3-Edge 60.1% May 2026 Lab model card
25 LFM2-VL-1.6B 58.7% Aug 2025 Lab model card
26 Gemma 3 4B 50% Mar 2025 Lab model card

5 models have held number one in labs’ own numbers since 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

Google DeepMind Qwen ByteDance Seed Moonshot AI
Lab claims Passed 85% in Feb 2025, by Qwen2.5-VL-72B
Kimi K2.5 92.6%

Source: Labs’ model cards

Qwen’s own number for Qwen2.5-VL-72B passed 85% in February 2025

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card Best so far
0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) Kimi K2.5 Seed1.5-VL Gemini 1.5 Pro 0% 20% 40% 60% 80% 100% 2024 2025 2026 Near the ceiling (85%) Kimi K2.5 Gemini 1.5 Pro

Source: Labs’ model cards

2 labs put it in a launch post in the last six months

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

OpenAI
Google DeepMind
Microsoft
ByteDance Seed
NVIDIA
Cohere
Liquid AI
Qwen
Moonshot AI
DateLaunch postScoreAs the post writes it
Aug 12, 2026 LFM2.5-VL-3B 70.2 InfographicVQA (val)
Aug 12, 2026 North Micro Vision Instruct 65.2 InfoVQA VAL
Jan 27, 2026 Kimi K2.5 92.6 InfoVQA (val)
Sep 23, 2025 Qwen3-VL-235B-A22B 89.5 InfoVQA_TEST
Aug 12, 2025 LFM2-VL-1.6B 58.7 InfoVQA (Val)
Jul 31, 2025 Command A Vision 82.9 InfoVQA
Jun 25, 2025 Seed1.6-Thinking 88 Infographic VQA
Jun 3, 2025 Llama-3.1-Nemotron-Nano-VL-8B-V1 77.4 InfoVQA Val
May 12, 2025 Seed1.5-VL 91.2 InfographicVQA
Mar 12, 2025 Gemma 3 27B 70.6 InfoVQA (IT); PT InfoVQA (val) = 59.4
Feb 26, 2025 Phi-4-multimodal 72.7 InfoVQA
May 14, 2024 Gemini 1.5 Pro 81 InfographicVQA (test), 0-shot (ANLS)
Feb 15, 2024 Gemini 1.5 Pro 72.7 InfographicVQA (test), 0-shot (ANLS)
Dec 6, 2023 Gemini 1.0 Ultra 80.3 InfographicVQA (test)
Mar 14, 2023 GPT-4 75.1 Infographic VQA ANLS score (test) 0-shot (pixel-only)

18 system cards report it, from 8 labs

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

DateDocumentScoreAs the document writes itSection
Jul 24, 2026 Gemma 4 E4B technical report 70 InfographicVQA, max resolution, thinking (Table 6) Capabilities
Jul 24, 2026 Gemma 4 E2B technical report 63.9 InfographicVQA, max resolution, thinking (Table 6) Capabilities
Jul 24, 2026 Gemma 4 31B IT technical report 92 InfographicVQA, thinking, max resolution (Table 6) Capabilities
Jul 24, 2026 Gemma 4 26B A4B technical report 89.3 InfographicVQA, thinking, max resolution (Table 6) Capabilities
May 31, 2026 Cosmos3-Nano technical report 81.8 InfoVQA, Cosmos3-Nano 8B column, Table 10 Capabilities
May 31, 2026 Cosmos3-Edge technical report 60.1 InfoVQA, Cosmos3-Edge 2B column, Table 10 Capabilities
Apr 27, 2026 Nemotron 3 Nano Omni 30B-A3B technical report 86.8 InfoVQA (Test), reasoning on, 83.6 reasoning off (Table 7) Capabilities
Jan 30, 2026 Kimi K2.5 technical report 92.6 InfoVQA (test) (Table 4) Capabilities
Nov 28, 2025 LFM2-VL-1.6B technical report 58.4 InfoVQA (val), LFM2-VL-1.6B (Table 8) Capabilities
Nov 26, 2025 Qwen3-VL-235B-A22B technical report 89.5 InfoVQA test (Table 2) Capabilities
Nov 6, 2025 Nemotron Nano 12B v2 VL technical report 80.4 InfoVQA (Test), reasoning on (Table 3). Reasoning off 79.4 Capabilities
Aug 25, 2025 InternVL3.5-241B-A28B technical report 82 InfoVQA (test) (Table 4) Capabilities
May 11, 2025 Seed1.5-VL technical report 91.2 InfographicVQA, thinking (Table 6). Non-thinking 89.3 Capabilities
Mar 25, 2025 Gemma 3 4B technical report 50 InfoVQA, IT, P&S applied (Table 16) Capabilities
Mar 25, 2025 Gemma 3 27B technical report 70.6 InfoVQA, IT, P&S applied (Table 16) Capabilities
Mar 25, 2025 Gemma 3 12B technical report 64.9 InfoVQA, IT, P&S applied (Table 16) Capabilities
Mar 3, 2025 Phi-4-multimodal technical report 72.7 InfoVQA (test) (Table 1). Speech-prompt ShareGPT4o InfoVQA 63.7 (Table 2) Capabilities
Feb 19, 2025 Qwen2.5-VL-72B technical report 87.3 InfoVQA test (Table 5) Capabilities

More in Vision

All 281 in Vision
  • MMMU In use 11.5K college-level multimodal questions across 30 subjects. Multiple-choice and open accuracy. GPT-5.1 85.4%
  • MMMU-Pro In use Harder MMMU: college-level multimodal questions with more options and vision-only inputs to remove text shortcuts. GPT-5.6 Sol 84.6%
  • CharXiv In use Chart understanding on real arXiv figures. Reasoning questions require synthesizing information from complex charts. Claude Fable 5 93.5%
  • MATH-Vision (MathVision) In use 3,040 competition math problems with visual context. Answer accuracy. Qwen 3.8 Max 97.7%
  • MMStar In use Models answer 1,500 human-curated image questions that cannot be solved without the image, across 6 core capabilities. Scored by accuracy. Qwen 3.8 Max 85.9%
  • ChartQA In use Models answer human-written and generated questions about chart images that need visual and arithmetic reasoning. Scored by relaxed accuracy with a 5 percent numeric tolerance. Command A Vision 90.9%