Benchmark Almanac

OCR-VQA

Kimi-VL-A3B-Instruct 82% leads since April 2025
Not in model cards

Models answer questions about book covers by reading visible text. The benchmark compares answers with facts such as a book’s title or author.

Made by
Anand Mishra and colleagues
Released
September 2019
Kind
Documents, charts and text in images
Level
School
Scored
Checked automatically
Answers
Short answer
Tasks
All public
Measures
Capability
Language
English
In and out
Images, Text → Text
Interaction
Single turn
Items from
Real work and use
Refresh
One fixed set
Run by
Anyone
In views
Vision
Strongest model tested
GPT-4.1 #138 on the capability index
Last model added
April 2025
Scores refreshed
November 20th, 2026
118
Entries on OpenCompass’s leaderboard, 80 models we track

Kimi-VL-A3B-Instruct leads with 82% among models released by April 2025 Kimi-VL-A3B-Instruct leads with 82% among models released by April 2025

Best score per entry from OpenCompass’s leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.

The newest model with a score here came out in April 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

118 entries. Scroll sideways for the rest.

  1. 82.0 Kimi-VL-A3B-Instruct
  2. 80.9 MUG-U-7B
  3. 75.1 Ovis1.6-Gemma2-27B
  4. 73.7 Qwen2-VL-72B-Instruct
  5. 73.5 Taiyi
  6. 71.2 Ovis1.5-Llama3-8B
  7. 71.2 Ovis1.6-Gemma2-9B
  8. 70.3 H2OVL-2B
  9. 68.2 Cambrian-1-34B
  10. 67.5 Qwen-VL
  11. 67.0 Monkey
  12. 67.0 DeepSeek-VL-7B-Chat
  13. 66.7 Ovis1.6-Llama3.2-3B
  14. 66.3 CogVLM-17B-Chat
  15. 66.3 LLaVA-v1.6-34B
  16. 66.0 Cambrian-1-8B
  17. 65.3 llava-v1.6-vicuna-13b
  18. 65.2 mPLUG-Owl2
  19. 65.0 Eagle-X5-13B
  20. 64.9 CogVLM2-19B-Chat
  21. 64.7 LLaVA-OneVision 7B (SI)
  22. 64.7 Pixtral 12B
  23. 64.7 BlueLM-V-3B
  24. 64.6 MMAlaya2
  25. 64.4 Monkey-Chat
  26. 64.3 ShareGPT4V-13B
  27. 64.3 Eagle-X5-7B
  28. 64.2 InternVL-Chat-V1-5
  29. 63.8 llava-v1.6-vicuna-7b
  30. 63.8 Bunny-Llama-3-8B-V
  31. 63.4 LLaVA-v1.5-13B
  32. 63.4 ShareGPT4V-7B
  33. 63.4 LLaVA-v1.5-13B (QLoRA)
  34. 63.3 Aquila-VL-2B
  35. 63.2 LLaVA-Next-Qwen-32B
  36. 62.9 InternLM-XComposer2
  37. 62.6 Mantis-8B-Idefics2
  38. 61.9 Phi-3-vision-128k-instruct
  39. 61.4 Falcon2-11B-VLM
  40. 61.3 LLaVA-LLaMA-3-8B
  41. 61.2 LLaVA-InternLM2-20B (QLoRA)
  42. 61.2 llava-v1.6-mistral-7b
  43. 61.0 LLaVA-v1.5-7B (QLoRA)
  44. 60.9 TransCore-M
  45. 60.7 llama3-llava-next-8b
  46. 60.6 llava-v1.5-7b
  47. 60.6 LLaVA-NeXT-Interleave-7B
  48. 60.2 Phi-4-multimodal
  49. 59.6 Moondream1
  50. 59.1 OmniLMM-12B
  51. 58.6 Qwen-VL-Chat
  52. 58.5 Mantis-8B-siglip-llama3
  53. 58.1 DeepSeek-VL-1.3B-Chat
  54. 58.1 POINTS-Qwen2.5-7B
  55. 58.1 AKI-4B
  56. 58.0 LLaVA-InternLM2-7B (QLoRA)
  57. 57.8 PaliGemma-3B-mix-448
  58. 57.6 LLaVA-InternLM-7B (QLoRA)
  59. 57.3 LLaVA-NeXT-Interleave-7B-DPO
  60. 56.9 LLaVA-OneVision 0.5B (SI)
  61. 56.8 Vintern-3B-beta
  62. 56.4 MiniCPM-V
  63. 56.3 POINTS-Yi-1.5-9B
  64. 55.8 MiniCPM-V 2.0
  65. 55.0 Qwen-VL-Max
  66. 54.5 InternLM-XComposer
  67. 54.2 Mantis-8B-Fuyu
  68. 51.0 MMAlaya
  69. 51.0 Slime-13B
  70. 50.2 instructblip-vicuna-7b
  71. 50.2 ShareCaptioner
  72. 50.0 H2OVL-800M
  73. 49.5 Yi-VL-6B
  74. 49.0 Slime-7B
  75. 47.9 Slime-8B
  76. 43.7 InternVL2-Llama3-76B
  77. 43.4 InternVL2-26B
  78. 42.9 InternVL2-40B
  79. 42.6 InternVL2-8B
  80. 42.4 Yi-VL-34B
  81. 41.0 Emu2-Chat
  82. 38.9 InternVL3-8B
  83. 38.8 Qwen-VL-Plus
  84. 36.0 GPT-4.1 nano
  85. 30.5 InternVL3-14B
  86. 28.6 MolmoE-1B
  87. 27.6 Gemma 3 4B
  88. 26.3 GPT-4.1 mini
  89. 21.4 InternVL3-1B
  90. 19.1 InternVL3-2B
  91. 18.7 GPT-4.1
  92. 18.5 Gemini 1.5 Flash
  93. 17.7 Gemma 3 12B
  94. 15.9 Molmo-7B-D
  95. 15.1 Molmo-7B-O
  96. 13.5 Gemma 3 27B
  97. 12.3 Gemini 1.0 Pro
  98. 11.7 Janus-1.3B
  99. 9.00 Chameleon-7B
  100. 8.90 OpenFlamingo v2
  101. 3.70 Chameleon-30B
  102. 2.90 Kosmos-2
  103. 0.50 SmolVLM-Synthetic
  104. 0.30 MiniGPT-4-v1-7B
  105. 0.20 SmolVLM2-256M-Video-Instruct
  106. 0.10 SmolVLM-Instruct
  107. 0.10 SmolVLM-Instruct-DPO
  108. 0.0 VisualGLM
  109. 0.0 PandaGPT-13B
  110. 0.0 IDEFICS-9B-Instruct
  111. 0.0 IDEFICS-80B-Instruct
  112. 0.0 MiniGPT-4-v2
  113. 0.0 GPT-4v (1106, detail-low)
  114. 0.0 Idefics3-8B-Llama3
  115. 0.0 SmolVLM-256M-Instruct
  116. 0.0 SmolVLM-500M-Instruct
  117. 0.0 SmolVLM2-2.2B-Instruct
  118. 0.0 SmolVLM2-500M-Video-Instruct
  1. 1 Kimi-VL-A3B-Instruct ✓ 82%
  2. 2 MUG-U-7B ✓ 80.9%
  3. 3 Ovis1.6-Gemma2-27B ✓ 75.1%
  4. 4 Qwen2-VL-72B-Instruct ✓ 73.7%
  5. 5 Taiyi ✓ 73.5%
  6. 6 Ovis1.5-Llama3-8B ✓ 71.2%
  7. 7 Ovis1.6-Gemma2-9B ✓ 71.2%
  8. 8 H2OVL-2B ✓ 70.3%
  9. 9 Cambrian-1-34B ✓ 68.2%
  10. 10 Qwen-VL ✓ 67.5%
  11. 11 Monkey ✓ 67%
  12. 12 DeepSeek-VL-7B-Chat ✓ 67%
  13. 13 Ovis1.6-Llama3.2-3B ✓ 66.7%
  14. 14 CogVLM-17B-Chat ✓ 66.3%
  15. 15 LLaVA-v1.6-34B ✓ 66.3%
  16. 16 Cambrian-1-8B ✓ 66%
  17. 17 llava-v1.6-vicuna-13b ✓ 65.3%
  18. 18 mPLUG-Owl2 ✓ 65.2%
  19. 19 Eagle-X5-13B ✓ 65%
  20. 20 CogVLM2-19B-Chat ✓ 64.9%
  21. 21 LLaVA-OneVision 7B (SI) SI ✓ 64.7%
  22. 22 Pixtral 12B ✓ 64.7%
  23. 23 BlueLM-V-3B ✓ 64.7%
  24. 24 MMAlaya2 ✓ 64.6%
  25. 25 Monkey-Chat ✓ 64.4%
  26. 26 ShareGPT4V-13B ✓ 64.3%
  27. 27 Eagle-X5-7B ✓ 64.3%
  28. 28 InternVL-Chat-V1-5 ✓ 64.2%
  29. 29 llava-v1.6-vicuna-7b ✓ 63.8%
  30. 30 Bunny-Llama-3-8B-V ✓ 63.8%
  31. 31 LLaVA-v1.5-13B ✓ 63.4%
  32. 32 ShareGPT4V-7B ✓ 63.4%
  33. 33 LLaVA-v1.5-13B (QLoRA) QLoRA ✓ 63.4%
  34. 34 Aquila-VL-2B ✓ 63.3%
  35. 35 LLaVA-Next-Qwen-32B ✓ 63.2%
  36. 36 InternLM-XComposer2 ✓ 62.9%
  37. 37 Mantis-8B-Idefics2 ✓ 62.6%
  38. 38 Phi-3-vision-128k-instruct ✓ 61.9%
  39. 39 Falcon2-11B-VLM ✓ 61.4%
  40. 40 LLaVA-LLaMA-3-8B ✓ 61.3%
  41. 41 LLaVA-InternLM2-20B (QLoRA) QLoRA ✓ 61.2%
  42. 42 llava-v1.6-mistral-7b ✓ 61.2%
  43. 43 LLaVA-v1.5-7B (QLoRA) QLoRA ✓ 61%
  44. 44 TransCore-M ✓ 60.9%
  45. 45 llama3-llava-next-8b ✓ 60.7%
  46. 46 llava-v1.5-7b ✓ 60.6%
  47. 47 LLaVA-NeXT-Interleave-7B ✓ 60.6%
  48. 48 Phi-4-multimodal ✓ 60.2%
  49. 49 Moondream1 ✓ 59.6%
  50. 50 OmniLMM-12B ✓ 59.1%
  51. 51 Qwen-VL-Chat ✓ 58.6%
  52. 52 Mantis-8B-siglip-llama3 ✓ 58.5%
  53. 53 DeepSeek-VL-1.3B-Chat ✓ 58.1%
  54. 54 POINTS-Qwen2.5-7B ✓ 58.1%
  55. 55 AKI-4B ✓ 58.1%
  56. 56 LLaVA-InternLM2-7B (QLoRA) QLoRA ✓ 58%
  57. 57 PaliGemma-3B-mix-448 ✓ 57.8%
  58. 58 LLaVA-InternLM-7B (QLoRA) QLoRA ✓ 57.6%
  59. 59 LLaVA-NeXT-Interleave-7B-DPO ✓ 57.3%
  60. 60 LLaVA-OneVision 0.5B (SI) SI ✓ 56.9%
  61. 61 Vintern-3B-beta ✓ 56.8%
  62. 62 MiniCPM-V ✓ 56.4%
  63. 63 POINTS-Yi-1.5-9B ✓ 56.3%
  64. 64 MiniCPM-V 2.0 ✓ 55.8%
  65. 65 Qwen-VL-Max ✓ 55%
  66. 66 InternLM-XComposer ✓ 54.5%
  67. 67 Mantis-8B-Fuyu ✓ 54.2%
  68. 68 MMAlaya ✓ 51%
  69. 69 Slime-13B ✓ 51%
  70. 70 instructblip-vicuna-7b ✓ 50.2%
  71. 71 ShareCaptioner ✓ 50.2%
  72. 72 H2OVL-800M ✓ 50%
  73. 73 Yi-VL-6B ✓ 49.5%
  74. 74 Slime-7B ✓ 49%
  75. 75 Slime-8B ✓ 47.9%
  76. 76 InternVL2-Llama3-76B ✓ 43.7%
  77. 77 InternVL2-26B ✓ 43.4%
  78. 78 InternVL2-40B ✓ 42.9%
  79. 79 InternVL2-8B ✓ 42.6%
  80. 80 Yi-VL-34B ✓ 42.4%
  81. 81 Emu2-Chat ✓ 41%
  82. 82 InternVL3-8B ✓ 38.9%
  83. 83 Qwen-VL-Plus ✓ 38.8%
  84. 84 GPT-4.1 nano ✓ 36%
  85. 85 InternVL3-14B ✓ 30.5%
  86. 86 MolmoE-1B ✓ 28.6%
  87. 87 Gemma 3 4B ✓ 27.6%
  88. 88 GPT-4.1 mini ✓ 26.3%
  89. 89 InternVL3-1B ✓ 21.4%
  90. 90 InternVL3-2B ✓ 19.1%
  91. 91 GPT-4.1 ✓ 18.7%
  92. 92 Gemini 1.5 Flash Sep 2024 ✓ 18.5%
  93. 93 Gemma 3 12B ✓ 17.7%
  94. 94 Molmo-7B-D ✓ 15.9%
  95. 95 Molmo-7B-O ✓ 15.1%
  96. 96 Gemma 3 27B ✓ 13.5%
  97. 97 Gemini 1.0 Pro ✓ 12.3%
  98. 98 Janus-1.3B ✓ 11.7%
  99. 99 Chameleon-7B ✓ 9.00%
  100. 100 OpenFlamingo v2 8.90%
  101. 101 Chameleon-30B ✓ 3.70%
  102. 102 Kosmos-2 ✓ 2.90%
  103. 103 SmolVLM-Synthetic ✓ 0.50%
  104. 104 MiniGPT-4-v1-7B ✓ 0.30%
  105. 105 SmolVLM2-256M-Video-Instruct ✓ 0.20%
  106. 106 SmolVLM-Instruct ✓ 0.10%
  107. 107 SmolVLM-Instruct-DPO ✓ 0.10%
  108. 108 VisualGLM ✓ 0%
  109. 109 PandaGPT-13B ✓ 0%
  110. 110 IDEFICS-9B-Instruct ✓ 0%
  111. 111 IDEFICS-80B-Instruct ✓ 0%
  112. 112 MiniGPT-4-v2 ✓ 0%
  113. 113 GPT-4v (1106, detail-low) detail-low ✓ 0%
  114. 114 Idefics3-8B-Llama3 ✓ 0%
  115. 115 SmolVLM-256M-Instruct ✓ 0%
  116. 116 SmolVLM-500M-Instruct ✓ 0%
  117. 117 SmolVLM2-2.2B-Instruct ✓ 0%
  118. 118 SmolVLM2-500M-Video-Instruct ✓ 0%

Source: OpenCompass’s leaderboard

80 models. Scroll sideways for the rest.

  1. 82.0 Kimi-VL-A3B-Instruct
  2. 75.1 Ovis1.6-Gemma2-27B
  3. 73.7 Qwen2-VL-72B-Instruct
  4. 71.2 Ovis1.5-Llama3-8B
  5. 71.2 Ovis1.6-Gemma2-9B
  6. 68.2 Cambrian-1-34B
  7. 67.0 Monkey
  8. 67.0 DeepSeek-VL-7B-Chat
  9. 66.7 Ovis1.6-Llama3.2-3B
  10. 66.3 CogVLM-17B-Chat
  11. 66.3 LLaVA-v1.6-34B
  12. 66.0 Cambrian-1-8B
  13. 65.3 llava-v1.6-vicuna-13b
  14. 65.2 mPLUG-Owl2
  15. 65.0 Eagle-X5-13B
  16. 64.9 CogVLM2-19B-Chat
  17. 64.7 LLaVA-OneVision 7B (SI)
  18. 64.7 Pixtral 12B
  19. 64.4 Monkey-Chat
  20. 64.3 ShareGPT4V-13B
  21. 64.3 Eagle-X5-7B
  22. 64.2 InternVL-Chat-V1-5
  23. 63.8 llava-v1.6-vicuna-7b
  24. 63.8 Bunny-Llama-3-8B-V
  25. 63.4 LLaVA-v1.5-13B
  26. 63.4 ShareGPT4V-7B
  27. 63.3 Aquila-VL-2B
  28. 61.9 Phi-3-vision-128k-instruct
  29. 61.4 Falcon2-11B-VLM
  30. 61.2 llava-v1.6-mistral-7b
  31. 60.7 llama3-llava-next-8b
  32. 60.6 llava-v1.5-7b
  33. 60.6 LLaVA-NeXT-Interleave-7B
  34. 60.2 Phi-4-multimodal
  35. 59.1 OmniLMM-12B
  36. 58.6 Qwen-VL-Chat
  37. 58.1 DeepSeek-VL-1.3B-Chat
  38. 57.8 PaliGemma-3B-mix-448
  39. 57.3 LLaVA-NeXT-Interleave-7B-DPO
  40. 56.9 LLaVA-OneVision 0.5B (SI)
  41. 56.4 MiniCPM-V
  42. 55.8 MiniCPM-V 2.0
  43. 55.0 Qwen-VL-Max
  44. 50.2 instructblip-vicuna-7b
  45. 49.5 Yi-VL-6B
  46. 43.7 InternVL2-Llama3-76B
  47. 43.4 InternVL2-26B
  48. 42.9 InternVL2-40B
  49. 42.6 InternVL2-8B
  50. 42.4 Yi-VL-34B
  51. 41.0 Emu2-Chat
  52. 38.9 InternVL3-8B
  53. 38.8 Qwen-VL-Plus
  54. 36.0 GPT-4.1 nano
  55. 30.5 InternVL3-14B
  56. 28.6 MolmoE-1B
  57. 27.6 Gemma 3 4B
  58. 26.3 GPT-4.1 mini
  59. 21.4 InternVL3-1B
  60. 19.1 InternVL3-2B
  61. 18.7 GPT-4.1
  62. 18.5 Gemini 1.5 Flash
  63. 17.7 Gemma 3 12B
  64. 15.9 Molmo-7B-D
  65. 15.1 Molmo-7B-O
  66. 13.5 Gemma 3 27B
  67. 12.3 Gemini 1.0 Pro
  68. 11.7 Janus-1.3B
  69. 9.00 Chameleon-7B
  70. 3.70 Chameleon-30B
  71. 2.90 Kosmos-2
  72. 0.20 SmolVLM2-256M-Video-Instruct
  73. 0.10 SmolVLM-Instruct
  74. 0.0 IDEFICS-9B-Instruct
  75. 0.0 IDEFICS-80B-Instruct
  76. 0.0 Idefics3-8B-Llama3
  77. 0.0 SmolVLM-256M-Instruct
  78. 0.0 SmolVLM-500M-Instruct
  79. 0.0 SmolVLM2-2.2B-Instruct
  80. 0.0 SmolVLM2-500M-Video-Instruct
  1. 1 Kimi-VL-A3B-Instruct ✓ 82%
  2. 2 Ovis1.6-Gemma2-27B ✓ 75.1%
  3. 3 Qwen2-VL-72B-Instruct ✓ 73.7%
  4. 4 Ovis1.5-Llama3-8B ✓ 71.2%
  5. 5 Ovis1.6-Gemma2-9B ✓ 71.2%
  6. 6 Cambrian-1-34B ✓ 68.2%
  7. 7 Monkey ✓ 67%
  8. 8 DeepSeek-VL-7B-Chat ✓ 67%
  9. 9 Ovis1.6-Llama3.2-3B ✓ 66.7%
  10. 10 CogVLM-17B-Chat ✓ 66.3%
  11. 11 LLaVA-v1.6-34B ✓ 66.3%
  12. 12 Cambrian-1-8B ✓ 66%
  13. 13 llava-v1.6-vicuna-13b ✓ 65.3%
  14. 14 mPLUG-Owl2 ✓ 65.2%
  15. 15 Eagle-X5-13B ✓ 65%
  16. 16 CogVLM2-19B-Chat ✓ 64.9%
  17. 17 LLaVA-OneVision 7B (SI) SI ✓ 64.7%
  18. 18 Pixtral 12B ✓ 64.7%
  19. 19 Monkey-Chat ✓ 64.4%
  20. 20 ShareGPT4V-13B ✓ 64.3%
  21. 21 Eagle-X5-7B ✓ 64.3%
  22. 22 InternVL-Chat-V1-5 ✓ 64.2%
  23. 23 llava-v1.6-vicuna-7b ✓ 63.8%
  24. 24 Bunny-Llama-3-8B-V ✓ 63.8%
  25. 25 LLaVA-v1.5-13B ✓ 63.4%
  26. 26 ShareGPT4V-7B ✓ 63.4%
  27. 27 Aquila-VL-2B ✓ 63.3%
  28. 28 Phi-3-vision-128k-instruct ✓ 61.9%
  29. 29 Falcon2-11B-VLM ✓ 61.4%
  30. 30 llava-v1.6-mistral-7b ✓ 61.2%
  31. 31 llama3-llava-next-8b ✓ 60.7%
  32. 32 llava-v1.5-7b ✓ 60.6%
  33. 33 LLaVA-NeXT-Interleave-7B ✓ 60.6%
  34. 34 Phi-4-multimodal ✓ 60.2%
  35. 35 OmniLMM-12B ✓ 59.1%
  36. 36 Qwen-VL-Chat ✓ 58.6%
  37. 37 DeepSeek-VL-1.3B-Chat ✓ 58.1%
  38. 38 PaliGemma-3B-mix-448 ✓ 57.8%
  39. 39 LLaVA-NeXT-Interleave-7B-DPO ✓ 57.3%
  40. 40 LLaVA-OneVision 0.5B (SI) SI ✓ 56.9%
  41. 41 MiniCPM-V ✓ 56.4%
  42. 42 MiniCPM-V 2.0 ✓ 55.8%
  43. 43 Qwen-VL-Max ✓ 55%
  44. 44 instructblip-vicuna-7b ✓ 50.2%
  45. 45 Yi-VL-6B ✓ 49.5%
  46. 46 InternVL2-Llama3-76B ✓ 43.7%
  47. 47 InternVL2-26B ✓ 43.4%
  48. 48 InternVL2-40B ✓ 42.9%
  49. 49 InternVL2-8B ✓ 42.6%
  50. 50 Yi-VL-34B ✓ 42.4%
  51. 51 Emu2-Chat ✓ 41%
  52. 52 InternVL3-8B ✓ 38.9%
  53. 53 Qwen-VL-Plus ✓ 38.8%
  54. 54 GPT-4.1 nano ✓ 36%
  55. 55 InternVL3-14B ✓ 30.5%
  56. 56 MolmoE-1B ✓ 28.6%
  57. 57 Gemma 3 4B ✓ 27.6%
  58. 58 GPT-4.1 mini ✓ 26.3%
  59. 59 InternVL3-1B ✓ 21.4%
  60. 60 InternVL3-2B ✓ 19.1%
  61. 61 GPT-4.1 ✓ 18.7%
  62. 62 Gemini 1.5 Flash Sep 2024 ✓ 18.5%
  63. 63 Gemma 3 12B ✓ 17.7%
  64. 64 Molmo-7B-D ✓ 15.9%
  65. 65 Molmo-7B-O ✓ 15.1%
  66. 66 Gemma 3 27B ✓ 13.5%
  67. 67 Gemini 1.0 Pro ✓ 12.3%
  68. 68 Janus-1.3B ✓ 11.7%
  69. 69 Chameleon-7B ✓ 9.00%
  70. 70 Chameleon-30B ✓ 3.70%
  71. 71 Kosmos-2 ✓ 2.90%
  72. 72 SmolVLM2-256M-Video-Instruct ✓ 0.20%
  73. 73 SmolVLM-Instruct ✓ 0.10%
  74. 74 IDEFICS-9B-Instruct ✓ 0%
  75. 75 IDEFICS-80B-Instruct ✓ 0%
  76. 76 Idefics3-8B-Llama3 ✓ 0%
  77. 77 SmolVLM-256M-Instruct ✓ 0%
  78. 78 SmolVLM-500M-Instruct ✓ 0%
  79. 79 SmolVLM2-2.2B-Instruct ✓ 0%
  80. 80 SmolVLM2-500M-Video-Instruct ✓ 0%

Source: OpenCompass’s leaderboard

#EntryScoreSettingReleasedRun onLinkSource
1 Kimi-VL-A3B-Instruct ✓ 82% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
2 MUG-U-7B ✓ closed weights, 7B 80.9% VLMEvalKit Mar 2025 github.com Official leaderboard
3 Ovis1.6-Gemma2-27B ✓ 75.1% VLMEvalKit Nov 2024 Nov 2024 huggingface.co Official leaderboard
4 Qwen2-VL-72B-Instruct ✓ 73.7% VLMEvalKit Aug 2024 Oct 2024 huggingface.co Official leaderboard
5 Taiyi ✓ closed weights 73.5% VLMEvalKit Dec 2024 taiyi.megvii.com Official leaderboard
6 Ovis1.5-Llama3-8B ✓ 71.2% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
7 Ovis1.6-Gemma2-9B ✓ 71.2% VLMEvalKit Sep 2024 Sep 2024 huggingface.co Official leaderboard
8 H2OVL-2B ✓ open weights, 2.2B 70.3% VLMEvalKit Oct 2024 huggingface.co Official leaderboard
9 Cambrian-1-34B ✓ 68.2% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
10 Qwen-VL ✓ open weights, 9.6B 67.5% VLMEvalKit Aug 2023 github.com Official leaderboard
11 Monkey ✓ 67% VLMEvalKit Nov 2023 Jan 2024 github.com Official leaderboard
12 DeepSeek-VL-7B-Chat ✓ 67% VLMEvalKit Mar 2024 Mar 2024 github.com Official leaderboard
13 Ovis1.6-Llama3.2-3B ✓ 66.7% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
14 CogVLM-17B-Chat ✓ 66.3% VLMEvalKit Nov 2023 Jan 2024 huggingface.co Official leaderboard
15 LLaVA-v1.6-34B ✓ 66.3% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
16 Cambrian-1-8B ✓ 66% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
17 llava-v1.6-vicuna-13b ✓ 65.3% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
18 mPLUG-Owl2 ✓ 65.2% VLMEvalKit Nov 2023 Nov 2023 github.com Official leaderboard
19 Eagle-X5-13B ✓ 65% VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
20 CogVLM2-19B-Chat ✓ 64.9% VLMEvalKit May 2024 May 2024 huggingface.co Official leaderboard
21 LLaVA-OneVision 7B (SI) ✓ 64.7% SI, VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
22 Pixtral 12B ✓ 64.7% VLMEvalKit Sep 2024 Sep 2024 huggingface.co Official leaderboard
23 BlueLM-V-3B ✓ closed weights, 3B 64.7% VLMEvalKit Oct 2024 developers.vivo.com Official leaderboard
24 MMAlaya2 ✓ open weights, 26B 64.6% VLMEvalKit Aug 2024 huggingface.co Official leaderboard
25 Monkey-Chat ✓ 64.4% VLMEvalKit Jan 2024 Jan 2024 github.com Official leaderboard
26 ShareGPT4V-13B ✓ 64.3% VLMEvalKit Dec 2023 Dec 2023 sharegpt4v.github.io Official leaderboard
27 Eagle-X5-7B ✓ 64.3% VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
28 InternVL-Chat-V1-5 ✓ 64.2% VLMEvalKit Apr 2024 Apr 2024 github.com Official leaderboard
29 llava-v1.6-vicuna-7b ✓ 63.8% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
30 Bunny-Llama-3-8B-V ✓ 63.8% VLMEvalKit Apr 2024 Jul 2024 huggingface.co Official leaderboard
31 LLaVA-v1.5-13B ✓ 63.4% VLMEvalKit Oct 2023 Oct 2023 arxiv.org Official leaderboard
32 ShareGPT4V-7B ✓ 63.4% VLMEvalKit Nov 2023 Dec 2023 sharegpt4v.github.io Official leaderboard
33 LLaVA-v1.5-13B (QLoRA) ✓ open weights, 13.4B 63.4% QLoRA, VLMEvalKit Dec 2023 github.com Official leaderboard
34 Aquila-VL-2B ✓ 63.3% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
35 LLaVA-Next-Qwen-32B ✓ open weights, 33B 63.2% VLMEvalKit Aug 2024 llava-vl.github.io Official leaderboard
36 InternLM-XComposer2 ✓ open weights, 7B 62.9% VLMEvalKit Jan 2024 github.com Official leaderboard
37 Mantis-8B-Idefics2 ✓ open weights, 8B 62.6% VLMEvalKit Aug 2024 huggingface.co Official leaderboard
38 Phi-3-vision-128k-instruct ✓ 61.9% VLMEvalKit May 2024 May 2024 huggingface.co Official leaderboard
39 Falcon2-11B-VLM ✓ 61.4% VLMEvalKit May 2024 Oct 2024 huggingface.co Official leaderboard
40 LLaVA-LLaMA-3-8B ✓ open weights, 8B 61.3% VLMEvalKit May 2024 huggingface.co Official leaderboard
41 LLaVA-InternLM2-20B (QLoRA) ✓ open weights, 20.2B 61.2% QLoRA, VLMEvalKit Jan 2024 github.com Official leaderboard
42 llava-v1.6-mistral-7b ✓ 61.2% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
43 LLaVA-v1.5-7B (QLoRA) ✓ open weights, 7.2B 61% QLoRA, VLMEvalKit Dec 2023 github.com Official leaderboard
44 TransCore-M ✓ open weights, 13.4B 60.9% VLMEvalKit Apr 2024 github.com Official leaderboard
45 llama3-llava-next-8b ✓ 60.7% VLMEvalKit Apr 2024 Jul 2024 llava-vl.github.io Official leaderboard
46 llava-v1.5-7b ✓ 60.6% VLMEvalKit Oct 2023 Oct 2023 arxiv.org Official leaderboard
47 LLaVA-NeXT-Interleave-7B ✓ 60.6% VLMEvalKit Jun 2024 Aug 2024 llava-vl.github.io Official leaderboard
48 Phi-4-multimodal ✓ 60.2% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
49 Moondream1 ✓ open weights, 1.9B 59.6% VLMEvalKit Sep 2024 huggingface.co Official leaderboard
50 OmniLMM-12B ✓ 59.1% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
51 Qwen-VL-Chat ✓ 58.6% VLMEvalKit Aug 2023 Aug 2023 github.com Official leaderboard
52 Mantis-8B-siglip-llama3 ✓ open weights, 8B 58.5% VLMEvalKit Aug 2024 huggingface.co Official leaderboard
53 DeepSeek-VL-1.3B-Chat ✓ 58.1% VLMEvalKit Mar 2024 Mar 2024 github.com Official leaderboard
54 POINTS-Qwen2.5-7B ✓ open weights, 8.3B 58.1% VLMEvalKit Oct 2024 huggingface.co Official leaderboard
55 AKI-4B ✓ open weights, 4.3B 58.1% VLMEvalKit Mar 2025 huggingface.co Official leaderboard
56 LLaVA-InternLM2-7B (QLoRA) ✓ open weights, 8.1B 58% QLoRA, VLMEvalKit Jan 2024 github.com Official leaderboard
57 PaliGemma-3B-mix-448 ✓ 57.8% VLMEvalKit May 2024 May 2024 github.com Official leaderboard
58 LLaVA-InternLM-7B (QLoRA) ✓ open weights, 7.6B 57.6% QLoRA, VLMEvalKit Dec 2023 github.com Official leaderboard
59 LLaVA-NeXT-Interleave-7B-DPO ✓ 57.3% VLMEvalKit Jun 2024 Jul 2024 llava-vl.github.io Official leaderboard
60 LLaVA-OneVision 0.5B (SI) ✓ 56.9% SI, VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
61 Vintern-3B-beta ✓ open weights, 3.7B 56.8% VLMEvalKit Oct 2024 huggingface.co Official leaderboard
62 MiniCPM-V ✓ 56.4% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
63 POINTS-Yi-1.5-9B ✓ open weights, 9.5B 56.3% VLMEvalKit Oct 2024 huggingface.co Official leaderboard
64 MiniCPM-V 2.0 ✓ 55.8% VLMEvalKit Apr 2024 Apr 2024 huggingface.co Official leaderboard
65 Qwen-VL-Max ✓ 55% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
66 InternLM-XComposer ✓ open weights, 8B 54.5% VLMEvalKit Sep 2023 github.com Official leaderboard
67 Mantis-8B-Fuyu ✓ open weights, 8B 54.2% VLMEvalKit Sep 2024 huggingface.co Official leaderboard
68 MMAlaya ✓ open weights, 7.8B 51% VLMEvalKit Jan 2024 huggingface.co Official leaderboard
69 Slime-13B ✓ open weights, 13B 51% VLMEvalKit Sep 2024 huggingface.co Official leaderboard
70 instructblip-vicuna-7b ✓ 50.2% VLMEvalKit May 2023 May 2023 arxiv.org Official leaderboard
71 ShareCaptioner ✓ open weights, 8B 50.2% VLMEvalKit Jan 2024 huggingface.co Official leaderboard
72 H2OVL-800M ✓ open weights, 0.8B 50% VLMEvalKit Oct 2024 huggingface.co Official leaderboard
73 Yi-VL-6B ✓ 49.5% VLMEvalKit Dec 2023 Jan 2024 huggingface.co Official leaderboard
74 Slime-7B ✓ open weights, 7B 49% VLMEvalKit Sep 2024 huggingface.co Official leaderboard
75 Slime-8B ✓ open weights, 8B 47.9% VLMEvalKit Sep 2024 huggingface.co Official leaderboard
76 InternVL2-Llama3-76B ✓ 43.7% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
77 InternVL2-26B ✓ 43.4% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
78 InternVL2-40B ✓ 42.9% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
79 InternVL2-8B ✓ 42.6% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
80 Yi-VL-34B ✓ 42.4% VLMEvalKit Dec 2023 Jan 2024 huggingface.co Official leaderboard
81 Emu2-Chat ✓ 41% VLMEvalKit Dec 2023 Jan 2024 github.com Official leaderboard
82 InternVL3-8B ✓ 38.9% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
83 Qwen-VL-Plus ✓ 38.8% VLMEvalKit Jan 2024 Jan 2024 github.com Official leaderboard
84 GPT-4.1 nano ✓ 36% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
85 InternVL3-14B ✓ 30.5% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
86 MolmoE-1B ✓ 28.6% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
87 Gemma 3 4B ✓ 27.6% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
88 GPT-4.1 mini ✓ 26.3% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
89 InternVL3-1B ✓ 21.4% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
90 InternVL3-2B ✓ 19.1% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
91 GPT-4.1 ✓ 18.7% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
92 Gemini 1.5 Flash Sep 2024 ✓ 18.5% VLMEvalKit Aug 2024 Sep 2024 deepmind.google Official leaderboard
93 Gemma 3 12B ✓ 17.7% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
94 Molmo-7B-D ✓ 15.9% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
95 Molmo-7B-O ✓ 15.1% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
96 Gemma 3 27B ✓ 13.5% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
97 Gemini 1.0 Pro ✓ 12.3% VLMEvalKit Dec 2023 Dec 2023 deepmind.google Official leaderboard
98 Janus-1.3B ✓ 11.7% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
99 Chameleon-7B ✓ 9.00% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
100 OpenFlamingo v2 open weights, 9B 8.90% VLMEvalKit Jun 2023 github.com Official leaderboard
101 Chameleon-30B ✓ 3.70% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
102 Kosmos-2 ✓ 2.90% VLMEvalKit Jun 2023 Oct 2024 huggingface.co Official leaderboard
103 SmolVLM-Synthetic ✓ open weights, 2.3B 0.50% VLMEvalKit Jan 2025 huggingface.co Official leaderboard
104 MiniGPT-4-v1-7B ✓ open weights, 8B 0.30% VLMEvalKit Apr 2023 arxiv.org Official leaderboard
105 SmolVLM2-256M-Video-Instruct ✓ 0.20% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
106 SmolVLM-Instruct ✓ 0.10% VLMEvalKit Nov 2024 Jan 2025 huggingface.co Official leaderboard
107 SmolVLM-Instruct-DPO ✓ open weights, 2.3B 0.10% VLMEvalKit Jan 2025 huggingface.co Official leaderboard
108 VisualGLM ✓ open weights, 8B 0% VLMEvalKit May 2023 github.com Official leaderboard
109 PandaGPT-13B ✓ open weights, 14B 0% VLMEvalKit May 2023 arxiv.org Official leaderboard
110 IDEFICS-9B-Instruct ✓ 0% VLMEvalKit Jul 2023 Jul 2023 huggingface.co Official leaderboard
111 IDEFICS-80B-Instruct ✓ 0% VLMEvalKit Jul 2023 Jul 2023 huggingface.co Official leaderboard
112 MiniGPT-4-v2 ✓ open weights, 8B 0% VLMEvalKit Oct 2023 minigpt-v2.github.io Official leaderboard
113 GPT-4v (1106, detail-low) ✓ closed weights 0% detail-low, VLMEvalKit Dec 2023 openai.com Official leaderboard
114 Idefics3-8B-Llama3 ✓ 0% VLMEvalKit Aug 2024 Aug 2024 huggingface.co Official leaderboard
115 SmolVLM-256M-Instruct ✓ 0% VLMEvalKit Jan 2025 Jan 2025 huggingface.co Official leaderboard
116 SmolVLM-500M-Instruct ✓ 0% VLMEvalKit Jan 2025 Jan 2025 huggingface.co Official leaderboard
117 SmolVLM2-2.2B-Instruct ✓ 0% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
118 SmolVLM2-500M-Video-Instruct ✓ 0% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
#ModelScoreSettingReleasedRun onLinkSource
1 Kimi-VL-A3B-Instruct ✓ 82% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
2 Ovis1.6-Gemma2-27B ✓ 75.1% VLMEvalKit Nov 2024 Nov 2024 huggingface.co Official leaderboard
3 Qwen2-VL-72B-Instruct ✓ 73.7% VLMEvalKit Aug 2024 Oct 2024 huggingface.co Official leaderboard
4 Ovis1.5-Llama3-8B ✓ 71.2% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
5 Ovis1.6-Gemma2-9B ✓ 71.2% VLMEvalKit Sep 2024 Sep 2024 huggingface.co Official leaderboard
6 Cambrian-1-34B ✓ 68.2% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
7 Monkey ✓ 67% VLMEvalKit Nov 2023 Jan 2024 github.com Official leaderboard
8 DeepSeek-VL-7B-Chat ✓ 67% VLMEvalKit Mar 2024 Mar 2024 github.com Official leaderboard
9 Ovis1.6-Llama3.2-3B ✓ 66.7% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
10 CogVLM-17B-Chat ✓ 66.3% VLMEvalKit Nov 2023 Jan 2024 huggingface.co Official leaderboard
11 LLaVA-v1.6-34B ✓ 66.3% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
12 Cambrian-1-8B ✓ 66% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
13 llava-v1.6-vicuna-13b ✓ 65.3% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
14 mPLUG-Owl2 ✓ 65.2% VLMEvalKit Nov 2023 Nov 2023 github.com Official leaderboard
15 Eagle-X5-13B ✓ 65% VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
16 CogVLM2-19B-Chat ✓ 64.9% VLMEvalKit May 2024 May 2024 huggingface.co Official leaderboard
17 LLaVA-OneVision 7B (SI) ✓ 64.7% SI, VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
18 Pixtral 12B ✓ 64.7% VLMEvalKit Sep 2024 Sep 2024 huggingface.co Official leaderboard
19 Monkey-Chat ✓ 64.4% VLMEvalKit Jan 2024 Jan 2024 github.com Official leaderboard
20 ShareGPT4V-13B ✓ 64.3% VLMEvalKit Dec 2023 Dec 2023 sharegpt4v.github.io Official leaderboard
21 Eagle-X5-7B ✓ 64.3% VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
22 InternVL-Chat-V1-5 ✓ 64.2% VLMEvalKit Apr 2024 Apr 2024 github.com Official leaderboard
23 llava-v1.6-vicuna-7b ✓ 63.8% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
24 Bunny-Llama-3-8B-V ✓ 63.8% VLMEvalKit Apr 2024 Jul 2024 huggingface.co Official leaderboard
25 LLaVA-v1.5-13B ✓ 63.4% VLMEvalKit Oct 2023 Oct 2023 arxiv.org Official leaderboard
26 ShareGPT4V-7B ✓ 63.4% VLMEvalKit Nov 2023 Dec 2023 sharegpt4v.github.io Official leaderboard
27 Aquila-VL-2B ✓ 63.3% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
28 Phi-3-vision-128k-instruct ✓ 61.9% VLMEvalKit May 2024 May 2024 huggingface.co Official leaderboard
29 Falcon2-11B-VLM ✓ 61.4% VLMEvalKit May 2024 Oct 2024 huggingface.co Official leaderboard
30 llava-v1.6-mistral-7b ✓ 61.2% VLMEvalKit Jan 2024 Mar 2024 llava-vl.github.io Official leaderboard
31 llama3-llava-next-8b ✓ 60.7% VLMEvalKit Apr 2024 Jul 2024 llava-vl.github.io Official leaderboard
32 llava-v1.5-7b ✓ 60.6% VLMEvalKit Oct 2023 Oct 2023 arxiv.org Official leaderboard
33 LLaVA-NeXT-Interleave-7B ✓ 60.6% VLMEvalKit Jun 2024 Aug 2024 llava-vl.github.io Official leaderboard
34 Phi-4-multimodal ✓ 60.2% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
35 OmniLMM-12B ✓ 59.1% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
36 Qwen-VL-Chat ✓ 58.6% VLMEvalKit Aug 2023 Aug 2023 github.com Official leaderboard
37 DeepSeek-VL-1.3B-Chat ✓ 58.1% VLMEvalKit Mar 2024 Mar 2024 github.com Official leaderboard
38 PaliGemma-3B-mix-448 ✓ 57.8% VLMEvalKit May 2024 May 2024 github.com Official leaderboard
39 LLaVA-NeXT-Interleave-7B-DPO ✓ 57.3% VLMEvalKit Jun 2024 Jul 2024 llava-vl.github.io Official leaderboard
40 LLaVA-OneVision 0.5B (SI) ✓ 56.9% SI, VLMEvalKit Aug 2024 Sep 2024 huggingface.co Official leaderboard
41 MiniCPM-V ✓ 56.4% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
42 MiniCPM-V 2.0 ✓ 55.8% VLMEvalKit Apr 2024 Apr 2024 huggingface.co Official leaderboard
43 Qwen-VL-Max ✓ 55% VLMEvalKit Jan 2024 Feb 2024 huggingface.co Official leaderboard
44 instructblip-vicuna-7b ✓ 50.2% VLMEvalKit May 2023 May 2023 arxiv.org Official leaderboard
45 Yi-VL-6B ✓ 49.5% VLMEvalKit Dec 2023 Jan 2024 huggingface.co Official leaderboard
46 InternVL2-Llama3-76B ✓ 43.7% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
47 InternVL2-26B ✓ 43.4% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
48 InternVL2-40B ✓ 42.9% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
49 InternVL2-8B ✓ 42.6% VLMEvalKit Jul 2024 Jul 2024 huggingface.co Official leaderboard
50 Yi-VL-34B ✓ 42.4% VLMEvalKit Dec 2023 Jan 2024 huggingface.co Official leaderboard
51 Emu2-Chat ✓ 41% VLMEvalKit Dec 2023 Jan 2024 github.com Official leaderboard
52 InternVL3-8B ✓ 38.9% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
53 Qwen-VL-Plus ✓ 38.8% VLMEvalKit Jan 2024 Jan 2024 github.com Official leaderboard
54 GPT-4.1 nano ✓ 36% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
55 InternVL3-14B ✓ 30.5% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
56 MolmoE-1B ✓ 28.6% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
57 Gemma 3 4B ✓ 27.6% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
58 GPT-4.1 mini ✓ 26.3% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
59 InternVL3-1B ✓ 21.4% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
60 InternVL3-2B ✓ 19.1% VLMEvalKit Apr 2025 Apr 2025 huggingface.co Official leaderboard
61 GPT-4.1 ✓ 18.7% VLMEvalKit Apr 2025 Apr 2025 openai.com Official leaderboard
62 Gemini 1.5 Flash Sep 2024 ✓ 18.5% VLMEvalKit Aug 2024 Sep 2024 deepmind.google Official leaderboard
63 Gemma 3 12B ✓ 17.7% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
64 Molmo-7B-D ✓ 15.9% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
65 Molmo-7B-O ✓ 15.1% VLMEvalKit Sep 2024 Oct 2024 huggingface.co Official leaderboard
66 Gemma 3 27B ✓ 13.5% VLMEvalKit Mar 2025 Mar 2025 huggingface.co Official leaderboard
67 Gemini 1.0 Pro ✓ 12.3% VLMEvalKit Dec 2023 Dec 2023 deepmind.google Official leaderboard
68 Janus-1.3B ✓ 11.7% VLMEvalKit Oct 2024 Oct 2024 huggingface.co Official leaderboard
69 Chameleon-7B ✓ 9.00% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
70 Chameleon-30B ✓ 3.70% VLMEvalKit Jun 2024 Jul 2024 huggingface.co Official leaderboard
71 Kosmos-2 ✓ 2.90% VLMEvalKit Jun 2023 Oct 2024 huggingface.co Official leaderboard
72 SmolVLM2-256M-Video-Instruct ✓ 0.20% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
73 SmolVLM-Instruct ✓ 0.10% VLMEvalKit Nov 2024 Jan 2025 huggingface.co Official leaderboard
74 IDEFICS-9B-Instruct ✓ 0% VLMEvalKit Jul 2023 Jul 2023 huggingface.co Official leaderboard
75 IDEFICS-80B-Instruct ✓ 0% VLMEvalKit Jul 2023 Jul 2023 huggingface.co Official leaderboard
76 Idefics3-8B-Llama3 ✓ 0% VLMEvalKit Aug 2024 Aug 2024 huggingface.co Official leaderboard
77 SmolVLM-256M-Instruct ✓ 0% VLMEvalKit Jan 2025 Jan 2025 huggingface.co Official leaderboard
78 SmolVLM-500M-Instruct ✓ 0% VLMEvalKit Jan 2025 Jan 2025 huggingface.co Official leaderboard
79 SmolVLM2-2.2B-Instruct ✓ 0% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard
80 SmolVLM2-500M-Video-Instruct ✓ 0% VLMEvalKit Feb 2025 Mar 2025 huggingface.co Official leaderboard

Rankings by part

We read 32 parts from OpenCompass’s leaderboard, each ranking models on one part of the test, such as Arts & Photography, Biographies & Memoirs and Business & Money. Kimi-VL-A3B-Instruct leads 27 of them, and 2 other models lead the rest. Arrows show how far a model moved from its overall rank among the models we track.

Arts & Photography

80 models we track have a score here.

  1. 1 Kimi-VL-A3B-Instruct 87.5%
  2. 2 Ovis1.6-Gemma2-27B 80.2%
  3. 3 Ovis1.6-Gemma2-9B ↑2 78.1%
  4. 4 Ovis1.5-Llama3-8B 77.1%
  5. 5 Phi-3-vision-128k-instruct ↑23 75%
  6. 6 Qwen2-VL-72B-Instruct ↓3 74%
  7. 7 Ovis1.6-Llama3.2-3B ↑2 70.8%
  8. 8 Aquila-VL-2B ↑19 70.8%
  9. 9 LLaVA-v1.6-34B ↑2 69.8%
  10. 10 InternVL-Chat-V1-5 ↑12 69.8%

11 models have held number one on OpenCompass’s leaderboard since 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

Other labs University of Wisconsin-Madison Alibaba Group Z.ai Huazhong University of Science and Technology New York University Alibaba International Digital Commerce (AIDC-AI) Moonshot AI
OpenCompass leaderboard Not tested since Apr 2025

Source: OpenCompass’s leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On OpenCompass’s leaderboard Best so far
0% 20% 40% 60% 80% 100% 2023 2024 2025 Near the ceiling (85%) Kimi-VL-A3B-Instruct Ovis1.6-Gemma2-27B Cambrian-1-34B Monkey Qwen-VL-Chat instructblip-vicuna-7b 0% 20% 40% 60% 80% 100% 2023 2024 2025 Near the ceiling (85%) Kimi-VL-A3B-Instruct Ovis1.6-Gemma2-27B

Source: OpenCompass’s leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Vision

All 636 in Vision
  • MMMU In use 11.5K college-level multimodal questions across 30 subjects. Multiple-choice and open accuracy. Qwen 3.6 Plus 86%
  • MMMU-Pro In use Harder MMMU: college-level multimodal questions with more options and vision-only inputs to remove text shortcuts. GPT-5.6 Sol 84.6%
  • CharXiv In use Chart understanding on real arXiv figures. Reasoning questions require synthesizing information from complex charts. Claude Fable 5 93.5%
  • MathVista In use Math reasoning in visual contexts (charts, geometry, puzzles) from 31 datasets. Answer accuracy. Seed2.1 Pro 90.7%
  • MATH-Vision (MathVision) In use 3,040 competition math problems with visual context. Answer accuracy. Qwen 3.8 Max 97.7%
  • MMStar In use Models answer 1,500 human-curated image questions that cannot be solved without the image, across 6 core capabilities. Scored by accuracy. Qwen 3.8 Max 85.9%

Data audit

9 of 10 checks pass, 1 warning. Look first at the Newest score check. The newest came 19 months ago, in April 2025, for GPT-4.1. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 1 warning 3 pass 1 note
  • Pass Independent runs Scores from the official leaderboard (118 entries).
  • Pass Models scored 80 models we track, plus 38 other entries on its leaderboard.
  • Warning Newest score The newest came 19 months ago, in April 2025, for GPT-4.1.
  • Note Frontier models None of the top 10 has a score. The strongest tested is GPT-4.1 (#138).
  • Pass Headroom The best is 82%, under 85%, so it still separates models.
Leaderboard import 3 pass
  • Pass Importer We read the board on OpenCompass: 80 rows for models we track and 38 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check