Benchmark Almanac

Country211

ViT-bigG-14-CLIPA-336 (datacomp1b) 40.9% tops its leaderboard
Not in model cards

Models predict the country where a photograph was taken.

The CLIP evaluation treats the 211 locations as classification labels.

Made by
OpenAI
Released
February 2021
Kind
Spatial reasoning and counting
Level
University
Scored
Checked automatically
Answers
Prediction
Tasks
All public
Measures
Capability
Language
English
In and out
Images → Text
Interaction
Single turn
Items from
Real work and use
Refresh
One fixed set
Run by
Anyone
In views
Vision
121
Entries on OpenCLIP’s leaderboard, 0 models we track

ViT-bigG-14-CLIPA-336 (datacomp1b) tops the leaderboard with 40.9%

Best score per entry from OpenCLIP’s leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.

121 entries. Scroll sideways for the rest.

  1. 40.9 ViT-bigG-14-CLIPA-336 (datacomp1b)
  2. 39.2 ViT-bigG-14-CLIPA (datacomp1b)
  3. 37.9 ViT-H-14-378-quickgelu (dfn5b)
  4. 37.2 ViT-H-14-quickgelu (metaclip_fullcc)
  5. 36.5 ViT-SO400M-14-SigLIP-384 (webli)
  6. 35.6 EVA02-E-14-plus (laion2b_s9b_b144k)
  7. 35.5 ViT-H-14-CLIPA-336 (datacomp1b)
  8. 34.8 EVA02-E-14 (laion2b_s4b_b115k)
  9. 34.5 ViT-L-14-336 (openai)
  10. 34.4 ViT-H-14-quickgelu (dfn5b)
  11. 34.0 ViT-H-14-CLIPA (datacomp1b)
  12. 33.9 ViT-L-14-quickgelu (metaclip_fullcc)
  13. 33.8 ViT-bigG-14 (laion2b_s39b_b160k)
  14. 33.5 EVA02-L-14-336 (merged2b_s6b_b61k)
  15. 32.4 ViT-SO400M-14-SigLIP (webli)
  16. 31.9 ViT-L-14 (openai)
  17. 31.7 xlm-roberta-large-ViT-H-14 (frozen_laion5b_s13b_b90k)
  18. 31.7 convnext_xxlarge (laion2b_s34b_b82k_augreg_soup)
  19. 31.6 ViT-L-14 (datacomp_xl_s13b_b90k)
  20. 31.6 convnext_xxlarge (laion2b_s34b_b82k_augreg_rewind)
  21. 31.3 convnext_xxlarge (laion2b_s34b_b82k_augreg)
  22. 31.1 ViT-H-14-CLIPA-336 (laion2b)
  23. 30.9 EVA02-L-14 (merged2b_s4b_b131k)
  24. 30.9 ViT-g-14 (laion2b_s34b_b88k)
  25. 30.9 EVA01-g-14-plus (merged2b_s11b_b114k)
  26. 30.9 ViT-L-14-quickgelu (metaclip_400m)
  27. 30.7 ViT-L-14-CLIPA-336 (datacomp1b)
  28. 29.9 ViT-H-14 (laion2b_s32b_b79k)
  29. 29.8 ViT-L-14 (commonpool_xl_clip_s13b_b90k)
  30. 29.8 RN50x64 (openai)
  31. 29.6 ViT-L-14 (commonpool_xl_s13b_b90k)
  32. 29.4 ViT-L-14-CLIPA (datacomp1b)
  33. 28.8 ViT-g-14 (laion2b_s12b_b42k)
  34. 28.6 EVA01-g-14 (laion400m_s11b_b41k)
  35. 28.2 ViT-L-14-quickgelu (dfn2b)
  36. 26.7 convnext_large_d_320 (laion2b_s29b_b131k_ft)
  37. 26.5 convnext_large_d_320 (laion2b_s29b_b131k_ft_soup)
  38. 26.3 ViT-L-14 (laion2b_s32b_b82k)
  39. 25.5 coca_ViT-L-14 (laion2b_s13b_b90k)
  40. 25.3 convnext_large_d (laion2b_s26b_b102k_augreg)
  41. 25.0 ViT-L-14 (commonpool_xl_laion_s13b_b90k)
  42. 24.7 ViT-L-16-SigLIP-384 (webli)
  43. 24.4 RN50x16 (openai)
  44. 23.0 ViT-L-14 (laion400m_e32)
  45. 22.9 ViT-L-14 (laion400m_e31)
  46. 22.8 ViT-B-16 (openai)
  47. 22.7 ViT-B-16-quickgelu (metaclip_fullcc)
  48. 22.6 ViT-B-16-quickgelu (metaclip_400m)
  49. 22.4 convnext_base_w_320 (laion_aesthetic_s13b_b82k_augreg)
  50. 22.4 convnext_base_w_320 (laion_aesthetic_s13b_b82k)
  51. 22.3 convnext_base_w (laion_aesthetic_s13b_b82k)
  52. 22.1 ViT-B-16 (datacomp_xl_s13b_b90k)
  53. 21.4 ViT-L-16-SigLIP-256 (webli)
  54. 21.4 EVA02-B-16 (merged2b_s8b_b131k)
  55. 20.4 RN50x4 (openai)
  56. 20.3 ViT-B-16 (laion2b_s34b_b88k)
  57. 20.2 convnext_base_w (laion2b_s13b_b82k)
  58. 20.2 convnext_base_w (laion2b_s13b_b82k_augreg)
  59. 19.7 ViT-B-32-256 (datacomp_s34b_b86k)
  60. 19.6 ViT-B-16 (dfn2b)
  61. 19.3 ViT-B-16-SigLIP-512 (webli)
  62. 19.0 xlm-roberta-base-ViT-B-32 (laion5b_s13b_b90k)
  63. 18.9 ViT-B-16-plus-240 (laion400m_e32)
  64. 18.8 ViT-B-16-plus-240 (laion400m_e31)
  65. 18.6 ViT-B-16-SigLIP-384 (webli)
  66. 18.1 ViT-B-16 (laion400m_e32)
  67. 18.0 ViT-B-16 (laion400m_e31)
  68. 18.0 coca_ViT-L-14 (mscoco_finetuned_laion2b_s13b_b90k)
  69. 17.6 ViT-B-32-quickgelu (metaclip_fullcc)
  70. 17.6 ViT-B-32 (datacomp_xl_s13b_b90k)
  71. 17.2 ViT-B-32 (openai)
  72. 17.2 ViT-B-32-quickgelu (openai)
  73. 17.2 ViT-B-32-quickgelu (metaclip_400m)
  74. 17.0 convnext_base (laion400m_s13b_b51k)
  75. 16.9 RN101 (openai)
  76. 16.9 RN101-quickgelu (openai)
  77. 16.7 ViT-B-32 (laion2b_s34b_b79k)
  78. 16.5 ViT-B-32 (laion2b_e16)
  79. 15.9 ViT-B-16-SigLIP (webli)
  80. 15.9 ViT-B-16-SigLIP-i18n-256 (webli)
  81. 15.8 ViT-B-16-SigLIP-256 (webli)
  82. 15.5 nllb-clip-large-siglip (v1)
  83. 15.4 RN50 (openai)
  84. 15.4 RN50-quickgelu (openai)
  85. 14.8 ViT-B-32-quickgelu (laion400m_e31)
  86. 14.8 ViT-B-32-quickgelu (laion400m_e32)
  87. 14.7 roberta-ViT-B-32 (laion2b_s12b_b32k)
  88. 14.5 coca_ViT-B-32 (laion2b_s13b_b90k)
  89. 14.3 ViT-B-16 (datacomp_l_s1b_b8k)
  90. 14.2 ViT-B-16 (commonpool_l_clip_s1b_b8k)
  91. 13.6 ViT-B-32 (laion400m_e31)
  92. 13.5 ViT-B-32 (laion400m_e32)
  93. 13.1 ViT-B-16 (commonpool_l_image_s1b_b8k)
  94. 11.8 ViT-B-16 (commonpool_l_s1b_b8k)
  95. 11.7 ViT-B-16 (commonpool_l_basic_s1b_b8k)
  96. 11.2 ViT-B-16 (commonpool_l_laion_s1b_b8k)
  97. 9.95 ViT-B-16 (commonpool_l_text_s1b_b8k)
  98. 6.99 RN101 (yfcc15m)
  99. 6.91 nllb-clip-large (v1)
  100. 6.83 RN101-quickgelu (yfcc15m)
  101. 6.42 RN50 (yfcc15m)
  102. 6.37 RN50-quickgelu (yfcc15m)
  103. 5.83 nllb-clip-base-siglip (v1)
  104. 4.66 ViT-B-32 (commonpool_m_image_s128m_b4k)
  105. 4.58 ViT-B-32 (commonpool_m_clip_s128m_b4k)
  106. 4.53 ViT-B-32 (datacomp_m_s128m_b4k)
  107. 4.31 RN50-quickgelu (cc12m)
  108. 4.23 ViT-B-32 (commonpool_m_basic_s128m_b4k)
  109. 4.22 RN50 (cc12m)
  110. 3.62 ViT-B-32 (commonpool_m_s128m_b4k)
  111. 3.55 ViT-B-32 (commonpool_m_text_s128m_b4k)
  112. 3.45 ViT-B-32 (commonpool_m_laion_s128m_b4k)
  113. 3.12 nllb-clip-base (v1)
  114. 1.26 ViT-B-32 (commonpool_s_s13m_b4k)
  115. 1.21 ViT-B-32 (commonpool_s_text_s13m_b4k)
  116. 1.20 ViT-B-32 (commonpool_s_basic_s13m_b4k)
  117. 1.19 ViT-B-32 (commonpool_s_clip_s13m_b4k)
  118. 1.09 ViT-B-32 (commonpool_s_image_s13m_b4k)
  119. 1.09 ViT-B-32 (datacomp_s_s13m_b4k)
  120. 0.98 ViT-B-32 (commonpool_s_laion_s13m_b4k)
  121. 0.44 coca_ViT-B-32 (mscoco_finetuned_laion2b_s13b_b90k)
  1. 1 ViT-bigG-14-CLIPA-336 (datacomp1b) Zero-shot 40.9%
  2. 2 ViT-bigG-14-CLIPA (datacomp1b) Zero-shot 39.2%
  3. 3 ViT-H-14-378-quickgelu (dfn5b) Zero-shot 37.9%
  4. 4 ViT-H-14-quickgelu (metaclip_fullcc) Zero-shot 37.2%
  5. 5 ViT-SO400M-14-SigLIP-384 (webli) Zero-shot 36.5%
  6. 6 EVA02-E-14-plus (laion2b_s9b_b144k) Zero-shot 35.6%
  7. 7 ViT-H-14-CLIPA-336 (datacomp1b) Zero-shot 35.5%
  8. 8 EVA02-E-14 (laion2b_s4b_b115k) Zero-shot 34.8%
  9. 9 ViT-L-14-336 (openai) Zero-shot 34.5%
  10. 10 ViT-H-14-quickgelu (dfn5b) Zero-shot 34.4%
  11. 11 ViT-H-14-CLIPA (datacomp1b) Zero-shot 34%
  12. 12 ViT-L-14-quickgelu (metaclip_fullcc) Zero-shot 33.9%
  13. 13 ViT-bigG-14 (laion2b_s39b_b160k) Zero-shot 33.8%
  14. 14 EVA02-L-14-336 (merged2b_s6b_b61k) Zero-shot 33.5%
  15. 15 ViT-SO400M-14-SigLIP (webli) Zero-shot 32.4%
  16. 16 ViT-L-14 (openai) Zero-shot 31.9%
  17. 17 xlm-roberta-large-ViT-H-14 (frozen_laion5b_s13b_b90k) Zero-shot 31.7%
  18. 18 convnext_xxlarge (laion2b_s34b_b82k_augreg_soup) Zero-shot 31.7%
  19. 19 ViT-L-14 (datacomp_xl_s13b_b90k) Zero-shot 31.6%
  20. 20 convnext_xxlarge (laion2b_s34b_b82k_augreg_rewind) Zero-shot 31.6%
  21. 21 convnext_xxlarge (laion2b_s34b_b82k_augreg) Zero-shot 31.3%
  22. 22 ViT-H-14-CLIPA-336 (laion2b) Zero-shot 31.1%
  23. 23 EVA02-L-14 (merged2b_s4b_b131k) Zero-shot 30.9%
  24. 24 ViT-g-14 (laion2b_s34b_b88k) Zero-shot 30.9%
  25. 25 EVA01-g-14-plus (merged2b_s11b_b114k) Zero-shot 30.9%
  26. 26 ViT-L-14-quickgelu (metaclip_400m) Zero-shot 30.9%
  27. 27 ViT-L-14-CLIPA-336 (datacomp1b) Zero-shot 30.7%
  28. 28 ViT-H-14 (laion2b_s32b_b79k) Zero-shot 29.9%
  29. 29 ViT-L-14 (commonpool_xl_clip_s13b_b90k) Zero-shot 29.8%
  30. 30 RN50x64 (openai) Zero-shot 29.8%
  31. 31 ViT-L-14 (commonpool_xl_s13b_b90k) Zero-shot 29.6%
  32. 32 ViT-L-14-CLIPA (datacomp1b) Zero-shot 29.4%
  33. 33 ViT-g-14 (laion2b_s12b_b42k) Zero-shot 28.8%
  34. 34 EVA01-g-14 (laion400m_s11b_b41k) Zero-shot 28.6%
  35. 35 ViT-L-14-quickgelu (dfn2b) Zero-shot 28.2%
  36. 36 convnext_large_d_320 (laion2b_s29b_b131k_ft) Zero-shot 26.7%
  37. 37 convnext_large_d_320 (laion2b_s29b_b131k_ft_soup) Zero-shot 26.5%
  38. 38 ViT-L-14 (laion2b_s32b_b82k) Zero-shot 26.3%
  39. 39 coca_ViT-L-14 (laion2b_s13b_b90k) Zero-shot 25.5%
  40. 40 convnext_large_d (laion2b_s26b_b102k_augreg) Zero-shot 25.3%
  41. 41 ViT-L-14 (commonpool_xl_laion_s13b_b90k) Zero-shot 25%
  42. 42 ViT-L-16-SigLIP-384 (webli) Zero-shot 24.7%
  43. 43 RN50x16 (openai) Zero-shot 24.4%
  44. 44 ViT-L-14 (laion400m_e32) Zero-shot 23%
  45. 45 ViT-L-14 (laion400m_e31) Zero-shot 22.9%
  46. 46 ViT-B-16 (openai) Zero-shot 22.8%
  47. 47 ViT-B-16-quickgelu (metaclip_fullcc) Zero-shot 22.7%
  48. 48 ViT-B-16-quickgelu (metaclip_400m) Zero-shot 22.6%
  49. 49 convnext_base_w_320 (laion_aesthetic_s13b_b82k_augreg) Zero-shot 22.4%
  50. 50 convnext_base_w_320 (laion_aesthetic_s13b_b82k) Zero-shot 22.4%
  51. 51 convnext_base_w (laion_aesthetic_s13b_b82k) Zero-shot 22.3%
  52. 52 ViT-B-16 (datacomp_xl_s13b_b90k) Zero-shot 22.1%
  53. 53 ViT-L-16-SigLIP-256 (webli) Zero-shot 21.4%
  54. 54 EVA02-B-16 (merged2b_s8b_b131k) Zero-shot 21.4%
  55. 55 RN50x4 (openai) Zero-shot 20.4%
  56. 56 ViT-B-16 (laion2b_s34b_b88k) Zero-shot 20.3%
  57. 57 convnext_base_w (laion2b_s13b_b82k) Zero-shot 20.2%
  58. 58 convnext_base_w (laion2b_s13b_b82k_augreg) Zero-shot 20.2%
  59. 59 ViT-B-32-256 (datacomp_s34b_b86k) Zero-shot 19.7%
  60. 60 ViT-B-16 (dfn2b) Zero-shot 19.6%
  61. 61 ViT-B-16-SigLIP-512 (webli) Zero-shot 19.3%
  62. 62 xlm-roberta-base-ViT-B-32 (laion5b_s13b_b90k) Zero-shot 19%
  63. 63 ViT-B-16-plus-240 (laion400m_e32) Zero-shot 18.9%
  64. 64 ViT-B-16-plus-240 (laion400m_e31) Zero-shot 18.8%
  65. 65 ViT-B-16-SigLIP-384 (webli) Zero-shot 18.6%
  66. 66 ViT-B-16 (laion400m_e32) Zero-shot 18.1%
  67. 67 ViT-B-16 (laion400m_e31) Zero-shot 18%
  68. 68 coca_ViT-L-14 (mscoco_finetuned_laion2b_s13b_b90k) Zero-shot 18%
  69. 69 ViT-B-32-quickgelu (metaclip_fullcc) Zero-shot 17.6%
  70. 70 ViT-B-32 (datacomp_xl_s13b_b90k) Zero-shot 17.6%
  71. 71 ViT-B-32 (openai) Zero-shot 17.2%
  72. 72 ViT-B-32-quickgelu (openai) Zero-shot 17.2%
  73. 73 ViT-B-32-quickgelu (metaclip_400m) Zero-shot 17.2%
  74. 74 convnext_base (laion400m_s13b_b51k) Zero-shot 17%
  75. 75 RN101 (openai) Zero-shot 16.9%
  76. 76 RN101-quickgelu (openai) Zero-shot 16.9%
  77. 77 ViT-B-32 (laion2b_s34b_b79k) Zero-shot 16.7%
  78. 78 ViT-B-32 (laion2b_e16) Zero-shot 16.5%
  79. 79 ViT-B-16-SigLIP (webli) Zero-shot 15.9%
  80. 80 ViT-B-16-SigLIP-i18n-256 (webli) Zero-shot 15.9%
  81. 81 ViT-B-16-SigLIP-256 (webli) Zero-shot 15.8%
  82. 82 nllb-clip-large-siglip (v1) Zero-shot 15.5%
  83. 83 RN50 (openai) Zero-shot 15.4%
  84. 84 RN50-quickgelu (openai) Zero-shot 15.4%
  85. 85 ViT-B-32-quickgelu (laion400m_e31) Zero-shot 14.8%
  86. 86 ViT-B-32-quickgelu (laion400m_e32) Zero-shot 14.8%
  87. 87 roberta-ViT-B-32 (laion2b_s12b_b32k) Zero-shot 14.7%
  88. 88 coca_ViT-B-32 (laion2b_s13b_b90k) Zero-shot 14.5%
  89. 89 ViT-B-16 (datacomp_l_s1b_b8k) Zero-shot 14.3%
  90. 90 ViT-B-16 (commonpool_l_clip_s1b_b8k) Zero-shot 14.2%
  91. 91 ViT-B-32 (laion400m_e31) Zero-shot 13.6%
  92. 92 ViT-B-32 (laion400m_e32) Zero-shot 13.5%
  93. 93 ViT-B-16 (commonpool_l_image_s1b_b8k) Zero-shot 13.1%
  94. 94 ViT-B-16 (commonpool_l_s1b_b8k) Zero-shot 11.8%
  95. 95 ViT-B-16 (commonpool_l_basic_s1b_b8k) Zero-shot 11.7%
  96. 96 ViT-B-16 (commonpool_l_laion_s1b_b8k) Zero-shot 11.2%
  97. 97 ViT-B-16 (commonpool_l_text_s1b_b8k) Zero-shot 9.95%
  98. 98 RN101 (yfcc15m) Zero-shot 6.99%
  99. 99 nllb-clip-large (v1) Zero-shot 6.91%
  100. 100 RN101-quickgelu (yfcc15m) Zero-shot 6.83%
  101. 101 RN50 (yfcc15m) Zero-shot 6.42%
  102. 102 RN50-quickgelu (yfcc15m) Zero-shot 6.37%
  103. 103 nllb-clip-base-siglip (v1) Zero-shot 5.83%
  104. 104 ViT-B-32 (commonpool_m_image_s128m_b4k) Zero-shot 4.66%
  105. 105 ViT-B-32 (commonpool_m_clip_s128m_b4k) Zero-shot 4.58%
  106. 106 ViT-B-32 (datacomp_m_s128m_b4k) Zero-shot 4.53%
  107. 107 RN50-quickgelu (cc12m) Zero-shot 4.31%
  108. 108 ViT-B-32 (commonpool_m_basic_s128m_b4k) Zero-shot 4.23%
  109. 109 RN50 (cc12m) Zero-shot 4.22%
  110. 110 ViT-B-32 (commonpool_m_s128m_b4k) Zero-shot 3.62%
  111. 111 ViT-B-32 (commonpool_m_text_s128m_b4k) Zero-shot 3.55%
  112. 112 ViT-B-32 (commonpool_m_laion_s128m_b4k) Zero-shot 3.45%
  113. 113 nllb-clip-base (v1) Zero-shot 3.12%
  114. 114 ViT-B-32 (commonpool_s_s13m_b4k) Zero-shot 1.26%
  115. 115 ViT-B-32 (commonpool_s_text_s13m_b4k) Zero-shot 1.21%
  116. 116 ViT-B-32 (commonpool_s_basic_s13m_b4k) Zero-shot 1.20%
  117. 117 ViT-B-32 (commonpool_s_clip_s13m_b4k) Zero-shot 1.19%
  118. 118 ViT-B-32 (commonpool_s_image_s13m_b4k) Zero-shot 1.09%
  119. 119 ViT-B-32 (datacomp_s_s13m_b4k) Zero-shot 1.09%
  120. 120 ViT-B-32 (commonpool_s_laion_s13m_b4k) Zero-shot 0.98%
  121. 121 coca_ViT-B-32 (mscoco_finetuned_laion2b_s13b_b90k) Zero-shot 0.44%

Source: OpenCLIP’s leaderboard

#EntryScoreSettingDateSource
1 ViT-bigG-14-CLIPA-336 (datacomp1b) 2.5B 40.9% Zero-shot Official leaderboard
2 ViT-bigG-14-CLIPA (datacomp1b) 2.5B 39.2% Zero-shot Official leaderboard
3 ViT-H-14-378-quickgelu (dfn5b) 1B 37.9% Zero-shot Official leaderboard
4 ViT-H-14-quickgelu (metaclip_fullcc) 1B 37.2% Zero-shot Official leaderboard
5 ViT-SO400M-14-SigLIP-384 (webli) 0.9B 36.5% Zero-shot Official leaderboard
6 EVA02-E-14-plus (laion2b_s9b_b144k) 5B 35.6% Zero-shot Official leaderboard
7 ViT-H-14-CLIPA-336 (datacomp1b) 1B 35.5% Zero-shot Official leaderboard
8 EVA02-E-14 (laion2b_s4b_b115k) 4.7B 34.8% Zero-shot Official leaderboard
9 ViT-L-14-336 (openai) 0.4B 34.5% Zero-shot Official leaderboard
10 ViT-H-14-quickgelu (dfn5b) 1B 34.4% Zero-shot Official leaderboard
11 ViT-H-14-CLIPA (datacomp1b) 1B 34% Zero-shot Official leaderboard
12 ViT-L-14-quickgelu (metaclip_fullcc) 0.4B 33.9% Zero-shot Official leaderboard
13 ViT-bigG-14 (laion2b_s39b_b160k) 2.5B 33.8% Zero-shot Official leaderboard
14 EVA02-L-14-336 (merged2b_s6b_b61k) 0.4B 33.5% Zero-shot Official leaderboard
15 ViT-SO400M-14-SigLIP (webli) 0.9B 32.4% Zero-shot Official leaderboard
16 ViT-L-14 (openai) 0.4B 31.9% Zero-shot Official leaderboard
17 xlm-roberta-large-ViT-H-14 (frozen_laion5b_s13b_b90k) 1.2B 31.7% Zero-shot Official leaderboard
18 convnext_xxlarge (laion2b_s34b_b82k_augreg_soup) 1.2B 31.7% Zero-shot Official leaderboard
19 ViT-L-14 (datacomp_xl_s13b_b90k) 0.4B 31.6% Zero-shot Official leaderboard
20 convnext_xxlarge (laion2b_s34b_b82k_augreg_rewind) 1.2B 31.6% Zero-shot Official leaderboard
21 convnext_xxlarge (laion2b_s34b_b82k_augreg) 1.2B 31.3% Zero-shot Official leaderboard
22 ViT-H-14-CLIPA-336 (laion2b) 1B 31.1% Zero-shot Official leaderboard
23 EVA02-L-14 (merged2b_s4b_b131k) 0.4B 30.9% Zero-shot Official leaderboard
24 ViT-g-14 (laion2b_s34b_b88k) 1.4B 30.9% Zero-shot Official leaderboard
25 EVA01-g-14-plus (merged2b_s11b_b114k) 1.4B 30.9% Zero-shot Official leaderboard
26 ViT-L-14-quickgelu (metaclip_400m) 0.4B 30.9% Zero-shot Official leaderboard
27 ViT-L-14-CLIPA-336 (datacomp1b) 0.4B 30.7% Zero-shot Official leaderboard
28 ViT-H-14 (laion2b_s32b_b79k) 1B 29.9% Zero-shot Official leaderboard
29 ViT-L-14 (commonpool_xl_clip_s13b_b90k) 0.4B 29.8% Zero-shot Official leaderboard
30 RN50x64 (openai) 0.6B 29.8% Zero-shot Official leaderboard
31 ViT-L-14 (commonpool_xl_s13b_b90k) 0.4B 29.6% Zero-shot Official leaderboard
32 ViT-L-14-CLIPA (datacomp1b) 0.4B 29.4% Zero-shot Official leaderboard
33 ViT-g-14 (laion2b_s12b_b42k) 1.4B 28.8% Zero-shot Official leaderboard
34 EVA01-g-14 (laion400m_s11b_b41k) 1.1B 28.6% Zero-shot Official leaderboard
35 ViT-L-14-quickgelu (dfn2b) 0.4B 28.2% Zero-shot Official leaderboard
36 convnext_large_d_320 (laion2b_s29b_b131k_ft) 0.4B 26.7% Zero-shot Official leaderboard
37 convnext_large_d_320 (laion2b_s29b_b131k_ft_soup) 0.4B 26.5% Zero-shot Official leaderboard
38 ViT-L-14 (laion2b_s32b_b82k) 0.4B 26.3% Zero-shot Official leaderboard
39 coca_ViT-L-14 (laion2b_s13b_b90k) 0.6B 25.5% Zero-shot Official leaderboard
40 convnext_large_d (laion2b_s26b_b102k_augreg) 0.4B 25.3% Zero-shot Official leaderboard
41 ViT-L-14 (commonpool_xl_laion_s13b_b90k) 0.4B 25% Zero-shot Official leaderboard
42 ViT-L-16-SigLIP-384 (webli) 0.7B 24.7% Zero-shot Official leaderboard
43 RN50x16 (openai) 0.3B 24.4% Zero-shot Official leaderboard
44 ViT-L-14 (laion400m_e32) 0.4B 23% Zero-shot Official leaderboard
45 ViT-L-14 (laion400m_e31) 0.4B 22.9% Zero-shot Official leaderboard
46 ViT-B-16 (openai) 0.1B 22.8% Zero-shot Official leaderboard
47 ViT-B-16-quickgelu (metaclip_fullcc) 0.1B 22.7% Zero-shot Official leaderboard
48 ViT-B-16-quickgelu (metaclip_400m) 0.1B 22.6% Zero-shot Official leaderboard
49 convnext_base_w_320 (laion_aesthetic_s13b_b82k_augreg) 0.2B 22.4% Zero-shot Official leaderboard
50 convnext_base_w_320 (laion_aesthetic_s13b_b82k) 0.2B 22.4% Zero-shot Official leaderboard
51 convnext_base_w (laion_aesthetic_s13b_b82k) 0.2B 22.3% Zero-shot Official leaderboard
52 ViT-B-16 (datacomp_xl_s13b_b90k) 0.1B 22.1% Zero-shot Official leaderboard
53 ViT-L-16-SigLIP-256 (webli) 0.7B 21.4% Zero-shot Official leaderboard
54 EVA02-B-16 (merged2b_s8b_b131k) 0.1B 21.4% Zero-shot Official leaderboard
55 RN50x4 (openai) 0.2B 20.4% Zero-shot Official leaderboard
56 ViT-B-16 (laion2b_s34b_b88k) 0.1B 20.3% Zero-shot Official leaderboard
57 convnext_base_w (laion2b_s13b_b82k) 0.2B 20.2% Zero-shot Official leaderboard
58 convnext_base_w (laion2b_s13b_b82k_augreg) 0.2B 20.2% Zero-shot Official leaderboard
59 ViT-B-32-256 (datacomp_s34b_b86k) 0.2B 19.7% Zero-shot Official leaderboard
60 ViT-B-16 (dfn2b) 0.1B 19.6% Zero-shot Official leaderboard
61 ViT-B-16-SigLIP-512 (webli) 0.2B 19.3% Zero-shot Official leaderboard
62 xlm-roberta-base-ViT-B-32 (laion5b_s13b_b90k) 0.4B 19% Zero-shot Official leaderboard
63 ViT-B-16-plus-240 (laion400m_e32) 0.2B 18.9% Zero-shot Official leaderboard
64 ViT-B-16-plus-240 (laion400m_e31) 0.2B 18.8% Zero-shot Official leaderboard
65 ViT-B-16-SigLIP-384 (webli) 0.2B 18.6% Zero-shot Official leaderboard
66 ViT-B-16 (laion400m_e32) 0.1B 18.1% Zero-shot Official leaderboard
67 ViT-B-16 (laion400m_e31) 0.1B 18% Zero-shot Official leaderboard
68 coca_ViT-L-14 (mscoco_finetuned_laion2b_s13b_b90k) 0.6B 18% Zero-shot Official leaderboard
69 ViT-B-32-quickgelu (metaclip_fullcc) 0.2B 17.6% Zero-shot Official leaderboard
70 ViT-B-32 (datacomp_xl_s13b_b90k) 0.2B 17.6% Zero-shot Official leaderboard
71 ViT-B-32 (openai) 0.2B 17.2% Zero-shot Official leaderboard
72 ViT-B-32-quickgelu (openai) 0.2B 17.2% Zero-shot Official leaderboard
73 ViT-B-32-quickgelu (metaclip_400m) 0.2B 17.2% Zero-shot Official leaderboard
74 convnext_base (laion400m_s13b_b51k) 0.2B 17% Zero-shot Official leaderboard
75 RN101 (openai) 0.1B 16.9% Zero-shot Official leaderboard
76 RN101-quickgelu (openai) 0.1B 16.9% Zero-shot Official leaderboard
77 ViT-B-32 (laion2b_s34b_b79k) 0.2B 16.7% Zero-shot Official leaderboard
78 ViT-B-32 (laion2b_e16) 0.2B 16.5% Zero-shot Official leaderboard
79 ViT-B-16-SigLIP (webli) 0.2B 15.9% Zero-shot Official leaderboard
80 ViT-B-16-SigLIP-i18n-256 (webli) 0.4B 15.9% Zero-shot Official leaderboard
81 ViT-B-16-SigLIP-256 (webli) 0.2B 15.8% Zero-shot Official leaderboard
82 nllb-clip-large-siglip (v1) 1.2B 15.5% Zero-shot Official leaderboard
83 RN50 (openai) 0.1B 15.4% Zero-shot Official leaderboard
84 RN50-quickgelu (openai) 0.1B 15.4% Zero-shot Official leaderboard
85 ViT-B-32-quickgelu (laion400m_e31) 0.2B 14.8% Zero-shot Official leaderboard
86 ViT-B-32-quickgelu (laion400m_e32) 0.2B 14.8% Zero-shot Official leaderboard
87 roberta-ViT-B-32 (laion2b_s12b_b32k) 0.2B 14.7% Zero-shot Official leaderboard
88 coca_ViT-B-32 (laion2b_s13b_b90k) 0.3B 14.5% Zero-shot Official leaderboard
89 ViT-B-16 (datacomp_l_s1b_b8k) 0.1B 14.3% Zero-shot Official leaderboard
90 ViT-B-16 (commonpool_l_clip_s1b_b8k) 0.1B 14.2% Zero-shot Official leaderboard
91 ViT-B-32 (laion400m_e31) 0.2B 13.6% Zero-shot Official leaderboard
92 ViT-B-32 (laion400m_e32) 0.2B 13.5% Zero-shot Official leaderboard
93 ViT-B-16 (commonpool_l_image_s1b_b8k) 0.1B 13.1% Zero-shot Official leaderboard
94 ViT-B-16 (commonpool_l_s1b_b8k) 0.1B 11.8% Zero-shot Official leaderboard
95 ViT-B-16 (commonpool_l_basic_s1b_b8k) 0.1B 11.7% Zero-shot Official leaderboard
96 ViT-B-16 (commonpool_l_laion_s1b_b8k) 0.1B 11.2% Zero-shot Official leaderboard
97 ViT-B-16 (commonpool_l_text_s1b_b8k) 0.1B 9.95% Zero-shot Official leaderboard
98 RN101 (yfcc15m) 0.1B 6.99% Zero-shot Official leaderboard
99 nllb-clip-large (v1) 1.4B 6.91% Zero-shot Official leaderboard
100 RN101-quickgelu (yfcc15m) 0.1B 6.83% Zero-shot Official leaderboard
101 RN50 (yfcc15m) 0.1B 6.42% Zero-shot Official leaderboard
102 RN50-quickgelu (yfcc15m) 0.1B 6.37% Zero-shot Official leaderboard
103 nllb-clip-base-siglip (v1) 0.5B 5.83% Zero-shot Official leaderboard
104 ViT-B-32 (commonpool_m_image_s128m_b4k) 0.2B 4.66% Zero-shot Official leaderboard
105 ViT-B-32 (commonpool_m_clip_s128m_b4k) 0.2B 4.58% Zero-shot Official leaderboard
106 ViT-B-32 (datacomp_m_s128m_b4k) 0.2B 4.53% Zero-shot Official leaderboard
107 RN50-quickgelu (cc12m) 0.1B 4.31% Zero-shot Official leaderboard
108 ViT-B-32 (commonpool_m_basic_s128m_b4k) 0.2B 4.23% Zero-shot Official leaderboard
109 RN50 (cc12m) 0.1B 4.22% Zero-shot Official leaderboard
110 ViT-B-32 (commonpool_m_s128m_b4k) 0.2B 3.62% Zero-shot Official leaderboard
111 ViT-B-32 (commonpool_m_text_s128m_b4k) 0.2B 3.55% Zero-shot Official leaderboard
112 ViT-B-32 (commonpool_m_laion_s128m_b4k) 0.2B 3.45% Zero-shot Official leaderboard
113 nllb-clip-base (v1) 0.5B 3.12% Zero-shot Official leaderboard
114 ViT-B-32 (commonpool_s_s13m_b4k) 0.2B 1.26% Zero-shot Official leaderboard
115 ViT-B-32 (commonpool_s_text_s13m_b4k) 0.2B 1.21% Zero-shot Official leaderboard
116 ViT-B-32 (commonpool_s_basic_s13m_b4k) 0.2B 1.20% Zero-shot Official leaderboard
117 ViT-B-32 (commonpool_s_clip_s13m_b4k) 0.2B 1.19% Zero-shot Official leaderboard
118 ViT-B-32 (commonpool_s_image_s13m_b4k) 0.2B 1.09% Zero-shot Official leaderboard
119 ViT-B-32 (datacomp_s_s13m_b4k) 0.2B 1.09% Zero-shot Official leaderboard
120 ViT-B-32 (commonpool_s_laion_s13m_b4k) 0.2B 0.98% Zero-shot Official leaderboard
121 coca_ViT-B-32 (mscoco_finetuned_laion2b_s13b_b90k) 0.3B 0.44% Zero-shot Official leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Vision

All 636 in Vision
  • MMMU In use 11.5K college-level multimodal questions across 30 subjects. Multiple-choice and open accuracy. Qwen 3.6 Plus 86%
  • MMMU-Pro In use Harder MMMU: college-level multimodal questions with more options and vision-only inputs to remove text shortcuts. GPT-5.6 Sol 84.6%
  • CharXiv In use Chart understanding on real arXiv figures. Reasoning questions require synthesizing information from complex charts. Claude Fable 5 93.5%
  • MathVista In use Math reasoning in visual contexts (charts, geometry, puzzles) from 31 datasets. Answer accuracy. Seed2.1 Pro 90.7%
  • MATH-Vision (MathVision) In use 3,040 competition math problems with visual context. Answer accuracy. Qwen 3.8 Max 97.7%
  • MMStar In use Models answer 1,500 human-curated image questions that cannot be solved without the image, across 6 core capabilities. Scored by accuracy. Qwen 3.8 Max 85.9%

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (121 entries).
  • Pass Models scored 121 entries on its leaderboard, none a model we track.
  • Note Newest score No scores yet.
  • Note Frontier models No models scored yet.
  • Note Headroom No scores yet.
Leaderboard import 3 pass
  • Pass Importer We read the board on OpenCLIP: 121 entries at the last read, none a model we track.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check