Benchmark Almanac

Icelandic WinoGrande

Gemini 3.7 Flash 96.3% leads since August 2026
Not in model cards

Models complete Icelandic sentences by choosing which referent fits the context. The evaluation uses an Icelandic adaptation of WinoGrande.

Released
June 2022
Kind
Reasoning in many languages
Level
Everyday
Scored
Checked automatically
Answers
Multiple choice
Tasks
All public
Measures
Capability
Language
Icelandic
In and out
Text → Text
Interaction
Single turn
Refresh
One fixed set
Run by
Anyone
Based on
WinoGrande
Strongest model tested
Claude Fable 5 #12 on the capability index
Last model added
August 2026
Scores refreshed
November 20th, 2026
93
Entries on its own leaderboard, 70 models we track

Gemini 3.7 Flash leads with 96.3% among models released by August 2026 Gemini 3.7 Flash leads with 96.3% among models released by August 2026

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.

The newest model with a score here came out in August 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

93 entries. Scroll sideways for the rest.

  1. 96.3 Gemini 3.7 Flash
  2. 96.1 Gemini 3.1 Pro
  3. 96.0 Claude Fable 5
  4. 96.0 Gemini 3.5 Flash
  5. 95.6 Gemini 3 Pro
  6. 95.6 Gemini 3 Flash
  7. 95.6 GPT-5.5
  8. 95.5 Gemini 3.6 Flash
  9. 94.9 Claude Opus 4.8
  10. 94.7 Claude Opus 4.5
  11. 94.6 Claude Opus 4.6
  12. 94.5 GPT-5.6 Sol
  13. 94.4 GPT-5
  14. 93.7 GPT-5.4
  15. 92.8 o1-preview
  16. 92.8 Gemini 2.5 Pro
  17. 92.8 GPT-5.1
  18. 92.8 Claude Opus 4.7
  19. 92.7 Claude Sonnet 4.5
  20. 92.2 GPT-5.2
  21. 92.1 Gemini 3.1 Flash-Lite
  22. 92.0 Gemma 4 31B IT
  23. 91.8 Gemini 2.5 Flash
  24. 91.8 Claude Sonnet 4.6
  25. 91.8 GPT-5.6 Terra
  26. 91.6 DeepSeek-V4-Pro
  27. 91.3 Claude 3.5 Sonnet
  28. 91.2 GLM-5.2
  29. 90.3 Grok 4.3
  30. 90.3 Claude Sonnet 4
  31. 90.3 Qwen3.5 397B-A17B
  32. 90.1 Gemini 2.0 Pro
  33. 89.7 Claude 3.7 Sonnet
  34. 89.7 Kimi K2.5
  35. 88.4 Gemma 4 26B A4B
  36. 87.5 GPT-5 mini
  37. 87.4 GPT-4.1
  38. 87.0 Claude 3 Opus
  39. 86.0 GPT-5.6 Luna
  40. 85.8 GPT-4 Turbo
  41. 85.4 GPT-4o
  42. 84.4 Gemini 2.0 Flash
  43. 83.7 o4-mini
  44. 83.5 GPT-4
  45. 83.5 GPT-4o
  46. 82.7 cyboghostginx/gemma-4-31B-it-Adetayo
  47. 81.4 DeepSeek-R1
  48. 81.2 GPT-4
  49. 77.8 o3-mini
  50. 77.8 MiniMax-M2.5
  51. 75.9 DeepSeek-V3
  52. 75.3 DeepSeek-R1-Distill-Llama-70B
  53. 75.3 Gemini 2.5 Flash-Lite
  54. 74.6 Mistral Large 3
  55. 72.6 o1-mini
  56. 71.8 cyboghostginx/gemma-3-27b-it-Adetayo
  57. 71.7 GPT-5 nano
  58. 70.9 GPT-4.1 mini
  59. 70.6 NousResearch/Hermes-3-Llama-3.1-405B-FP8
  60. 70.4 Gemma 3 27B
  61. 70.1 meta-llama/Meta-Llama-3.1-70B-Instruct
  62. 70.0 Llama-3.1-Nemotron-70B-Instruct
  63. 68.7 Llama 3.3 70B Instruct
  64. 68.3 mistral/mistral-medium-2508
  65. 65.3 GPT-4o mini
  66. 65.0 Gemma 3 12B
  67. 64.4 Claude 3.5 Haiku
  68. 61.4 Qwen2-72B
  69. 60.0 meta-llama/Meta-Llama-3-70B-Instruct
  70. 56.9 Sigurdur/icebreaker
  71. 56.5 AI-Sweden-Models/gpt-sw3-356m-instruct
  72. 55.1 mistralai/Mistral-Nemo-Instruct-2407
  73. 55.1 Claude 2.1
  74. 54.7 mistral/ministral-3b-2410
  75. 54.3 LumiOpen/Viking-33B
  76. 53.9 AI-Sweden-Models/gpt-sw3-126m-instruct
  77. 52.9 Gemma 3 1B
  78. 52.9 google/gemma-2-9b-it
  79. 52.5 Llama 3.1-8B
  80. 52.1 AI-Sweden-Models/gpt-sw3-1.3b-instruct
  81. 52.1 Gemma 3 4B
  82. 52.0 cyboghostginx/gemma-3-4b-it-Adetayo
  83. 52.0 GPT-3.5 Turbo
  84. 52.0 GPT-4.1 nano
  85. 51.9 meta-llama/Meta-Llama-3.1-8B-Instruct
  86. 50.9 meta-llama/Llama-3.2-1B-Instruct
  87. 49.8 AI-Sweden-Models/gpt-sw3-20b-instruct
  88. 49.7 meta-llama/Llama-3.2-3B-Instruct
  89. 49.6 Qwen2-7B-Instruct
  90. 49.4 AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct
  91. 49.1 LumiOpen/Viking-13B
  92. 49.1 meta-llama/Meta-Llama-3-8B-Instruct
  93. 49.0 LumiOpen/Viking-7B
  1. 1 Gemini 3.7 Flash 3-shot · thinking high 96.3%
  2. 2 Gemini 3.1 Pro 3-shot · thinking high 96.1%
  3. 3 Claude Fable 5 3-shot · thinking high 96%
  4. 4 Gemini 3.5 Flash 3-shot · thinking high 96%
  5. 5 Gemini 3 Pro 3-shot · thinking high 95.6%
  6. 6 Gemini 3 Flash 3-shot · thinking high 95.6%
  7. 7 GPT-5.5 3-shot · thinking high 95.6%
  8. 8 Gemini 3.6 Flash 3-shot · thinking high 95.5%
  9. 9 Claude Opus 4.8 3-shot · thinking high 94.9%
  10. 10 Claude Opus 4.5 3-shot · thinking high 94.7%
  11. 11 Claude Opus 4.6 3-shot · thinking high 94.6%
  12. 12 GPT-5.6 Sol 3-shot · thinking high 94.5%
  13. 13 GPT-5 3-shot · thinking high 94.4%
  14. 14 GPT-5.4 3-shot · thinking high 93.7%
  15. 15 o1-preview 3-shot · thinking on 92.8%
  16. 16 Gemini 2.5 Pro Jun 2025, 3-shot · thinking on 92.8%
  17. 17 GPT-5.1 3-shot · thinking high 92.8%
  18. 18 Claude Opus 4.7 3-shot · thinking high 92.8%
  19. 19 Claude Sonnet 4.5 3-shot · thinking high 92.7%
  20. 20 GPT-5.2 3-shot · thinking high 92.2%
  21. 21 Gemini 3.1 Flash-Lite 3-shot · thinking high 92.1%
  22. 22 Gemma 4 31B IT 3-shot · thinking on 92%
  23. 23 Gemini 2.5 Flash Sep 2025, 3-shot · thinking high 91.8%
  24. 24 Claude Sonnet 4.6 3-shot · thinking high 91.8%
  25. 25 GPT-5.6 Terra 3-shot · thinking high 91.8%
  26. 26 DeepSeek-V4-Pro 3-shot · thinking on 91.6%
  27. 27 Claude 3.5 Sonnet 3-shot 91.3%
  28. 28 GLM-5.2 3-shot · thinking on 91.2%
  29. 29 Grok 4.3 3-shot · thinking on 90.3%
  30. 30 Claude Sonnet 4 3-shot · thinking on 90.3%
  31. 31 Qwen3.5 397B-A17B 3-shot · thinking on 90.3%
  32. 32 Gemini 2.0 Pro 3-shot · thinking on 90.1%
  33. 33 Claude 3.7 Sonnet 3-shot 89.7%
  34. 34 Kimi K2.5 3-shot · thinking on 89.7%
  35. 35 Gemma 4 26B A4B 3-shot · thinking on 88.4%
  36. 36 GPT-5 mini 3-shot · thinking high 87.5%
  37. 37 GPT-4.1 3-shot 87.4%
  38. 38 Claude 3 Opus 3-shot 87%
  39. 39 GPT-5.6 Luna 3-shot · thinking high 86%
  40. 40 GPT-4 Turbo Apr 2024, 3-shot 85.8%
  41. 41 GPT-4o Aug 2024, 3-shot 85.4%
  42. 42 Gemini 2.0 Flash Feb 2025, 3-shot 84.4%
  43. 43 o4-mini 3-shot · thinking on 83.7%
  44. 44 GPT-4 Jun 2023, 3-shot 83.5%
  45. 45 GPT-4o May 2024, 3-shot 83.5%
  46. 46 cyboghostginx/gemma-4-31B-it-Adetayo 3-shot 82.7%
  47. 47 DeepSeek-R1 May 2025, 3-shot · thinking on 81.4%
  48. 48 GPT-4 Mar 2023, 3-shot 81.2%
  49. 49 o3-mini 3-shot · thinking on 77.8%
  50. 50 MiniMax-M2.5 3-shot · thinking on 77.8%
  51. 51 DeepSeek-V3 Mar 2025, 3-shot 75.9%
  52. 52 DeepSeek-R1-Distill-Llama-70B 3-shot · thinking on 75.3%
  53. 53 Gemini 2.5 Flash-Lite Sep 2025, 3-shot · thinking high 75.3%
  54. 54 Mistral Large 3 3-shot 74.6%
  55. 55 o1-mini 3-shot · thinking on 72.6%
  56. 56 cyboghostginx/gemma-3-27b-it-Adetayo 3-shot 71.8%
  57. 57 GPT-5 nano 3-shot · thinking high 71.7%
  58. 58 GPT-4.1 mini 3-shot 70.9%
  59. 59 NousResearch/Hermes-3-Llama-3.1-405B-FP8 3-shot 70.6%
  60. 60 Gemma 3 27B 3-shot 70.4%
  61. 61 meta-llama/Meta-Llama-3.1-70B-Instruct 3-shot 70.1%
  62. 62 Llama-3.1-Nemotron-70B-Instruct 3-shot 70%
  63. 63 Llama 3.3 70B Instruct 3-shot 68.7%
  64. 64 mistral/mistral-medium-2508 3-shot 68.3%
  65. 65 GPT-4o mini 3-shot 65.3%
  66. 66 Gemma 3 12B 3-shot 65%
  67. 67 Claude 3.5 Haiku 3-shot 64.4%
  68. 68 Qwen2-72B 3-shot 61.4%
  69. 69 meta-llama/Meta-Llama-3-70B-Instruct 3-shot 60%
  70. 70 Sigurdur/icebreaker 3-shot 56.9%
  71. 71 AI-Sweden-Models/gpt-sw3-356m-instruct 3-shot 56.5%
  72. 72 mistralai/Mistral-Nemo-Instruct-2407 3-shot 55.1%
  73. 73 Claude 2.1 3-shot 55.1%
  74. 74 mistral/ministral-3b-2410 3-shot 54.7%
  75. 75 LumiOpen/Viking-33B 3-shot 54.3%
  76. 76 AI-Sweden-Models/gpt-sw3-126m-instruct 3-shot 53.9%
  77. 77 Gemma 3 1B 3-shot 52.9%
  78. 78 google/gemma-2-9b-it 3-shot 52.9%
  79. 79 Llama 3.1-8B 3-shot 52.5%
  80. 80 AI-Sweden-Models/gpt-sw3-1.3b-instruct 3-shot 52.1%
  81. 81 Gemma 3 4B 3-shot 52.1%
  82. 82 cyboghostginx/gemma-3-4b-it-Adetayo 3-shot 52%
  83. 83 GPT-3.5 Turbo Jan 2024, 3-shot 52%
  84. 84 GPT-4.1 nano 3-shot 52%
  85. 85 meta-llama/Meta-Llama-3.1-8B-Instruct 3-shot 51.9%
  86. 86 meta-llama/Llama-3.2-1B-Instruct 3-shot 50.9%
  87. 87 AI-Sweden-Models/gpt-sw3-20b-instruct 3-shot 49.8%
  88. 88 meta-llama/Llama-3.2-3B-Instruct 3-shot 49.7%
  89. 89 Qwen2-7B-Instruct 3-shot 49.6%
  90. 90 AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct 3-shot 49.4%
  91. 91 LumiOpen/Viking-13B 3-shot 49.1%
  92. 92 meta-llama/Meta-Llama-3-8B-Instruct 3-shot 49.1%
  93. 93 LumiOpen/Viking-7B 3-shot 49%

Source: Official Icelandic WinoGrande leaderboard

  1. 1 Gemini 3.7 Flash 3-shot · thinking high 96.3%
  2. 2 Gemini 3.1 Pro 3-shot · thinking high 96.1%
  3. 3 Claude Fable 5 3-shot · thinking high 96%
  4. 4 Gemini 3.5 Flash 3-shot · thinking high 96%
  5. 5 Gemini 3 Pro 3-shot · thinking high 95.6%
  6. 6 Gemini 3 Flash 3-shot · thinking high 95.6%
  7. 7 GPT-5.5 3-shot · thinking high 95.6%
  8. 8 Gemini 3.6 Flash 3-shot · thinking high 95.5%
  9. 9 Claude Opus 4.8 3-shot · thinking high 94.9%
  10. 10 Claude Opus 4.5 3-shot · thinking high 94.7%
  11. 11 Claude Opus 4.6 3-shot · thinking high 94.6%
  12. 12 GPT-5.6 Sol 3-shot · thinking high 94.5%
  13. 13 GPT-5 3-shot · thinking high 94.4%
  14. 14 GPT-5.4 3-shot · thinking high 93.7%
  15. 15 o1-preview 3-shot · thinking on 92.8%
  16. 16 Gemini 2.5 Pro Jun 2025, 3-shot · thinking on 92.8%
  17. 17 GPT-5.1 3-shot · thinking high 92.8%
  18. 18 Claude Opus 4.7 3-shot · thinking high 92.8%
  19. 19 Claude Sonnet 4.5 3-shot · thinking high 92.7%
  20. 20 GPT-5.2 3-shot · thinking high 92.2%
  21. 21 Gemini 3.1 Flash-Lite 3-shot · thinking high 92.1%
  22. 22 Gemma 4 31B IT 3-shot · thinking on 92%
  23. 23 Gemini 2.5 Flash Sep 2025, 3-shot · thinking high 91.8%
  24. 24 Claude Sonnet 4.6 3-shot · thinking high 91.8%
  25. 25 GPT-5.6 Terra 3-shot · thinking high 91.8%
  26. 26 DeepSeek-V4-Pro 3-shot · thinking on 91.6%
  27. 27 Claude 3.5 Sonnet 3-shot 91.3%
  28. 28 GLM-5.2 3-shot · thinking on 91.2%
  29. 29 Grok 4.3 3-shot · thinking on 90.3%
  30. 30 Claude Sonnet 4 3-shot · thinking on 90.3%
  31. 31 Qwen3.5 397B-A17B 3-shot · thinking on 90.3%
  32. 32 Gemini 2.0 Pro 3-shot · thinking on 90.1%
  33. 33 Claude 3.7 Sonnet 3-shot 89.7%
  34. 34 Kimi K2.5 3-shot · thinking on 89.7%
  35. 35 Gemma 4 26B A4B 3-shot · thinking on 88.4%
  36. 36 GPT-5 mini 3-shot · thinking high 87.5%
  37. 37 GPT-4.1 3-shot 87.4%
  38. 38 Claude 3 Opus 3-shot 87%
  39. 39 GPT-5.6 Luna 3-shot · thinking high 86%
  40. 40 GPT-4 Turbo Apr 2024, 3-shot 85.8%
  41. 41 GPT-4o Aug 2024, 3-shot 85.4%
  42. 42 Gemini 2.0 Flash Feb 2025, 3-shot 84.4%
  43. 43 o4-mini 3-shot · thinking on 83.7%
  44. 44 GPT-4 Jun 2023, 3-shot 83.5%
  45. 45 GPT-4o May 2024, 3-shot 83.5%
  46. 46 DeepSeek-R1 May 2025, 3-shot · thinking on 81.4%
  47. 47 GPT-4 Mar 2023, 3-shot 81.2%
  48. 48 o3-mini 3-shot · thinking on 77.8%
  49. 49 MiniMax-M2.5 3-shot · thinking on 77.8%
  50. 50 DeepSeek-V3 Mar 2025, 3-shot 75.9%
  51. 51 DeepSeek-R1-Distill-Llama-70B 3-shot · thinking on 75.3%
  52. 52 Gemini 2.5 Flash-Lite Sep 2025, 3-shot · thinking high 75.3%
  53. 53 Mistral Large 3 3-shot 74.6%
  54. 54 o1-mini 3-shot · thinking on 72.6%
  55. 55 GPT-5 nano 3-shot · thinking high 71.7%
  56. 56 GPT-4.1 mini 3-shot 70.9%
  57. 57 Gemma 3 27B 3-shot 70.4%
  58. 58 Llama-3.1-Nemotron-70B-Instruct 3-shot 70%
  59. 59 Llama 3.3 70B Instruct 3-shot 68.7%
  60. 60 GPT-4o mini 3-shot 65.3%
  61. 61 Gemma 3 12B 3-shot 65%
  62. 62 Claude 3.5 Haiku 3-shot 64.4%
  63. 63 Qwen2-72B 3-shot 61.4%
  64. 64 Claude 2.1 3-shot 55.1%
  65. 65 Gemma 3 1B 3-shot 52.9%
  66. 66 Llama 3.1-8B 3-shot 52.5%
  67. 67 Gemma 3 4B 3-shot 52.1%
  68. 68 GPT-3.5 Turbo Jan 2024, 3-shot 52%
  69. 69 GPT-4.1 nano 3-shot 52%
  70. 70 Qwen2-7B-Instruct 3-shot 49.6%

Source: Official Icelandic WinoGrande leaderboard

#EntryScoreSettingDateLinkSource
1 Gemini 3.7 Flash 96.3% 3-shot · thinking high Aug 2026 ai.google.dev Official leaderboard
2 Gemini 3.1 Pro 96.1% 3-shot · thinking high Feb 2026 ai.google.dev Official leaderboard
3 Claude Fable 5 96% 3-shot · thinking high Jun 2026 anthropic.com Official leaderboard
4 Gemini 3.5 Flash 96% 3-shot · thinking high May 2026 ai.google.dev Official leaderboard
5 Gemini 3 Pro 95.6% 3-shot · thinking high Nov 2025 ai.google.dev Official leaderboard
6 Gemini 3 Flash 95.6% 3-shot · thinking high Dec 2025 ai.google.dev Official leaderboard
7 GPT-5.5 95.6% 3-shot · thinking high Apr 2026 developers.openai.com Official leaderboard
8 Gemini 3.6 Flash 95.5% 3-shot · thinking high Jul 2026 ai.google.dev Official leaderboard
9 Claude Opus 4.8 94.9% 3-shot · thinking high May 2026 anthropic.com Official leaderboard
10 Claude Opus 4.5 94.7% 3-shot · thinking high Nov 2025 huggingface.co Official leaderboard
11 Claude Opus 4.6 94.6% 3-shot · thinking high Feb 2026 anthropic.com Official leaderboard
12 GPT-5.6 Sol 94.5% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
13 GPT-5 94.4% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
14 GPT-5.4 93.7% 3-shot · thinking high Mar 2026 huggingface.co Official leaderboard
15 o1-preview 92.8% 3-shot · thinking on Sep 2024 huggingface.co Official leaderboard
16 Gemini 2.5 Pro Jun 2025 92.8% 3-shot · thinking on Jun 2025 huggingface.co Official leaderboard
17 GPT-5.1 92.8% 3-shot · thinking high Nov 2025 huggingface.co Official leaderboard
18 Claude Opus 4.7 92.8% 3-shot · thinking high Apr 2026 anthropic.com Official leaderboard
19 Claude Sonnet 4.5 92.7% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
20 GPT-5.2 92.2% 3-shot · thinking high Dec 2025 huggingface.co Official leaderboard
21 Gemini 3.1 Flash-Lite 92.1% 3-shot · thinking high Mar 2026 ai.google.dev Official leaderboard
22 Gemma 4 31B IT 92% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
23 Gemini 2.5 Flash Sep 2025 91.8% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
24 Claude Sonnet 4.6 91.8% 3-shot · thinking high Feb 2026 anthropic.com Official leaderboard
25 GPT-5.6 Terra 91.8% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
26 DeepSeek-V4-Pro 91.6% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
27 Claude 3.5 Sonnet 91.3% 3-shot Jun 2024 huggingface.co Official leaderboard
28 GLM-5.2 91.2% 3-shot · thinking on Jun 2026 huggingface.co Official leaderboard
29 Grok 4.3 90.3% 3-shot · thinking on Apr 2026 docs.x.ai Official leaderboard
30 Claude Sonnet 4 90.3% 3-shot · thinking on May 2025 huggingface.co Official leaderboard
31 Qwen3.5 397B-A17B 90.3% 3-shot · thinking on Feb 2026 huggingface.co Official leaderboard
32 Gemini 2.0 Pro 90.1% 3-shot · thinking on Feb 2025 huggingface.co Official leaderboard
33 Claude 3.7 Sonnet 89.7% 3-shot Feb 2025 huggingface.co Official leaderboard
34 Kimi K2.5 89.7% 3-shot · thinking on Jan 2026 kimi.com Official leaderboard
35 Gemma 4 26B A4B 88.4% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
36 GPT-5 mini 87.5% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
37 GPT-4.1 87.4% 3-shot Apr 2025 huggingface.co Official leaderboard
38 Claude 3 Opus 87% 3-shot Feb 2024 huggingface.co Official leaderboard
39 GPT-5.6 Luna 86% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
40 GPT-4 Turbo Apr 2024 85.8% 3-shot Apr 2024 huggingface.co Official leaderboard
41 GPT-4o Aug 2024 85.4% 3-shot Aug 2024 huggingface.co Official leaderboard
42 Gemini 2.0 Flash Feb 2025 84.4% 3-shot Feb 2025 huggingface.co Official leaderboard
43 o4-mini 83.7% 3-shot · thinking on Apr 2025 huggingface.co Official leaderboard
44 GPT-4 Jun 2023 83.5% 3-shot Jun 2023 huggingface.co Official leaderboard
45 GPT-4o May 2024 83.5% 3-shot May 2024 huggingface.co Official leaderboard
46 cyboghostginx/gemma-4-31B-it-Adetayo 31B 82.7% 3-shot huggingface.co Official leaderboard
47 DeepSeek-R1 May 2025 81.4% 3-shot · thinking on May 2025 huggingface.co Official leaderboard
48 GPT-4 Mar 2023 81.2% 3-shot Mar 2023 huggingface.co Official leaderboard
49 o3-mini 77.8% 3-shot · thinking on Jan 2025 huggingface.co Official leaderboard
50 MiniMax-M2.5 77.8% 3-shot · thinking on Feb 2026 minimax.io Official leaderboard
51 DeepSeek-V3 Mar 2025 75.9% 3-shot Mar 2025 huggingface.co Official leaderboard
52 DeepSeek-R1-Distill-Llama-70B 75.3% 3-shot · thinking on Jan 2025 huggingface.co Official leaderboard
53 Gemini 2.5 Flash-Lite Sep 2025 75.3% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
54 Mistral Large 3 74.6% 3-shot Dec 2025 huggingface.co Official leaderboard
55 o1-mini 72.6% 3-shot · thinking on Sep 2024 huggingface.co Official leaderboard
56 cyboghostginx/gemma-3-27b-it-Adetayo 27B 71.8% 3-shot huggingface.co Official leaderboard
57 GPT-5 nano 71.7% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
58 GPT-4.1 mini 70.9% 3-shot Apr 2025 huggingface.co Official leaderboard
59 NousResearch/Hermes-3-Llama-3.1-405B-FP8 405.9B 70.6% 3-shot huggingface.co Official leaderboard
60 Gemma 3 27B 70.4% 3-shot Mar 2025 huggingface.co Official leaderboard
61 meta-llama/Meta-Llama-3.1-70B-Instruct 70.6B 70.1% 3-shot huggingface.co Official leaderboard
62 Llama-3.1-Nemotron-70B-Instruct 70% 3-shot Oct 2024 huggingface.co Official leaderboard
63 Llama 3.3 70B Instruct 68.7% 3-shot Dec 2024 huggingface.co Official leaderboard
64 mistral/mistral-medium-2508 68.3% 3-shot huggingface.co Official leaderboard
65 GPT-4o mini 65.3% 3-shot Jul 2024 huggingface.co Official leaderboard
66 Gemma 3 12B 65% 3-shot Mar 2025 huggingface.co Official leaderboard
67 Claude 3.5 Haiku 64.4% 3-shot Oct 2024 huggingface.co Official leaderboard
68 Qwen2-72B 61.4% 3-shot Jun 2024 huggingface.co Official leaderboard
69 meta-llama/Meta-Llama-3-70B-Instruct 70.6B 60% 3-shot huggingface.co Official leaderboard
70 Sigurdur/icebreaker 0.1B 56.9% 3-shot huggingface.co Official leaderboard
71 AI-Sweden-Models/gpt-sw3-356m-instruct 0.5B 56.5% 3-shot huggingface.co Official leaderboard
72 mistralai/Mistral-Nemo-Instruct-2407 12.3B 55.1% 3-shot huggingface.co Official leaderboard
73 Claude 2.1 55.1% 3-shot Nov 2023 huggingface.co Official leaderboard
74 mistral/ministral-3b-2410 54.7% 3-shot huggingface.co Official leaderboard
75 LumiOpen/Viking-33B 33.1B 54.3% 3-shot huggingface.co Official leaderboard
76 AI-Sweden-Models/gpt-sw3-126m-instruct 0.2B 53.9% 3-shot huggingface.co Official leaderboard
77 Gemma 3 1B 52.9% 3-shot Mar 2025 huggingface.co Official leaderboard
78 google/gemma-2-9b-it 9.2B 52.9% 3-shot huggingface.co Official leaderboard
79 Llama 3.1-8B 52.5% 3-shot Jul 2024 huggingface.co Official leaderboard
80 AI-Sweden-Models/gpt-sw3-1.3b-instruct 1.4B 52.1% 3-shot huggingface.co Official leaderboard
81 Gemma 3 4B 52.1% 3-shot Mar 2025 huggingface.co Official leaderboard
82 cyboghostginx/gemma-3-4b-it-Adetayo 4B 52% 3-shot huggingface.co Official leaderboard
83 GPT-3.5 Turbo Jan 2024 52% 3-shot Jan 2024 huggingface.co Official leaderboard
84 GPT-4.1 nano 52% 3-shot Apr 2025 huggingface.co Official leaderboard
85 meta-llama/Meta-Llama-3.1-8B-Instruct 8B 51.9% 3-shot huggingface.co Official leaderboard
86 meta-llama/Llama-3.2-1B-Instruct 1.2B 50.9% 3-shot huggingface.co Official leaderboard
87 AI-Sweden-Models/gpt-sw3-20b-instruct 20.9B 49.8% 3-shot huggingface.co Official leaderboard
88 meta-llama/Llama-3.2-3B-Instruct 3.2B 49.7% 3-shot huggingface.co Official leaderboard
89 Qwen2-7B-Instruct 49.6% 3-shot Jun 2024 huggingface.co Official leaderboard
90 AI-Sweden-Models/gpt-sw3-6.7b-v2-instruct 7.1B 49.4% 3-shot huggingface.co Official leaderboard
91 LumiOpen/Viking-13B 14B 49.1% 3-shot huggingface.co Official leaderboard
92 meta-llama/Meta-Llama-3-8B-Instruct 8B 49.1% 3-shot huggingface.co Official leaderboard
93 LumiOpen/Viking-7B 7.6B 49% 3-shot huggingface.co Official leaderboard
#ModelScoreSettingDateLinkSource
1 Gemini 3.7 Flash 96.3% 3-shot · thinking high Aug 2026 ai.google.dev Official leaderboard
2 Gemini 3.1 Pro 96.1% 3-shot · thinking high Feb 2026 ai.google.dev Official leaderboard
3 Claude Fable 5 96% 3-shot · thinking high Jun 2026 anthropic.com Official leaderboard
4 Gemini 3.5 Flash 96% 3-shot · thinking high May 2026 ai.google.dev Official leaderboard
5 Gemini 3 Pro 95.6% 3-shot · thinking high Nov 2025 ai.google.dev Official leaderboard
6 Gemini 3 Flash 95.6% 3-shot · thinking high Dec 2025 ai.google.dev Official leaderboard
7 GPT-5.5 95.6% 3-shot · thinking high Apr 2026 developers.openai.com Official leaderboard
8 Gemini 3.6 Flash 95.5% 3-shot · thinking high Jul 2026 ai.google.dev Official leaderboard
9 Claude Opus 4.8 94.9% 3-shot · thinking high May 2026 anthropic.com Official leaderboard
10 Claude Opus 4.5 94.7% 3-shot · thinking high Nov 2025 huggingface.co Official leaderboard
11 Claude Opus 4.6 94.6% 3-shot · thinking high Feb 2026 anthropic.com Official leaderboard
12 GPT-5.6 Sol 94.5% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
13 GPT-5 94.4% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
14 GPT-5.4 93.7% 3-shot · thinking high Mar 2026 huggingface.co Official leaderboard
15 o1-preview 92.8% 3-shot · thinking on Sep 2024 huggingface.co Official leaderboard
16 Gemini 2.5 Pro Jun 2025 92.8% 3-shot · thinking on Jun 2025 huggingface.co Official leaderboard
17 GPT-5.1 92.8% 3-shot · thinking high Nov 2025 huggingface.co Official leaderboard
18 Claude Opus 4.7 92.8% 3-shot · thinking high Apr 2026 anthropic.com Official leaderboard
19 Claude Sonnet 4.5 92.7% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
20 GPT-5.2 92.2% 3-shot · thinking high Dec 2025 huggingface.co Official leaderboard
21 Gemini 3.1 Flash-Lite 92.1% 3-shot · thinking high Mar 2026 ai.google.dev Official leaderboard
22 Gemma 4 31B IT 92% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
23 Gemini 2.5 Flash Sep 2025 91.8% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
24 Claude Sonnet 4.6 91.8% 3-shot · thinking high Feb 2026 anthropic.com Official leaderboard
25 GPT-5.6 Terra 91.8% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
26 DeepSeek-V4-Pro 91.6% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
27 Claude 3.5 Sonnet 91.3% 3-shot Jun 2024 huggingface.co Official leaderboard
28 GLM-5.2 91.2% 3-shot · thinking on Jun 2026 huggingface.co Official leaderboard
29 Grok 4.3 90.3% 3-shot · thinking on Apr 2026 docs.x.ai Official leaderboard
30 Claude Sonnet 4 90.3% 3-shot · thinking on May 2025 huggingface.co Official leaderboard
31 Qwen3.5 397B-A17B 90.3% 3-shot · thinking on Feb 2026 huggingface.co Official leaderboard
32 Gemini 2.0 Pro 90.1% 3-shot · thinking on Feb 2025 huggingface.co Official leaderboard
33 Claude 3.7 Sonnet 89.7% 3-shot Feb 2025 huggingface.co Official leaderboard
34 Kimi K2.5 89.7% 3-shot · thinking on Jan 2026 kimi.com Official leaderboard
35 Gemma 4 26B A4B 88.4% 3-shot · thinking on Apr 2026 huggingface.co Official leaderboard
36 GPT-5 mini 87.5% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
37 GPT-4.1 87.4% 3-shot Apr 2025 huggingface.co Official leaderboard
38 Claude 3 Opus 87% 3-shot Feb 2024 huggingface.co Official leaderboard
39 GPT-5.6 Luna 86% 3-shot · thinking high Jul 2026 developers.openai.com Official leaderboard
40 GPT-4 Turbo Apr 2024 85.8% 3-shot Apr 2024 huggingface.co Official leaderboard
41 GPT-4o Aug 2024 85.4% 3-shot Aug 2024 huggingface.co Official leaderboard
42 Gemini 2.0 Flash Feb 2025 84.4% 3-shot Feb 2025 huggingface.co Official leaderboard
43 o4-mini 83.7% 3-shot · thinking on Apr 2025 huggingface.co Official leaderboard
44 GPT-4 Jun 2023 83.5% 3-shot Jun 2023 huggingface.co Official leaderboard
45 GPT-4o May 2024 83.5% 3-shot May 2024 huggingface.co Official leaderboard
46 DeepSeek-R1 May 2025 81.4% 3-shot · thinking on May 2025 huggingface.co Official leaderboard
47 GPT-4 Mar 2023 81.2% 3-shot Mar 2023 huggingface.co Official leaderboard
48 o3-mini 77.8% 3-shot · thinking on Jan 2025 huggingface.co Official leaderboard
49 MiniMax-M2.5 77.8% 3-shot · thinking on Feb 2026 minimax.io Official leaderboard
50 DeepSeek-V3 Mar 2025 75.9% 3-shot Mar 2025 huggingface.co Official leaderboard
51 DeepSeek-R1-Distill-Llama-70B 75.3% 3-shot · thinking on Jan 2025 huggingface.co Official leaderboard
52 Gemini 2.5 Flash-Lite Sep 2025 75.3% 3-shot · thinking high Sep 2025 huggingface.co Official leaderboard
53 Mistral Large 3 74.6% 3-shot Dec 2025 huggingface.co Official leaderboard
54 o1-mini 72.6% 3-shot · thinking on Sep 2024 huggingface.co Official leaderboard
55 GPT-5 nano 71.7% 3-shot · thinking high Aug 2025 huggingface.co Official leaderboard
56 GPT-4.1 mini 70.9% 3-shot Apr 2025 huggingface.co Official leaderboard
57 Gemma 3 27B 70.4% 3-shot Mar 2025 huggingface.co Official leaderboard
58 Llama-3.1-Nemotron-70B-Instruct 70% 3-shot Oct 2024 huggingface.co Official leaderboard
59 Llama 3.3 70B Instruct 68.7% 3-shot Dec 2024 huggingface.co Official leaderboard
60 GPT-4o mini 65.3% 3-shot Jul 2024 huggingface.co Official leaderboard
61 Gemma 3 12B 65% 3-shot Mar 2025 huggingface.co Official leaderboard
62 Claude 3.5 Haiku 64.4% 3-shot Oct 2024 huggingface.co Official leaderboard
63 Qwen2-72B 61.4% 3-shot Jun 2024 huggingface.co Official leaderboard
64 Claude 2.1 55.1% 3-shot Nov 2023 huggingface.co Official leaderboard
65 Gemma 3 1B 52.9% 3-shot Mar 2025 huggingface.co Official leaderboard
66 Llama 3.1-8B 52.5% 3-shot Jul 2024 huggingface.co Official leaderboard
67 Gemma 3 4B 52.1% 3-shot Mar 2025 huggingface.co Official leaderboard
68 GPT-3.5 Turbo Jan 2024 52% 3-shot Jan 2024 huggingface.co Official leaderboard
69 GPT-4.1 nano 52% 3-shot Apr 2025 huggingface.co Official leaderboard
70 Qwen2-7B-Instruct 49.6% 3-shot Jun 2024 huggingface.co Official leaderboard

9 models have held number one on the official leaderboard since 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

OpenAI Anthropic Google DeepMind
Own leaderboard Passed 85% in Feb 2024, by Claude 3 Opus

Source: Official Icelandic WinoGrande leaderboard

Claude 3 Opus on the official leaderboard passed 85% in February 2024

That was 20 months after its release. All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On the benchmark’s own leaderboard Best so far
0% 20% 40% 60% 80% 100% 2023 2024 2025 2026 Near the ceiling (85%) Gemini 3.7 Flash Gemini 3 Pro o1-preview Claude 3 Opus GPT-4 0% 20% 40% 60% 80% 100% 2023 2024 2025 2026 Near the ceiling (85%) Gemini 3.7 Flash o1-preview

Source: Official Icelandic WinoGrande leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Multilingual

All 545 in Multilingual
  • MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
  • WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET. K-EXAONE 90.5%
  • MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language. Qwen3.7-Max 87%
  • CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories. Solar Open 2 90.7%
  • Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
  • MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%

Data audit

All 9 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 3 pass 2 notes
  • Pass Independent runs Scores from the official leaderboard (93 entries).
  • Pass Models scored 70 models we track, plus 23 other entries on its leaderboard.
  • Pass Newest score The newest is from August 2026, for Gemini 3.7 Flash.
  • Note Frontier models None of the top 10 has a score, which is fine for a retired test. The strongest tested is Claude Fable 5 (#12).
  • Note Headroom Saturated. The best is 96.3%, past 85% since February 2024.
Leaderboard import 3 pass
  • Pass Importer We read the board on mideind-icelandic-llm-leaderboard.static.hf.space: 71 rows for models we track and 23 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check