EuroEval ERRNews
Models summarize Estonian radio news transcripts. EuroEval adds stories from TalTech’s training split to make a 2,048-story test split and keeps 256 stories for validation.
EuroEval reports scores for 207 distinct model names across test and validation runs. Its public script rebuilds the splits from the source archive.
- Made by
- EuroEval
- Released
- August 2025
- Kind
- Reading in many languages
- Level
- School
- Scored
- Checked automatically
- Answers
- Open-ended
- Tasks
- All public
- Measures
- Capability
- Subject
- Media and communications
- Language
- Estonian
- Interaction
- Single turn
- Items from
- Another benchmark, Real work and use
- Refresh
- One fixed set
- Run by
- Anyone
- Based on
- ERRnews broadcast summarization
- Strongest model tested
- GPT-6.2 Astra #1 on the capability index
- Last model added
- November 2026
- Scores refreshed
- November 20th, 2026
Llama 3.3 70B Instruct leads with 32.8 Llama 3.3 70B Instruct leads with 32.8
Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.
- 32.8
Llama 3.3 70B Instruct
- 32.7 deepcogito/cogito-v2-preview-llama-70B
- 32.3
Gemma 3 27B
- 32.2 mistralai/Mistral-Small-3.1-24B-Instruct-2503
- 32.2
Gemma 3 12B
- 32.1 GPT-6 Astra
- 32.1 GPT-6 Sol
- 31.9 mistralai/Mistral-Small-3.2-24B-Instruct-2506
- 31.9 GPT-6.1 Sol
- 31.9 deepcogito/cogito-v1-preview-qwen-32B
- 31.8 Qwen/Qwen3-32B#no-thinking
- 31.7 GPT-6.2 Astra
- 31.7
Qwen2.5-72B
- 31.5 GPT-5.6 Sol
- 31.5 Qwen/Qwen3-14B#no-thinking
- 31.5
Gemma 3n E4B
- 31.5 GPT-6.2 Sol
- 31.4 deepcogito/cogito-v1-preview-llama-8B
- 31.3 deepcogito/cogito-v1-preview-qwen-14B
- 31.3 GPT-4.1
- 31.2 NbAiLab/borealis2-31b-preview
- 31.2 GPT-6 Luna
- 31.0
Gemma 4 31B IT
- 31.0 Qwen/Qwen3-8B#no-thinking
- 31.0 gemini/gemini-3-flash-preview#no-thinking
- 30.9
Mistral Medium 3.5
- 30.9 deepseek/deepseek-flash#no-thinking
- 30.9 utter-project/EuroLLM-22B-Instruct-2512
- 30.9 GPT-5.6 Terra
- 30.8
Apertus 1.5 70B
- 30.8 speakleash/Bielik-Minitron-7B-v3.0-Instruct
- 30.8
Voxtral Small
- 30.8
Gemma 3 4B
- 30.7 Qwen/Qwen3-4B#no-thinking
- 30.7 speakleash/Bielik-11B-v3.0-Instruct
- 30.6 GLM-5.3-Flash
- 30.6 Qwen/Qwen3.5-35B-A3B-FP8
- 30.6 gemini/gemini-2.5-flash-lite#no-thinking
- 30.5 mii-llm/nesso-4B
- 30.5
Qwen3-4B-Thinking-2507
- 30.5 meta-llama/Llama-3.1-8B-Instruct
- 30.5 speakleash/Bielik-11B-v3.1-Instruct
- 30.5
Gemini 3 Pro
- 30.4 NbAiLab/borealis2-26b-a4b-preview
- 30.3
Gemma 4 26B A4B
- 30.3
Gemini 3.7 Flash
- 30.3 GPT-5.6 Luna
- 30.3 amalia-llm/AMALIA-9B-0626-DPO
- 30.3
Qwen 3.8 27B
- 30.2 utter-project/EuroLLM-9B-Instruct-2512
- 30.2
Apertus 1.5 8B
- 30.2 deepcogito/cogito-v1-preview-llama-3B
- 30.1 mistralai/Mistral-Large-3-675B-Instruct-2512
- 30.1 claude-sonnet-4-5-20250929#no-thinking
- 30.1
Gemma 4 12B
- 30.1 openai/gpt-5.4-mini-2026-03-17#high
- 30.0 openai/gpt-5.4-mini-2026-03-17#medium
- 30.0 mistralai/Mistral-Small-4-119B-2603
- 29.8
Gemma 4 E4B
- 29.8 Grok 4.1 Fast
- 29.8 deepseek/deepseek-flash#low
- 29.7 amalia-llm/AMALIA-9B-0626-SFT
- 29.7
Gemini 3.1 Flash-Lite
- 29.6 Qwen/Qwen3.6-27B-FP8
- 29.6 openai/gpt-5.4-mini-2026-03-17#none
- 29.6 Qwen/Qwen3-1.7B#no-thinking
- 29.6 mistralai/Ministral-3-14B-Instruct-2512
- 29.4 openai/gpt-5.4-mini-2026-03-17#low
- 29.4
Gemma 4 E2B
- 29.4 gemini/gemini-3-flash-preview#thinking
- 29.4
Gemini 2.5 Flash-Lite
- 29.4
Ministral 3 8B Instruct
- 29.3 Claude Sonnet 4.6
- 29.2 GPT-5 mini
- 29.1 claude-sonnet-4-5-20250929#thinking
- 29.1 speakleash/Bielik-11B-v2.3-Instruct
- 29.1
Ministral 3 3B Reasoning
- 29.0 meta-llama/Llama-3.2-3B-Instruct
- 28.9
Qwen3.5-2B
- 28.9 NbAiLab/borealis2-e4b-preview
- 28.9 openai/gpt-5.4-2026-03-05#none
- 28.9
EXAONE 4.0 32B
- 28.9 granite-4.0-micro
- 28.9 Aleph-Alpha/Kolibri-1
- 28.8 Claude Haiku 4.5
- 28.8 GPT-5.2
- 28.7
Ministral 3 3B Instruct
- 28.7
Gemini 3.6 Flash
- 28.6 ibm-granite/granite-4.0-h-micro
- 28.6 openGPT-X/Teuken-7B-instruct-v0.6
- 28.5
Gemini 3.5 Flash-Lite
- 28.5
Olmo 3.1 32B Instruct
- 28.3 NbAiLab/borealis2-e2b-preview
- 28.1 allenai/Olmo-3.1-32B-Instruct-DPO
- 28.0 glm-4.7-flash
- 28.0
Qwen3.5-35B-A3B-Base
- 28.0 mistralai/Mistral-Small-3.1-24B-Base-2503
- 28.0 swiss-ai/Apertus-v1.1-4B-Instruct
- 27.8
Qwen3.5-9B
- 27.7 LiquidAI/LFM2.5-8B-A1B-Base
- 27.4
Gemma 3 270M
- 27.4 HuggingFaceTB/SmolLM3-3B#no-thinking
- 27.4 openai/gpt-5.4-nano-2026-03-17#high
- 27.3 GadflyII/GLM-4.7-Flash-NVFP4
- 27.2 OpenLLM-France/Luciole-23B-Instruct-1.1
- 27.1
Aya Expanse 8B
- 27.1 openai/gpt-5.4-nano-2026-03-17#medium
- 27.0 BSC-LT/salamandra-7b-instruct
- 27.0 openai/gpt-5.4-nano-2026-03-17#none
- 26.9 openai/gpt-5.4-nano-2026-03-17#low
- 26.9 yulan-team/YuLan-Mini-Instruct
- 26.6 mistralai/Ministral-3-8B-Reasoning-2512
- 26.4 domyn/Domyn-Small-v1.0
- 26.3
Llama 3.1-70B
- 26.2 gpt-oss-20b
- 26.1 gpt-oss-120b
- 26.1 swiss-ai/Apertus-v1.1-1.5B-Instruct
- 26.0
Gemma 3 1B
- 25.9 allenai/Llama-3.1-Tulu-3-8B-SFT
- 25.9 GPT-5 nano
- 25.8 mistralai/Ministral-3-14B-Base-2512
- 25.8 allenai/Olmo-3-1125-32B
- 25.8 OpenLLM-France/Luciole-8B-Instruct-1.1
- 25.6
Llama 3.1-8B
- 25.3 allenai/Olmo-3-7B-Instruct-DPO
- 25.2 mistralai/Ministral-3-8B-Base-2512
- 25.2 allenai/Olmo-3-7B-Instruct
- 24.9 Qwen/Qwen3-0.6B#no-thinking
- 24.5 occiglot/occiglot-7b-eu5-instruct
- 24.5
Qwen3.5-0.8B
- 24.4
Gemma 3 27B PT
- 24.3 utter-project/EuroLLM-22B-2512
- 24.1 utter-project/EuroLLM-1.7B-Instruct
- 24.1 LFM2-1.2B
- 24.1 swiss-ai/Apertus-v1.1-4B
- 24.0 LiquidAI/LFM2-700M
- 24.0
Gemma 3 12B PT
- 23.9 swiss-ai/Apertus-v1.1-1.5B
- 23.6 danish-foundation-models/DFM-Mimir
- 23.5 utter-project/EuroLLM-9B
- 23.5 LiquidAI/LFM2-350M
- 23.4 swiss-ai/Apertus-v1.1-0.5B-Instruct
- 23.1
Qwen3-0.6B
- 22.6 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16
- 22.2
Gemma 3 4B PT
- 22.1 openeurollm/prelude-long
- 21.9
Qwen3.5-9B-Base
- 21.9 OpenLLM-France/Luciole-1B-Instruct-1.1
- 21.9 allenai/Olmo-3-1025-7B
- 21.5 openeurollm/prelude-base
- 21.4
Qwen3.5-4B
- 21.2 openeurollm/oellm-9b-128k-theta32m-v3
- 21.1
Olmo 3.1 32B Think
- 21.1 HuggingFaceTB/SmolLM3-3B-Base
- 21.1
Qwen3.5-4B-Base
- 21.0 speakleash/Bielik-1.5B-v3.0-Instruct
- 21.0
Llama 3.2 1B
- 20.9 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16
- 20.7 BSC-LT/salamandra-7b
- 20.6 danish-foundation-models/DFM-Mimir-v1.5
- 20.3
Gemma 3 1B PT
- 20.2 AI-Sweden-Models/Llama-3-8B-instruct
- 20.1
Qwen3.5-2B-Base
- 19.9 occiglot/occiglot-7b-eu5
- 19.9 swiss-ai/Apertus-v1.1-0.5B
- 19.9 utter-project/EuroLLM-1.7B
- 19.6 utter-project/EuroMoE-2.6B-A0.6B-Preview
- 19.5 OpenLLM-France/Luciole-8B-Base
- 19.1 OpenLLM-France/Luciole-23B-Base
- 19.1 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8
- 19.1 meta-llama/Llama-3.2-1B-Instruct
- 18.8 allenai/Olmo-3-7B-Instruct-SFT
- 18.6 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview
- 18.5
Qwen3.5-0.8B-Base
- 18.4 allenai/Olmo-3.1-32B-Instruct-SFT
- 18.0 nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16
- 17.1 PleIAs/Pleias-1.2b-Preview
- 17.1 OpenLLM-France/Luciole-1B-Base
- 17.0 PleIAs/Pleias-3b-Preview
- 16.8 HuggingFaceTB/SmolLM2-360M-Instruct
- 16.6 PleIAs/Pleias-350m-Preview
- 16.4 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct
- 16.3 CohereLabs/aya-23-8B
- 16.1 nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8
- 15.5
Nemotron-Cascade 2 30B-A3B
- 14.0 HuggingFaceTB/SmolLM2-135M-Instruct
- 13.6
SmolLM2-360M
- 13.6
SmolLM2-135M
- 12.7 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base
- 12.4 TildeAI/TildeOpen-30b
- 10.6 AIDC-AI/Marco-Mini-Global-Base
- 5.38 PleIAs/Monad
- 4.30 LFM2.5-8B-A1B
- 4.06 inclusionAI/Ling-mini-2.0
- 2.13 openbmb/MiniCPM5-1B
- 1.94
Ministral 3 14B
- 1.16 Muse-research/Muse-3B
- 0.62 inclusionAI/Ling-mini-base-2.0
- 0.00 openGPT-X/Teuken-7B-base-v0.6
- 1
Llama 3.3 70B Instruct 32.8
- 2 deepcogito/cogito-v2-preview-llama-70B 32.7
- 3
Gemma 3 27B 32.3
- 4 mistralai/Mistral-Small-3.1-24B-Instruct-2503 32.2
- 5
Gemma 3 12B 32.2
- 6 GPT-6 Astra zero-shot, val 32.1
- 7 GPT-6 Sol zero-shot, val 32.1
- 8 mistralai/Mistral-Small-3.2-24B-Instruct-2506 31.9
- 9 GPT-6.1 Sol zero-shot, val 31.9
- 10 deepcogito/cogito-v1-preview-qwen-32B 31.9
- 11 Qwen/Qwen3-32B#no-thinking 31.8
- 12 GPT-6.2 Astra zero-shot, val 31.7
- 13
Qwen2.5-72B 31.7
- 14 GPT-5.6 Sol zero-shot, val 31.5
- 15 Qwen/Qwen3-14B#no-thinking 31.5
- 16
Gemma 3n E4B 31.5
- 17 GPT-6.2 Sol zero-shot, val 31.5
- 18 deepcogito/cogito-v1-preview-llama-8B 31.4
- 19 deepcogito/cogito-v1-preview-qwen-14B 31.3
- 20 GPT-4.1 zero-shot, val 31.3
- 21 NbAiLab/borealis2-31b-preview val 31.2
- 22 GPT-6 Luna zero-shot, val 31.2
- 23
Gemma 4 31B IT val 31.0
- 24 Qwen/Qwen3-8B#no-thinking 31.0
- 25 gemini/gemini-3-flash-preview#no-thinking zero-shot, val 31.0
- 26
Mistral Medium 3.5 val 30.9
- 27 deepseek/deepseek-flash#no-thinking val 30.9
- 28 utter-project/EuroLLM-22B-Instruct-2512 30.9
- 29 GPT-5.6 Terra zero-shot, val 30.9
- 30
Apertus 1.5 70B val 30.8
- 31 speakleash/Bielik-Minitron-7B-v3.0-Instruct val 30.8
- 32
Voxtral Small 30.8
- 33
Gemma 3 4B 30.8
- 34 Qwen/Qwen3-4B#no-thinking 30.7
- 35 speakleash/Bielik-11B-v3.0-Instruct val 30.7
- 36 GLM-5.3-Flash val 30.6
- 37 Qwen/Qwen3.5-35B-A3B-FP8 val 30.6
- 38 gemini/gemini-2.5-flash-lite#no-thinking zero-shot, val 30.6
- 39 mii-llm/nesso-4B 30.5
- 40
Qwen3-4B-Thinking-2507 30.5
- 41 meta-llama/Llama-3.1-8B-Instruct 30.5
- 42 speakleash/Bielik-11B-v3.1-Instruct val 30.5
- 43
Gemini 3 Pro zero-shot, val 30.5
- 44 NbAiLab/borealis2-26b-a4b-preview zero-shot, val 30.4
- 45
Gemma 4 26B A4B val 30.3
- 46
Gemini 3.7 Flash zero-shot, val 30.3
- 47 GPT-5.6 Luna zero-shot, val 30.3
- 48 amalia-llm/AMALIA-9B-0626-DPO val 30.3
- 49
Qwen 3.8 27B val 30.3
- 50 utter-project/EuroLLM-9B-Instruct-2512 val 30.2
- 51
Apertus 1.5 8B zero-shot, val 30.2
- 52 deepcogito/cogito-v1-preview-llama-3B 30.2
- 53 mistralai/Mistral-Large-3-675B-Instruct-2512 val 30.1
- 54 claude-sonnet-4-5-20250929#no-thinking zero-shot, val 30.1
- 55
Gemma 4 12B val 30.1
- 56 openai/gpt-5.4-mini-2026-03-17#high zero-shot, val 30.1
- 57 openai/gpt-5.4-mini-2026-03-17#medium zero-shot, val 30.0
- 58 mistralai/Mistral-Small-4-119B-2603 val 30.0
- 59
Gemma 4 E4B val 29.8
- 60 Grok 4.1 Fast zero-shot, val 29.8
- 61 deepseek/deepseek-flash#low zero-shot, val 29.8
- 62 amalia-llm/AMALIA-9B-0626-SFT val 29.7
- 63
Gemini 3.1 Flash-Lite zero-shot, val 29.7
- 64 Qwen/Qwen3.6-27B-FP8 val 29.6
- 65 openai/gpt-5.4-mini-2026-03-17#none zero-shot, val 29.6
- 66 Qwen/Qwen3-1.7B#no-thinking 29.6
- 67 mistralai/Ministral-3-14B-Instruct-2512 val 29.6
- 68 openai/gpt-5.4-mini-2026-03-17#low zero-shot, val 29.4
- 69
Gemma 4 E2B val 29.4
- 70 gemini/gemini-3-flash-preview#thinking zero-shot, val 29.4
- 71
Gemini 2.5 Flash-Lite Sep 2025, zero-shot, val 29.4
- 72
Ministral 3 8B Instruct val 29.4
- 73 Claude Sonnet 4.6 zero-shot, val 29.3
- 74 GPT-5 mini zero-shot, val 29.2
- 75 claude-sonnet-4-5-20250929#thinking zero-shot, val 29.1
- 76 speakleash/Bielik-11B-v2.3-Instruct val 29.1
- 77
Ministral 3 3B Reasoning 29.1
- 78 meta-llama/Llama-3.2-3B-Instruct 29.0
- 79
Qwen3.5-2B val 28.9
- 80 NbAiLab/borealis2-e4b-preview zero-shot, val 28.9
- 81 openai/gpt-5.4-2026-03-05#none zero-shot, val 28.9
- 82
EXAONE 4.0 32B val 28.9
- 83 granite-4.0-micro 28.9
- 84 Aleph-Alpha/Kolibri-1 zero-shot, val 28.9
- 85 Claude Haiku 4.5 zero-shot, val 28.8
- 86 GPT-5.2 zero-shot, val 28.8
- 87
Ministral 3 3B Instruct val 28.7
- 88
Gemini 3.6 Flash zero-shot, val 28.7
- 89 ibm-granite/granite-4.0-h-micro 28.6
- 90 openGPT-X/Teuken-7B-instruct-v0.6 val 28.6
- 91
Gemini 3.5 Flash-Lite zero-shot, val 28.5
- 92
Olmo 3.1 32B Instruct 28.5
- 93 NbAiLab/borealis2-e2b-preview zero-shot, val 28.3
- 94 allenai/Olmo-3.1-32B-Instruct-DPO 28.1
- 95 glm-4.7-flash val 28.0
- 96
Qwen3.5-35B-A3B-Base val 28.0
- 97 mistralai/Mistral-Small-3.1-24B-Base-2503 28.0
- 98 swiss-ai/Apertus-v1.1-4B-Instruct val 28.0
- 99
Qwen3.5-9B val 27.8
- 100 LiquidAI/LFM2.5-8B-A1B-Base val 27.7
- 101
Gemma 3 270M 27.4
- 102 HuggingFaceTB/SmolLM3-3B#no-thinking 27.4
- 103 openai/gpt-5.4-nano-2026-03-17#high zero-shot, val 27.4
- 104 GadflyII/GLM-4.7-Flash-NVFP4 val 27.3
- 105 OpenLLM-France/Luciole-23B-Instruct-1.1 val 27.2
- 106
Aya Expanse 8B val 27.1
- 107 openai/gpt-5.4-nano-2026-03-17#medium zero-shot, val 27.1
- 108 BSC-LT/salamandra-7b-instruct 27.0
- 109 openai/gpt-5.4-nano-2026-03-17#none zero-shot, val 27.0
- 110 openai/gpt-5.4-nano-2026-03-17#low zero-shot, val 26.9
- 111 yulan-team/YuLan-Mini-Instruct 26.9
- 112 mistralai/Ministral-3-8B-Reasoning-2512 26.6
- 113 domyn/Domyn-Small-v1.0 val 26.4
- 114
Llama 3.1-70B 26.3
- 115 gpt-oss-20b medium 26.2
- 116 gpt-oss-120b val 26.1
- 117 swiss-ai/Apertus-v1.1-1.5B-Instruct val 26.1
- 118
Gemma 3 1B 26.0
- 119 allenai/Llama-3.1-Tulu-3-8B-SFT 25.9
- 120 GPT-5 nano zero-shot, val 25.9
- 121 mistralai/Ministral-3-14B-Base-2512 val 25.8
- 122 allenai/Olmo-3-1125-32B 25.8
- 123 OpenLLM-France/Luciole-8B-Instruct-1.1 val 25.8
- 124
Llama 3.1-8B 25.6
- 125 allenai/Olmo-3-7B-Instruct-DPO 25.3
- 126 mistralai/Ministral-3-8B-Base-2512 val 25.2
- 127 allenai/Olmo-3-7B-Instruct 25.2
- 128 Qwen/Qwen3-0.6B#no-thinking 24.9
- 129 occiglot/occiglot-7b-eu5-instruct 24.5
- 130
Qwen3.5-0.8B val 24.5
- 131
Gemma 3 27B PT 24.4
- 132 utter-project/EuroLLM-22B-2512 24.3
- 133 utter-project/EuroLLM-1.7B-Instruct val 24.1
- 134 LFM2-1.2B 24.1
- 135 swiss-ai/Apertus-v1.1-4B val 24.1
- 136 LiquidAI/LFM2-700M 24.0
- 137
Gemma 3 12B PT 24.0
- 138 swiss-ai/Apertus-v1.1-1.5B val 23.9
- 139 danish-foundation-models/DFM-Mimir val 23.6
- 140 utter-project/EuroLLM-9B 23.5
- 141 LiquidAI/LFM2-350M 23.5
- 142 swiss-ai/Apertus-v1.1-0.5B-Instruct val 23.4
- 143
Qwen3-0.6B 23.1
- 144 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 val 22.6
- 145
Gemma 3 4B PT 22.2
- 146 openeurollm/prelude-long val 22.1
- 147
Qwen3.5-9B-Base val 21.9
- 148 OpenLLM-France/Luciole-1B-Instruct-1.1 val 21.9
- 149 allenai/Olmo-3-1025-7B 21.9
- 150 openeurollm/prelude-base val 21.5
- 151
Qwen3.5-4B val 21.4
- 152 openeurollm/oellm-9b-128k-theta32m-v3 val 21.2
- 153
Olmo 3.1 32B Think val 21.1
- 154 HuggingFaceTB/SmolLM3-3B-Base 21.1
- 155
Qwen3.5-4B-Base val 21.1
- 156 speakleash/Bielik-1.5B-v3.0-Instruct 21.0
- 157
Llama 3.2 1B 21.0
- 158 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 val 20.9
- 159 BSC-LT/salamandra-7b 20.7
- 160 danish-foundation-models/DFM-Mimir-v1.5 val 20.6
- 161
Gemma 3 1B PT 20.3
- 162 AI-Sweden-Models/Llama-3-8B-instruct val 20.2
- 163
Qwen3.5-2B-Base val 20.1
- 164 occiglot/occiglot-7b-eu5 19.9
- 165 swiss-ai/Apertus-v1.1-0.5B val 19.9
- 166 utter-project/EuroLLM-1.7B val 19.9
- 167 utter-project/EuroMoE-2.6B-A0.6B-Preview 19.6
- 168 OpenLLM-France/Luciole-8B-Base val 19.5
- 169 OpenLLM-France/Luciole-23B-Base val 19.1
- 170 nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 val 19.1
- 171 meta-llama/Llama-3.2-1B-Instruct 19.1
- 172 allenai/Olmo-3-7B-Instruct-SFT 18.8
- 173 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview 18.6
- 174
Qwen3.5-0.8B-Base val 18.5
- 175 allenai/Olmo-3.1-32B-Instruct-SFT 18.4
- 176 nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 18.0
- 177 PleIAs/Pleias-1.2b-Preview 17.1
- 178 OpenLLM-France/Luciole-1B-Base val 17.1
- 179 PleIAs/Pleias-3b-Preview 17.0
- 180 HuggingFaceTB/SmolLM2-360M-Instruct 16.8
- 181 PleIAs/Pleias-350m-Preview 16.6
- 182 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct 16.4
- 183 CohereLabs/aya-23-8B val 16.3
- 184 nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 val 16.1
- 185
Nemotron-Cascade 2 30B-A3B val 15.5
- 186 HuggingFaceTB/SmolLM2-135M-Instruct 14.0
- 187
SmolLM2-360M 13.6
- 188
SmolLM2-135M 13.6
- 189 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base 12.7
- 190 TildeAI/TildeOpen-30b val 12.4
- 191 AIDC-AI/Marco-Mini-Global-Base val 10.6
- 192 PleIAs/Monad 5.38
- 193 LFM2.5-8B-A1B val 4.30
- 194 inclusionAI/Ling-mini-2.0 val 4.06
- 195 openbmb/MiniCPM5-1B val 2.13
- 196
Ministral 3 14B val 1.94
- 197 Muse-research/Muse-3B val 1.16
- 198 inclusionAI/Ling-mini-base-2.0 val 0.62
- 199 openGPT-X/Teuken-7B-base-v0.6 val 0.00
Source: Official EuroEval ERRNews leaderboard
- 32.8
Llama 3.3 70B Instruct
- 32.3
Gemma 3 27B
- 32.2
Gemma 3 12B
- 32.1 GPT-6 Astra
- 32.1 GPT-6 Sol
- 31.9 GPT-6.1 Sol
- 31.7 GPT-6.2 Astra
- 31.7
Qwen2.5-72B
- 31.5 GPT-5.6 Sol
- 31.5
Gemma 3n E4B
- 31.5 GPT-6.2 Sol
- 31.3 GPT-4.1
- 31.2 GPT-6 Luna
- 31.0
Gemma 4 31B IT
- 30.9
Mistral Medium 3.5
- 30.9 GPT-5.6 Terra
- 30.8
Apertus 1.5 70B
- 30.8
Voxtral Small
- 30.8
Gemma 3 4B
- 30.6 GLM-5.3-Flash
- 30.5
Qwen3-4B-Thinking-2507
- 30.5
Gemini 3 Pro
- 30.3
Gemma 4 26B A4B
- 30.3
Gemini 3.7 Flash
- 30.3 GPT-5.6 Luna
- 30.3
Qwen 3.8 27B
- 30.2
Apertus 1.5 8B
- 30.1
Gemma 4 12B
- 29.8
Gemma 4 E4B
- 29.8 Grok 4.1 Fast
- 29.7
Gemini 3.1 Flash-Lite
- 29.4
Gemma 4 E2B
- 29.4
Gemini 2.5 Flash-Lite
- 29.4
Ministral 3 8B Instruct
- 29.3 Claude Sonnet 4.6
- 29.2 GPT-5 mini
- 29.1
Ministral 3 3B Reasoning
- 28.9
Qwen3.5-2B
- 28.9
EXAONE 4.0 32B
- 28.9 granite-4.0-micro
- 28.8 Claude Haiku 4.5
- 28.8 GPT-5.2
- 28.7
Ministral 3 3B Instruct
- 28.7
Gemini 3.6 Flash
- 28.5
Gemini 3.5 Flash-Lite
- 28.5
Olmo 3.1 32B Instruct
- 28.0 glm-4.7-flash
- 28.0
Qwen3.5-35B-A3B-Base
- 27.8
Qwen3.5-9B
- 27.4
Gemma 3 270M
- 27.1
Aya Expanse 8B
- 26.3
Llama 3.1-70B
- 26.2 gpt-oss-20b
- 26.1 gpt-oss-120b
- 26.0
Gemma 3 1B
- 25.9 GPT-5 nano
- 25.6
Llama 3.1-8B
- 24.5
Qwen3.5-0.8B
- 24.4
Gemma 3 27B PT
- 24.1 LFM2-1.2B
- 24.0
Gemma 3 12B PT
- 23.1
Qwen3-0.6B
- 22.2
Gemma 3 4B PT
- 21.9
Qwen3.5-9B-Base
- 21.4
Qwen3.5-4B
- 21.1
Olmo 3.1 32B Think
- 21.1
Qwen3.5-4B-Base
- 21.0
Llama 3.2 1B
- 20.3
Gemma 3 1B PT
- 20.1
Qwen3.5-2B-Base
- 18.5
Qwen3.5-0.8B-Base
- 15.5
Nemotron-Cascade 2 30B-A3B
- 13.6
SmolLM2-360M
- 13.6
SmolLM2-135M
- 4.30 LFM2.5-8B-A1B
- 1.94
Ministral 3 14B
- 1
Llama 3.3 70B Instruct 32.8
- 2
Gemma 3 27B 32.3
- 3
Gemma 3 12B 32.2
- 4 GPT-6 Astra zero-shot, val 32.1
- 5 GPT-6 Sol zero-shot, val 32.1
- 6 GPT-6.1 Sol zero-shot, val 31.9
- 7 GPT-6.2 Astra zero-shot, val 31.7
- 8
Qwen2.5-72B 31.7
- 9 GPT-5.6 Sol zero-shot, val 31.5
- 10
Gemma 3n E4B 31.5
- 11 GPT-6.2 Sol zero-shot, val 31.5
- 12 GPT-4.1 zero-shot, val 31.3
- 13 GPT-6 Luna zero-shot, val 31.2
- 14
Gemma 4 31B IT val 31.0
- 15
Mistral Medium 3.5 val 30.9
- 16 GPT-5.6 Terra zero-shot, val 30.9
- 17
Apertus 1.5 70B val 30.8
- 18
Voxtral Small 30.8
- 19
Gemma 3 4B 30.8
- 20 GLM-5.3-Flash val 30.6
- 21
Qwen3-4B-Thinking-2507 30.5
- 22
Gemini 3 Pro zero-shot, val 30.5
- 23
Gemma 4 26B A4B val 30.3
- 24
Gemini 3.7 Flash zero-shot, val 30.3
- 25 GPT-5.6 Luna zero-shot, val 30.3
- 26
Qwen 3.8 27B val 30.3
- 27
Apertus 1.5 8B zero-shot, val 30.2
- 28
Gemma 4 12B val 30.1
- 29
Gemma 4 E4B val 29.8
- 30 Grok 4.1 Fast zero-shot, val 29.8
- 31
Gemini 3.1 Flash-Lite zero-shot, val 29.7
- 32
Gemma 4 E2B val 29.4
- 33
Gemini 2.5 Flash-Lite Sep 2025, zero-shot, val 29.4
- 34
Ministral 3 8B Instruct val 29.4
- 35 Claude Sonnet 4.6 zero-shot, val 29.3
- 36 GPT-5 mini zero-shot, val 29.2
- 37
Ministral 3 3B Reasoning 29.1
- 38
Qwen3.5-2B val 28.9
- 39
EXAONE 4.0 32B val 28.9
- 40 granite-4.0-micro 28.9
- 41 Claude Haiku 4.5 zero-shot, val 28.8
- 42 GPT-5.2 zero-shot, val 28.8
- 43
Ministral 3 3B Instruct val 28.7
- 44
Gemini 3.6 Flash zero-shot, val 28.7
- 45
Gemini 3.5 Flash-Lite zero-shot, val 28.5
- 46
Olmo 3.1 32B Instruct 28.5
- 47 glm-4.7-flash val 28.0
- 48
Qwen3.5-35B-A3B-Base val 28.0
- 49
Qwen3.5-9B val 27.8
- 50
Gemma 3 270M 27.4
- 51
Aya Expanse 8B val 27.1
- 52
Llama 3.1-70B 26.3
- 53 gpt-oss-20b medium 26.2
- 54 gpt-oss-120b val 26.1
- 55
Gemma 3 1B 26.0
- 56 GPT-5 nano zero-shot, val 25.9
- 57
Llama 3.1-8B 25.6
- 58
Qwen3.5-0.8B val 24.5
- 59
Gemma 3 27B PT 24.4
- 60 LFM2-1.2B 24.1
- 61
Gemma 3 12B PT 24.0
- 62
Qwen3-0.6B 23.1
- 63
Gemma 3 4B PT 22.2
- 64
Qwen3.5-9B-Base val 21.9
- 65
Qwen3.5-4B val 21.4
- 66
Olmo 3.1 32B Think val 21.1
- 67
Qwen3.5-4B-Base val 21.1
- 68
Llama 3.2 1B 21.0
- 69
Gemma 3 1B PT 20.3
- 70
Qwen3.5-2B-Base val 20.1
- 71
Qwen3.5-0.8B-Base val 18.5
- 72
Nemotron-Cascade 2 30B-A3B val 15.5
- 73
SmolLM2-360M 13.6
- 74
SmolLM2-135M 13.6
- 75 LFM2.5-8B-A1B val 4.30
- 76
Ministral 3 14B val 1.94
Source: Official EuroEval ERRNews leaderboard
| # | Entry | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 32.8 ±0.1 | Dec 2024 | hf.co | Official leaderboard | |
| 2 | deepcogito/cogito-v2-preview-llama-70B open weights | 32.7 ±0.1 | hf.co | Official leaderboard | ||
| 3 | | 32.3 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 4 | mistralai/Mistral-Small-3.1-24B-Instruct-2503 open weights | 32.2 ±0.1 | hf.co | Official leaderboard | ||
| 5 | | 32.2 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 6 | GPT-6 Astra | 32.1 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 7 | GPT-6 Sol | 32.1 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 8 | mistralai/Mistral-Small-3.2-24B-Instruct-2506 open weights | 31.9 ±0.2 | hf.co | Official leaderboard | ||
| 9 | GPT-6.1 Sol | 31.9 ±0.4 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 10 | deepcogito/cogito-v1-preview-qwen-32B open weights | 31.9 ±0.1 | hf.co | Official leaderboard | ||
| 11 | Qwen/Qwen3-32B#no-thinking closed weights | 31.8 ±0.1 | hf.co | Official leaderboard | ||
| 12 | GPT-6.2 Astra | 31.7 ±0.2 | zero-shot, val | Nov 2026 | platform.openai.com | Official leaderboard |
| 13 | | 31.7 ±0.1 | Sep 2024 | hf.co | Official leaderboard | |
| 14 | GPT-5.6 Sol | 31.5 ±0.2 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 15 | Qwen/Qwen3-14B#no-thinking closed weights | 31.5 ±0.1 | hf.co | Official leaderboard | ||
| 16 | | 31.5 ±0.1 | Jun 2025 | hf.co | Official leaderboard | |
| 17 | GPT-6.2 Sol | 31.5 ±0.2 | zero-shot, val | Nov 2026 | platform.openai.com | Official leaderboard |
| 18 | deepcogito/cogito-v1-preview-llama-8B open weights | 31.4 ±0.2 | hf.co | Official leaderboard | ||
| 19 | deepcogito/cogito-v1-preview-qwen-14B open weights | 31.3 ±0.1 | hf.co | Official leaderboard | ||
| 20 | GPT-4.1 | 31.3 ±0.2 | zero-shot, val | Apr 2025 | platform.openai.com | Official leaderboard |
| 21 | NbAiLab/borealis2-31b-preview open weights | 31.2 ±0.3 | val | hf.co | Official leaderboard | |
| 22 | GPT-6 Luna | 31.2 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 23 | | 31.0 ±0.2 | val | Apr 2026 | hf.co | Official leaderboard |
| 24 | Qwen/Qwen3-8B#no-thinking closed weights | 31.0 ±0.1 | hf.co | Official leaderboard | ||
| 25 | gemini/gemini-3-flash-preview#no-thinking closed weights | 31.0 ±0.2 | zero-shot, val | ai.google.dev | Official leaderboard | |
| 26 | | 30.9 ±0.2 | val | Apr 2026 | hf.co | Official leaderboard |
| 27 | deepseek/deepseek-flash#no-thinking closed weights | 30.9 ±0.4 | val | api-docs.deepseek.com | Official leaderboard | |
| 28 | utter-project/EuroLLM-22B-Instruct-2512 open weights | 30.9 ±1.1 | hf.co | Official leaderboard | ||
| 29 | GPT-5.6 Terra | 30.9 ±0.2 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 30 | | 30.8 ±0.2 | val | Jul 2026 | hf.co | Official leaderboard |
| 31 | speakleash/Bielik-Minitron-7B-v3.0-Instruct open weights | 30.8 | val | hf.co | Official leaderboard | |
| 32 | | 30.8 ±0.5 | Jul 2025 | hf.co | Official leaderboard | |
| 33 | | 30.8 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 34 | Qwen/Qwen3-4B#no-thinking closed weights | 30.7 ±0.1 | hf.co | Official leaderboard | ||
| 35 | speakleash/Bielik-11B-v3.0-Instruct open weights | 30.7 | val | hf.co | Official leaderboard | |
| 36 | GLM-5.3-Flash | 30.6 ±0.9 | val | Aug 2026 | hf.co | Official leaderboard |
| 37 | Qwen/Qwen3.5-35B-A3B-FP8 open weights | 30.6 ±0.3 | val | hf.co | Official leaderboard | |
| 38 | gemini/gemini-2.5-flash-lite#no-thinking closed weights | 30.6 ±0.2 | zero-shot, val | ai.google.dev | Official leaderboard | |
| 39 | mii-llm/nesso-4B open weights | 30.5 ±0.2 | hf.co | Official leaderboard | ||
| 40 | | 30.5 ±0.1 | Aug 2025 | hf.co | Official leaderboard | |
| 41 | meta-llama/Llama-3.1-8B-Instruct open weights | 30.5 ±0.5 | hf.co | Official leaderboard | ||
| 42 | speakleash/Bielik-11B-v3.1-Instruct open weights | 30.5 | val | hf.co | Official leaderboard | |
| 43 | | 30.5 ±0.2 | zero-shot, val | Nov 2025 | ai.google.dev | Official leaderboard |
| 44 | NbAiLab/borealis2-26b-a4b-preview open weights | 30.4 ±0.2 | zero-shot, val | hf.co | Official leaderboard | |
| 45 | | 30.3 ±0.3 | val | Apr 2026 | hf.co | Official leaderboard |
| 46 | | 30.3 ±0.2 | zero-shot, val | Aug 2026 | ai.google.dev | Official leaderboard |
| 47 | GPT-5.6 Luna | 30.3 ±0.1 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 48 | amalia-llm/AMALIA-9B-0626-DPO open weights | 30.3 ±0.2 | val | hf.co | Official leaderboard | |
| 49 | | 30.3 ±0.3 | val | Aug 2026 | hf.co | Official leaderboard |
| 50 | utter-project/EuroLLM-9B-Instruct-2512 open weights | 30.2 ±0.2 | val | hf.co | Official leaderboard | |
| 51 | | 30.2 ±0.2 | zero-shot, val | Jul 2026 | hf.co | Official leaderboard |
| 52 | deepcogito/cogito-v1-preview-llama-3B open weights | 30.2 ±0.1 | hf.co | Official leaderboard | ||
| 53 | mistralai/Mistral-Large-3-675B-Instruct-2512 open weights | 30.1 ±0.2 | val | hf.co | Official leaderboard | |
| 54 | claude-sonnet-4-5-20250929#no-thinking closed weights | 30.1 ±0.2 | zero-shot, val | docs.anthropic.com | Official leaderboard | |
| 55 | | 30.1 ±0.3 | val | Jun 2026 | hf.co | Official leaderboard |
| 56 | openai/gpt-5.4-mini-2026-03-17#high closed weights | 30.1 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 57 | openai/gpt-5.4-mini-2026-03-17#medium closed weights | 30.0 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 58 | mistralai/Mistral-Small-4-119B-2603 open weights | 30.0 ±0.2 | val | hf.co | Official leaderboard | |
| 59 | | 29.8 ±0.2 | val | Mar 2026 | hf.co | Official leaderboard |
| 60 | Grok 4.1 Fast | 29.8 ±0.2 | zero-shot, val | Nov 2025 | docs.x.ai | Official leaderboard |
| 61 | deepseek/deepseek-flash#low closed weights | 29.8 ±0.2 | zero-shot, val | api-docs.deepseek.com | Official leaderboard | |
| 62 | amalia-llm/AMALIA-9B-0626-SFT open weights | 29.7 ±0.3 | val | hf.co | Official leaderboard | |
| 63 | | 29.7 ±0.2 | zero-shot, val | Mar 2026 | ai.google.dev | Official leaderboard |
| 64 | Qwen/Qwen3.6-27B-FP8 open weights | 29.6 ±0.3 | val | hf.co | Official leaderboard | |
| 65 | openai/gpt-5.4-mini-2026-03-17#none closed weights | 29.6 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 66 | Qwen/Qwen3-1.7B#no-thinking closed weights | 29.6 ±0.1 | hf.co | Official leaderboard | ||
| 67 | mistralai/Ministral-3-14B-Instruct-2512 open weights | 29.6 ±0.2 | val | hf.co | Official leaderboard | |
| 68 | openai/gpt-5.4-mini-2026-03-17#low closed weights | 29.4 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 69 | | 29.4 ±0.2 | val | Mar 2026 | hf.co | Official leaderboard |
| 70 | gemini/gemini-3-flash-preview#thinking closed weights | 29.4 ±0.2 | zero-shot, val | ai.google.dev | Official leaderboard | |
| 71 | | 29.4 ±0.2 | zero-shot, val | Sep 2025 | ai.google.dev | Official leaderboard |
| 72 | | 29.4 ±0.2 | val | Dec 2025 | hf.co | Official leaderboard |
| 73 | Claude Sonnet 4.6 | 29.3 ±0.2 | zero-shot, val | Feb 2026 | docs.anthropic.com | Official leaderboard |
| 74 | GPT-5 mini | 29.2 ±0.2 | zero-shot, val | Aug 2025 | platform.openai.com | Official leaderboard |
| 75 | claude-sonnet-4-5-20250929#thinking closed weights | 29.1 ±0.2 | zero-shot, val | docs.anthropic.com | Official leaderboard | |
| 76 | speakleash/Bielik-11B-v2.3-Instruct open weights | 29.1 ±0.4 | val | hf.co | Official leaderboard | |
| 77 | | 29.1 ±0.1 | Dec 2025 | hf.co | Official leaderboard | |
| 78 | meta-llama/Llama-3.2-3B-Instruct open weights | 29.0 ±0.1 | hf.co | Official leaderboard | ||
| 79 | | 28.9 ±0.3 | val | Feb 2026 | hf.co | Official leaderboard |
| 80 | NbAiLab/borealis2-e4b-preview open weights | 28.9 ±0.2 | zero-shot, val | hf.co | Official leaderboard | |
| 81 | openai/gpt-5.4-2026-03-05#none closed weights | 28.9 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 82 | | 28.9 ±0.2 | val | Jul 2025 | hf.co | Official leaderboard |
| 83 | granite-4.0-micro | 28.9 ±0.7 | Oct 2025 | hf.co | Official leaderboard | |
| 84 | Aleph-Alpha/Kolibri-1 open weights | 28.9 ±0.1 | zero-shot, val | hf.co | Official leaderboard | |
| 85 | Claude Haiku 4.5 | 28.8 ±0.2 | zero-shot, val | Oct 2025 | docs.anthropic.com | Official leaderboard |
| 86 | GPT-5.2 | 28.8 ±0.2 | zero-shot, val | Dec 2025 | platform.openai.com | Official leaderboard |
| 87 | | 28.7 ±0.2 | val | Dec 2025 | hf.co | Official leaderboard |
| 88 | | 28.7 ±0.2 | zero-shot, val | Jul 2026 | ai.google.dev | Official leaderboard |
| 89 | ibm-granite/granite-4.0-h-micro open weights | 28.6 ±0.5 | hf.co | Official leaderboard | ||
| 90 | openGPT-X/Teuken-7B-instruct-v0.6 open weights | 28.6 ±0.2 | val | hf.co | Official leaderboard | |
| 91 | | 28.5 ±0.2 | zero-shot, val | Jul 2026 | ai.google.dev | Official leaderboard |
| 92 | | 28.5 ±0.2 | Dec 2025 | hf.co | Official leaderboard | |
| 93 | NbAiLab/borealis2-e2b-preview open weights | 28.3 ±0.1 | zero-shot, val | hf.co | Official leaderboard | |
| 94 | allenai/Olmo-3.1-32B-Instruct-DPO open weights | 28.1 ±0.3 | hf.co | Official leaderboard | ||
| 95 | glm-4.7-flash | 28.0 ±0.2 | val | Jan 2026 | hf.co | Official leaderboard |
| 96 | | 28.0 ±0.4 | val | Feb 2026 | hf.co | Official leaderboard |
| 97 | mistralai/Mistral-Small-3.1-24B-Base-2503 open weights | 28.0 ±1.4 | hf.co | Official leaderboard | ||
| 98 | swiss-ai/Apertus-v1.1-4B-Instruct open weights | 28.0 ±0.9 | val | hf.co | Official leaderboard | |
| 99 | | 27.8 ±0.7 | val | Feb 2026 | hf.co | Official leaderboard |
| 100 | LiquidAI/LFM2.5-8B-A1B-Base open weights | 27.7 ±0.3 | val | hf.co | Official leaderboard | |
| 101 | | 27.4 ±1.5 | Aug 2025 | hf.co | Official leaderboard | |
| 102 | HuggingFaceTB/SmolLM3-3B#no-thinking open weights | 27.4 ±0.2 | hf.co | Official leaderboard | ||
| 103 | openai/gpt-5.4-nano-2026-03-17#high closed weights | 27.4 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 104 | GadflyII/GLM-4.7-Flash-NVFP4 open weights | 27.3 ±0.4 | val | hf.co | Official leaderboard | |
| 105 | OpenLLM-France/Luciole-23B-Instruct-1.1 open weights | 27.2 ±0.2 | val | hf.co | Official leaderboard | |
| 106 | | 27.1 ±0.7 | val | Oct 2024 | hf.co | Official leaderboard |
| 107 | openai/gpt-5.4-nano-2026-03-17#medium closed weights | 27.1 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 108 | BSC-LT/salamandra-7b-instruct open weights | 27.0 ±0.5 | hf.co | Official leaderboard | ||
| 109 | openai/gpt-5.4-nano-2026-03-17#none open weights | 27.0 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 110 | openai/gpt-5.4-nano-2026-03-17#low closed weights | 26.9 ±0.2 | zero-shot, val | platform.openai.com | Official leaderboard | |
| 111 | yulan-team/YuLan-Mini-Instruct open weights | 26.9 ±0.4 | hf.co | Official leaderboard | ||
| 112 | mistralai/Ministral-3-8B-Reasoning-2512 open weights | 26.6 ±0.8 | hf.co | Official leaderboard | ||
| 113 | domyn/Domyn-Small-v1.0 open weights | 26.4 ±0.2 | val | hf.co | Official leaderboard | |
| 114 | | 26.3 ±1.5 | Jul 2024 | hf.co | Official leaderboard | |
| 115 | gpt-oss-20b | 26.2 ±0.1 | medium | Aug 2025 | hf.co | Official leaderboard |
| 116 | gpt-oss-120b | 26.1 ±0.3 | val | Aug 2025 | hf.co | Official leaderboard |
| 117 | swiss-ai/Apertus-v1.1-1.5B-Instruct open weights | 26.1 ±0.9 | val | hf.co | Official leaderboard | |
| 118 | | 26.0 ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 119 | allenai/Llama-3.1-Tulu-3-8B-SFT open weights | 25.9 ±1.6 | hf.co | Official leaderboard | ||
| 120 | GPT-5 nano | 25.9 ±0.2 | zero-shot, val | Aug 2025 | platform.openai.com | Official leaderboard |
| 121 | mistralai/Ministral-3-14B-Base-2512 open weights | 25.8 ±1.5 | val | hf.co | Official leaderboard | |
| 122 | allenai/Olmo-3-1125-32B open weights | 25.8 ±1 | hf.co | Official leaderboard | ||
| 123 | OpenLLM-France/Luciole-8B-Instruct-1.1 open weights | 25.8 ±0.2 | val | hf.co | Official leaderboard | |
| 124 | | 25.6 ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 125 | allenai/Olmo-3-7B-Instruct-DPO open weights | 25.3 ±0.9 | hf.co | Official leaderboard | ||
| 126 | mistralai/Ministral-3-8B-Base-2512 open weights | 25.2 ±1.5 | val | hf.co | Official leaderboard | |
| 127 | allenai/Olmo-3-7B-Instruct open weights | 25.2 ±1.3 | hf.co | Official leaderboard | ||
| 128 | Qwen/Qwen3-0.6B#no-thinking closed weights | 24.9 ±0.8 | hf.co | Official leaderboard | ||
| 129 | occiglot/occiglot-7b-eu5-instruct open weights | 24.5 ±1.1 | hf.co | Official leaderboard | ||
| 130 | | 24.5 ±0.3 | val | Feb 2026 | hf.co | Official leaderboard |
| 131 | | 24.4 ±1.4 | Mar 2025 | hf.co | Official leaderboard | |
| 132 | utter-project/EuroLLM-22B-2512 open weights | 24.3 ±1.4 | hf.co | Official leaderboard | ||
| 133 | utter-project/EuroLLM-1.7B-Instruct open weights | 24.1 ±1 | val | hf.co | Official leaderboard | |
| 134 | LFM2-1.2B | 24.1 ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 135 | swiss-ai/Apertus-v1.1-4B open weights | 24.1 ±1.2 | val | hf.co | Official leaderboard | |
| 136 | LiquidAI/LFM2-700M open weights | 24.0 ±0.4 | hf.co | Official leaderboard | ||
| 137 | | 24.0 ±1.3 | Mar 2025 | hf.co | Official leaderboard | |
| 138 | swiss-ai/Apertus-v1.1-1.5B open weights | 23.9 ±0.5 | val | hf.co | Official leaderboard | |
| 139 | danish-foundation-models/DFM-Mimir open weights | 23.6 ±0.7 | val | hf.co | Official leaderboard | |
| 140 | utter-project/EuroLLM-9B open weights | 23.5 ±1.7 | hf.co | Official leaderboard | ||
| 141 | LiquidAI/LFM2-350M open weights | 23.5 ±0.4 | hf.co | Official leaderboard | ||
| 142 | swiss-ai/Apertus-v1.1-0.5B-Instruct open weights | 23.4 ±1.6 | val | hf.co | Official leaderboard | |
| 143 | | 23.1 ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 144 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-Base-BF16 open weights | 22.6 ±1.6 | val | hf.co | Official leaderboard | |
| 145 | | 22.2 ±1.2 | Mar 2025 | hf.co | Official leaderboard | |
| 146 | openeurollm/prelude-long open weights | 22.1 ±1.2 | val | hf.co | Official leaderboard | |
| 147 | | 21.9 ±1.1 | val | Feb 2026 | hf.co | Official leaderboard |
| 148 | OpenLLM-France/Luciole-1B-Instruct-1.1 open weights | 21.9 ±0.1 | val | hf.co | Official leaderboard | |
| 149 | allenai/Olmo-3-1025-7B open weights | 21.9 ±1.1 | hf.co | Official leaderboard | ||
| 150 | openeurollm/prelude-base open weights | 21.5 ±1.2 | val | hf.co | Official leaderboard | |
| 151 | | 21.4 ±0.4 | val | Feb 2026 | hf.co | Official leaderboard |
| 152 | openeurollm/oellm-9b-128k-theta32m-v3 open weights | 21.2 ±1.4 | val | hf.co | Official leaderboard | |
| 153 | | 21.1 ±1.3 | val | Dec 2025 | hf.co | Official leaderboard |
| 154 | HuggingFaceTB/SmolLM3-3B-Base open weights | 21.1 ±0.9 | hf.co | Official leaderboard | ||
| 155 | | 21.1 ±1.2 | val | Feb 2026 | hf.co | Official leaderboard |
| 156 | speakleash/Bielik-1.5B-v3.0-Instruct open weights | 21.0 ±1.8 | hf.co | Official leaderboard | ||
| 157 | | 21.0 ±0.7 | Sep 2024 | hf.co | Official leaderboard | |
| 158 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-BF16 open weights | 20.9 ±0.2 | val | hf.co | Official leaderboard | |
| 159 | BSC-LT/salamandra-7b open weights | 20.7 ±1.1 | hf.co | Official leaderboard | ||
| 160 | danish-foundation-models/DFM-Mimir-v1.5 open weights | 20.6 ±1 | val | hf.co | Official leaderboard | |
| 161 | | 20.3 ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 162 | AI-Sweden-Models/Llama-3-8B-instruct open weights | 20.2 ±0.4 | val | hf.co | Official leaderboard | |
| 163 | | 20.1 ±0.8 | val | Feb 2026 | hf.co | Official leaderboard |
| 164 | occiglot/occiglot-7b-eu5 open weights | 19.9 ±0.9 | hf.co | Official leaderboard | ||
| 165 | swiss-ai/Apertus-v1.1-0.5B open weights | 19.9 ±0.7 | val | hf.co | Official leaderboard | |
| 166 | utter-project/EuroLLM-1.7B open weights | 19.9 ±1.2 | val | hf.co | Official leaderboard | |
| 167 | utter-project/EuroMoE-2.6B-A0.6B-Preview open weights | 19.6 ±0.7 | hf.co | Official leaderboard | ||
| 168 | OpenLLM-France/Luciole-8B-Base open weights | 19.5 ±1.3 | val | hf.co | Official leaderboard | |
| 169 | OpenLLM-France/Luciole-23B-Base open weights | 19.1 ±1.1 | val | hf.co | Official leaderboard | |
| 170 | nvidia/NVIDIA-Nemotron-3-Nano-30B-A3B-FP8 open weights | 19.1 ±0.4 | val | hf.co | Official leaderboard | |
| 171 | meta-llama/Llama-3.2-1B-Instruct open weights | 19.1 ±0.8 | hf.co | Official leaderboard | ||
| 172 | allenai/Olmo-3-7B-Instruct-SFT open weights | 18.8 ±0.9 | hf.co | Official leaderboard | ||
| 173 | utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview open weights | 18.6 ±2.7 | hf.co | Official leaderboard | ||
| 174 | | 18.5 ±0.7 | val | Feb 2026 | hf.co | Official leaderboard |
| 175 | allenai/Olmo-3.1-32B-Instruct-SFT open weights | 18.4 ±1 | hf.co | Official leaderboard | ||
| 176 | nvidia/NVIDIA-Nemotron-3-Nano-4B-BF16 open weights | 18.0 ±0.2 | hf.co | Official leaderboard | ||
| 177 | PleIAs/Pleias-1.2b-Preview open weights | 17.1 ±0.9 | hf.co | Official leaderboard | ||
| 178 | OpenLLM-France/Luciole-1B-Base open weights | 17.1 ±1.2 | val | hf.co | Official leaderboard | |
| 179 | PleIAs/Pleias-3b-Preview open weights | 17.0 ±1 | hf.co | Official leaderboard | ||
| 180 | HuggingFaceTB/SmolLM2-360M-Instruct open weights | 16.8 ±1.1 | hf.co | Official leaderboard | ||
| 181 | PleIAs/Pleias-350m-Preview open weights | 16.6 ±1.3 | hf.co | Official leaderboard | ||
| 182 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct open weights | 16.4 ±1.1 | hf.co | Official leaderboard | ||
| 183 | CohereLabs/aya-23-8B open weights | 16.3 ±1 | val | hf.co | Official leaderboard | |
| 184 | nvidia/NVIDIA-Nemotron-3-Nano-4B-FP8 open weights | 16.1 ±0.4 | val | hf.co | Official leaderboard | |
| 185 | | 15.5 ±0.5 | val | Mar 2026 | hf.co | Official leaderboard |
| 186 | HuggingFaceTB/SmolLM2-135M-Instruct open weights | 14.0 ±1.2 | hf.co | Official leaderboard | ||
| 187 | | 13.6 ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 188 | | 13.6 ±1.2 | Oct 2024 | hf.co | Official leaderboard | |
| 189 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base open weights | 12.7 ±1.1 | hf.co | Official leaderboard | ||
| 190 | TildeAI/TildeOpen-30b open weights | 12.4 ±0.9 | val | hf.co | Official leaderboard | |
| 191 | AIDC-AI/Marco-Mini-Global-Base open weights | 10.6 ±0.5 | val | hf.co | Official leaderboard | |
| 192 | PleIAs/Monad open weights | 5.38 ±0.1 | hf.co | Official leaderboard | ||
| 193 | LFM2.5-8B-A1B | 4.30 ±0.5 | val | May 2026 | hf.co | Official leaderboard |
| 194 | inclusionAI/Ling-mini-2.0 open weights | 4.06 ±0.2 | val | hf.co | Official leaderboard | |
| 195 | openbmb/MiniCPM5-1B open weights | 2.13 ±0.2 | val | hf.co | Official leaderboard | |
| 196 | | 1.94 ±1.1 | val | Dec 2025 | hf.co | Official leaderboard |
| 197 | Muse-research/Muse-3B open weights | 1.16 ±0.2 | val | hf.co | Official leaderboard | |
| 198 | inclusionAI/Ling-mini-base-2.0 open weights | 0.62 ±0.1 | val | hf.co | Official leaderboard | |
| 199 | openGPT-X/Teuken-7B-base-v0.6 open weights | 0.00 | val | hf.co | Official leaderboard |
| # | Model | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 32.8 ±0.1 | Dec 2024 | hf.co | Official leaderboard | |
| 2 | | 32.3 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 3 | | 32.2 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 4 | GPT-6 Astra | 32.1 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 5 | GPT-6 Sol | 32.1 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 6 | GPT-6.1 Sol | 31.9 ±0.4 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 7 | GPT-6.2 Astra | 31.7 ±0.2 | zero-shot, val | Nov 2026 | platform.openai.com | Official leaderboard |
| 8 | | 31.7 ±0.1 | Sep 2024 | hf.co | Official leaderboard | |
| 9 | GPT-5.6 Sol | 31.5 ±0.2 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 10 | | 31.5 ±0.1 | Jun 2025 | hf.co | Official leaderboard | |
| 11 | GPT-6.2 Sol | 31.5 ±0.2 | zero-shot, val | Nov 2026 | platform.openai.com | Official leaderboard |
| 12 | GPT-4.1 | 31.3 ±0.2 | zero-shot, val | Apr 2025 | platform.openai.com | Official leaderboard |
| 13 | GPT-6 Luna | 31.2 ±0.2 | zero-shot, val | Sep 2026 | platform.openai.com | Official leaderboard |
| 14 | | 31.0 ±0.2 | val | Apr 2026 | hf.co | Official leaderboard |
| 15 | | 30.9 ±0.2 | val | Apr 2026 | hf.co | Official leaderboard |
| 16 | GPT-5.6 Terra | 30.9 ±0.2 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 17 | | 30.8 ±0.2 | val | Jul 2026 | hf.co | Official leaderboard |
| 18 | | 30.8 ±0.5 | Jul 2025 | hf.co | Official leaderboard | |
| 19 | | 30.8 ±0.1 | Mar 2025 | hf.co | Official leaderboard | |
| 20 | GLM-5.3-Flash | 30.6 ±0.9 | val | Aug 2026 | hf.co | Official leaderboard |
| 21 | | 30.5 ±0.1 | Aug 2025 | hf.co | Official leaderboard | |
| 22 | | 30.5 ±0.2 | zero-shot, val | Nov 2025 | ai.google.dev | Official leaderboard |
| 23 | | 30.3 ±0.3 | val | Apr 2026 | hf.co | Official leaderboard |
| 24 | | 30.3 ±0.2 | zero-shot, val | Aug 2026 | ai.google.dev | Official leaderboard |
| 25 | GPT-5.6 Luna | 30.3 ±0.1 | zero-shot, val | Jul 2026 | platform.openai.com | Official leaderboard |
| 26 | | 30.3 ±0.3 | val | Aug 2026 | hf.co | Official leaderboard |
| 27 | | 30.2 ±0.2 | zero-shot, val | Jul 2026 | hf.co | Official leaderboard |
| 28 | | 30.1 ±0.3 | val | Jun 2026 | hf.co | Official leaderboard |
| 29 | | 29.8 ±0.2 | val | Mar 2026 | hf.co | Official leaderboard |
| 30 | Grok 4.1 Fast | 29.8 ±0.2 | zero-shot, val | Nov 2025 | docs.x.ai | Official leaderboard |
| 31 | | 29.7 ±0.2 | zero-shot, val | Mar 2026 | ai.google.dev | Official leaderboard |
| 32 | | 29.4 ±0.2 | val | Mar 2026 | hf.co | Official leaderboard |
| 33 | | 29.4 ±0.2 | zero-shot, val | Sep 2025 | ai.google.dev | Official leaderboard |
| 34 | | 29.4 ±0.2 | val | Dec 2025 | hf.co | Official leaderboard |
| 35 | Claude Sonnet 4.6 | 29.3 ±0.2 | zero-shot, val | Feb 2026 | docs.anthropic.com | Official leaderboard |
| 36 | GPT-5 mini | 29.2 ±0.2 | zero-shot, val | Aug 2025 | platform.openai.com | Official leaderboard |
| 37 | | 29.1 ±0.1 | Dec 2025 | hf.co | Official leaderboard | |
| 38 | | 28.9 ±0.3 | val | Feb 2026 | hf.co | Official leaderboard |
| 39 | | 28.9 ±0.2 | val | Jul 2025 | hf.co | Official leaderboard |
| 40 | granite-4.0-micro | 28.9 ±0.7 | Oct 2025 | hf.co | Official leaderboard | |
| 41 | Claude Haiku 4.5 | 28.8 ±0.2 | zero-shot, val | Oct 2025 | docs.anthropic.com | Official leaderboard |
| 42 | GPT-5.2 | 28.8 ±0.2 | zero-shot, val | Dec 2025 | platform.openai.com | Official leaderboard |
| 43 | | 28.7 ±0.2 | val | Dec 2025 | hf.co | Official leaderboard |
| 44 | | 28.7 ±0.2 | zero-shot, val | Jul 2026 | ai.google.dev | Official leaderboard |
| 45 | | 28.5 ±0.2 | zero-shot, val | Jul 2026 | ai.google.dev | Official leaderboard |
| 46 | | 28.5 ±0.2 | Dec 2025 | hf.co | Official leaderboard | |
| 47 | glm-4.7-flash | 28.0 ±0.2 | val | Jan 2026 | hf.co | Official leaderboard |
| 48 | | 28.0 ±0.4 | val | Feb 2026 | hf.co | Official leaderboard |
| 49 | | 27.8 ±0.7 | val | Feb 2026 | hf.co | Official leaderboard |
| 50 | | 27.4 ±1.5 | Aug 2025 | hf.co | Official leaderboard | |
| 51 | | 27.1 ±0.7 | val | Oct 2024 | hf.co | Official leaderboard |
| 52 | | 26.3 ±1.5 | Jul 2024 | hf.co | Official leaderboard | |
| 53 | gpt-oss-20b | 26.2 ±0.1 | medium | Aug 2025 | hf.co | Official leaderboard |
| 54 | gpt-oss-120b | 26.1 ±0.3 | val | Aug 2025 | hf.co | Official leaderboard |
| 55 | | 26.0 ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 56 | GPT-5 nano | 25.9 ±0.2 | zero-shot, val | Aug 2025 | platform.openai.com | Official leaderboard |
| 57 | | 25.6 ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 58 | | 24.5 ±0.3 | val | Feb 2026 | hf.co | Official leaderboard |
| 59 | | 24.4 ±1.4 | Mar 2025 | hf.co | Official leaderboard | |
| 60 | LFM2-1.2B | 24.1 ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 61 | | 24.0 ±1.3 | Mar 2025 | hf.co | Official leaderboard | |
| 62 | | 23.1 ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 63 | | 22.2 ±1.2 | Mar 2025 | hf.co | Official leaderboard | |
| 64 | | 21.9 ±1.1 | val | Feb 2026 | hf.co | Official leaderboard |
| 65 | | 21.4 ±0.4 | val | Feb 2026 | hf.co | Official leaderboard |
| 66 | | 21.1 ±1.3 | val | Dec 2025 | hf.co | Official leaderboard |
| 67 | | 21.1 ±1.2 | val | Feb 2026 | hf.co | Official leaderboard |
| 68 | | 21.0 ±0.7 | Sep 2024 | hf.co | Official leaderboard | |
| 69 | | 20.3 ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 70 | | 20.1 ±0.8 | val | Feb 2026 | hf.co | Official leaderboard |
| 71 | | 18.5 ±0.7 | val | Feb 2026 | hf.co | Official leaderboard |
| 72 | | 15.5 ±0.5 | val | Mar 2026 | hf.co | Official leaderboard |
| 73 | | 13.6 ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 74 | | 13.6 ±1.2 | Oct 2024 | hf.co | Official leaderboard | |
| 75 | LFM2.5-8B-A1B | 4.30 ±0.5 | val | May 2026 | hf.co | Official leaderboard |
| 76 | | 1.94 ±1.1 | val | Dec 2025 | hf.co | Official leaderboard |
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: Official EuroEval ERRNews leaderboard
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: Official EuroEval ERRNews leaderboard
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official EuroEval ERRNews leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official EuroEval ERRNews leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
All 10 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 4 pass 1 note
- Pass Independent runs Scores from the official leaderboard (199 entries).
- Pass Models scored 76 models we track, plus 123 other entries on its leaderboard.
- Pass Newest score The newest is from November 2026, for GPT-6.2 Astra.
- Pass Frontier models 3 of the top 10 have a score, led by GPT-6.2 Astra (#1).
- Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
- Pass Importer We read the board on euroeval.com: 89 rows for models we track and 123 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.