GermanQuAD
Models extract answers to German questions from manually annotated Wikipedia passages.
EuroEval reports character-level F1 and exact match.
- Made by
- Timo Möller and colleagues
- Released
- April 2021
- Kind
- Reading in many languages
- Level
- School
- Scored
- Checked automatically
- Answers
- Short answer
- Tasks
- All public
- Measures
- Capability
- Language
- German
- Interaction
- Single turn
- Items from
- Real work and use
- Refresh
- One fixed set
- Run by
- Anyone
- Strongest model tested
-
Qwen3-235B-A22B #131 on the capability index
- Last model added
- March 2026
- Scores refreshed
- November 20th, 2026
allenai/Olmo-3-1125-32B tops the leaderboard with 72.4% Gemma 2 27B leads with 70% among models released by March 2026
Best score per entry from EuroEval’s leaderboard, read on November 20th, 2026. EuroEval reports character-level F1 on the GermanQuAD-mini test split, scaled by 100. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Gemma 2 27B, at 70%. This view shows only models we track, each at its best.
The newest model with a score here came out in March 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- and 16 more
- 72.4 allenai/Olmo-3-1125-32B
- 70.0
Gemma 2 27B
- 69.4
Llama 3.1-405B
- 69.2
Llama 2-70B
- 69.0 mistralai/Mistral-Small-3.1-24B-Base-2503
- 68.4 allenai/OLMo-2-0325-32B
- 68.4
Gemma 3 12B PT
- 68.4
Gemma 3n E4B
- 68.3 allenai/OLMo-2-1124-13B
- 68.2
Yi-1.5-34B
- 68.1
Llama 3.1-70B
- 68.1 utter-project/EuroLLM-22B-Preview
- 68.0 allenai/Olmo-3-1025-7B
- 68.0 upstage/SOLAR-10.7B-v1.0
- 68.0
Gemma 3 27B PT
- 68.0 utter-project/EuroLLM-22B-2512
- 67.6
Apertus 70B
- 67.5 speakleash/Bielik-11B-v3-Base-20250730
- 67.0 mistralai/Ministral-3-3B-Base-2512
- 66.8 01-ai/Yi-1.5-9B
- 66.8 allenai/OLMo-2-1124-7B
- 66.8 tiiuae/Falcon3-10B-Base
- 66.5
Llama 3.1-8B
- 66.3 speakleash/Bielik-11B-v2.3-Instruct
- 65.8
Llama 3-8B
- 65.6 swiss-ai/Apertus-8B-2509
- 65.5 ibm-granite/granite-34b-code-base
- 65.5 mistralai/Magistral-Small-2509
- 65.4
Mistral Small 3.1
- 65.2 mistralai/Ministral-3-8B-Reasoning-2512
- 65.2
Gemma 2 9B
- 64.9 allenai/Olmo-3.1-32B-Instruct-SFT
- 64.8
Mistral Small 3.2
- 64.8
Nemotron 3 Nano 30B-A3B
- 64.6
Falcon3-10B-Instruct
- 64.6 ai21labs/Jamba-v0.1
- 64.5 TildeAI/TildeOpen-30b
- 64.5 bullerwins/Magistral-Small-2506-fp8
- 64.4 CohereForAI/aya-23-35B
- 64.3
Gemma 7B
- 64.2 BSC-LT/ALIA-40b
- 64.0
Gemma 3 4B PT
- 64.0 syvai/llama3-da-base
- 63.9 mistralai/Voxtral-Mini-3B-2507
- 63.8 meta-llama/Llama-2-13b-hf
- 63.7 utter-project/EuroLLM-9B
- 63.5 allenai/Llama-3.1-Tulu-3-8B-SFT
- 63.2
Qwen3-32B
- 63.2
Command R7B
- 63.0 allenai/Olmo-3.1-32B-Instruct-DPO
- 62.7
Falcon3-7B-Instruct
- 62.4
Mistral 7B v0.3
- 62.4 Granite-3.0-8B-Instruct
- 62.0 allenai/Llama-3.1-Tulu-3-8B-DPO
- 61.9 Granite-3.0-8B-Base
- 61.5 HuggingFaceTB/SmolLM3-3B-Base
- 61.5
Qwen3-14B
- 61.3
Voxtral Small
- 61.2 mii-llm/nesso-4B
- 61.1 deepcogito/cogito-v1-preview-qwen-32B
- 60.9 ibm-granite/granite-20b-code-base
- 60.9
Mistral 7B v0.1
- 60.7
Olmo 3.1 32B Instruct
- 60.6 senseable/WestLake-7B-v2
- 60.4 NovaSky-AI/Sky-T1-32B-Preview
- 60.1 occiglot/occiglot-7b-eu5
- 60.1 tiiuae/Falcon3-7B-Base
- 59.8 NousResearch/DeepHermes-3-Llama-3-8B-Preview
- 59.5 ibm-granite/granite-34b-code-instruct
- 59.4 LumiOpen/Llama-Poro-2-70B-SFT
- 59.2 baidu/ERNIE-4.5-21B-A3B-PT
- 59.0 mistralai/Mistral-Small-24B-Instruct-2501
- 58.9
Ministral 3 3B Reasoning
- 58.9
Phi-4-reasoning
- 58.6 norallm/normistral-11b-warm
- 58.5
Apertus 8B Instruct
- 58.3 MaLA-LM/emma-500-llama2-7b
- 58.2 utter-project/EuroLLM-9B-Instruct
- 58.1 kyutai/helium-1-2b
- 58.0
Qwen1.5-14B-Chat
- 57.7
Starling-LM-7B-beta
- 57.6 allenai/OLMo-2-1124-7B-Instruct
- 57.6 utter-project/EuroLLM-22B-Instruct-Preview
- 57.6
Mistral-7B-Instruct-v0.1
- 57.5 meta-llama/Llama-3.1-405B-Instruct-FP8
- 57.5 TrustLLMeu/baseline-7-8b_2-3t-tokens_llama
- 57.3
Llama-3.1-Tulu-3-8B
- 57.3
Qwen3-30B-A3B
- 57.2 arcee-ai/AFM-4.5B-Base
- 57.1 ibm-granite/granite-8b-code-base-4k
- 57.1 google/gemma-2-9b-it
- 56.6
Gemma 2 2B IT
- 56.6 ibm-granite/granite-3.0-3b-a800m-instruct
- 56.2
Cogito v1 Preview 70B
- 56.1 HuggingFaceTB/SmolLM3-3B
- 55.8
Aya Expanse 32B
- 55.7 google/gemma-2-27b-it
- 55.6 deepcogito/cogito-v1-preview-qwen-14B
- 55.5
Qwen3-235B-A22B
- 55.5 LumiOpen/Llama-Poro-2-70B-Instruct
- 55.4 152334H/miqu-1-70b-sf
- 55.4
Qwen3-8B
- 55.4 qwen3-4b-instruct-2507
- 55.3 Granite 4.0 H Small
- 55.1 Qwen/Qwen3-235B-A22B-Instruct-2507-FP8
- 55.0 deepcogito/cogito-v2-preview-llama-70B
- 54.9 ThatsGroes/gemma-2-27b-it-FP8-Dynamic
- 54.9
Qwen3-Next-80B-A3B-Instruct
- 54.8
Gemma 3 12B
- 54.7 allenai/Llama-3.1-Tulu-3.1-8B
- 54.5 ibm-granite/granite-4.0-h-micro
- 54.4 TrustLLMeu/baseline-7-8b_1t-tokens_llama
- 54.3 granite-4.0-micro
- 54.0
Gemma 3n E2B
- 54.0 seedboxai/KafkaLM-70B-German-V0.1
- 53.9 ibm-granite/granite-8b-code-instruct-4k
- 53.8 Reka Flash 3
- 53.8 Qwen/Qwen3-235B-A22B-Thinking-2507-FP8
- 53.6 deepseek-r1-0528-qwen3-8b
- 53.6 allenai/OLMo-2-1124-13B-Instruct
- 53.5
Qwen3-1.7B
- 53.5
Gemma 3 27B
- 53.4
Qwen3-4B
- 53.4
Qwen3-4B-Thinking-2507
- 53.3 google/gemma-2-2b
- 53.1 infly/OpenCoder-8B-Instruct
- 53.0 ollama_chat/gemma3:27b-it-fp16
- 53.0 common-pile/comma-v0.1-2t
- 52.7 Qwen/Qwen2.5-1.5B-Instruct
- 52.4 meta-llama/Llama-3.1-8B-Instruct
- 52.3 ibm-granite/granite-20b-code-instruct
- 51.8 meta-llama/Llama-2-13b-chat-hf
- 51.5 meta-llama/Llama-2-70b-chat-hf
- 51.5
Llama 4 Scout
- 50.8 LumiOpen/Viking-33B
- 50.8 nvidia-nemotron-nano-9b-v2
- 50.7
Falcon3-3B-Instruct
- 50.3 LiquidAI/LFM2-2.6B
- 50.0 TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49
- 49.9 ibm-granite/granite-3.0-3b-a800m-base
- 49.8 FacebookAI/xlm-roberta-large
- 49.6 gpt-oss-20b
- 49.0 ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf
- 48.6 speakleash/Bielik-4.5B-v3.0-Instruct
- 48.6 allenai/Olmo-3-7B-Instruct
- 48.6 allenai/Olmo-3-7B-Think
- 48.5
DeepSeek-R1-Distill-Llama-70B
- 48.3 BSC-LT/salamandra-7b
- 48.2 allenai/Olmo-3-7B-Instruct-SFT
- 48.2 openGPT-X/Teuken-7B-instruct-commercial-v0.4
- 47.9
Mistral-7B-Instruct-v0.2
- 47.7 intfloat/multilingual-e5-large
- 47.6
Qwen3-Next-80B-A3B
- 47.4
DeepSeek-R1-Distill-Qwen-32B
- 46.8 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview
- 46.5 deepcogito/cogito-v1-preview-llama-8B
- 46.5 arcee-ai/Trinity-Nano-Preview
- 45.9 allenai/Olmo-3-7B-Instruct-DPO
- 45.9
QwQ-32B
- 45.8 ollama_chat/gemma3:4b-it-q4_K_M
- 45.4 meta-llama/Llama-2-7b-chat-hf
- 45.3 arcee-ai/Trinity-Nano-Base
- 45.3 meta-llama/Llama-3.2-3B-Instruct
- 45.2 speakleash/Bielik-1.5B-v3.0-Instruct
- 44.8 common-pile/comma-v0.1-1t
- 44.7 Reka Flash 3.1
- 44.0 Qwen/Qwen2.5-Math-7B
- 43.9 jhu-clsp/mmBERT-base
- 43.4 TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f
- 43.4 TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6
- 43.3
SmolLM2 1.7B Instruct
- 43.2
Gemma 3 1B PT
- 43.1 seedboxai/KafkaLM-13B-German-V0.1
- 43.0 occiglot/occiglot-7b-eu5-instruct
- 42.7 facebook/MobileLLM-R1-950M-base
- 42.3 tiiuae/Falcon3-3B-Base
- 41.8 TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894
- 41.4 utter-project/EuroMoE-2.6B-A0.6B-Preview
- 41.3 TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660
- 41.2 yulan-team/YuLan-Mini-Instruct
- 41.1
Gemma 3 4B
- 40.6 EuroBERT/EuroBERT-610m
- 40.5
Qwen3-0.6B
- 39.0
SmolLM2-1.7B
- 38.5
Phi-4
- 36.9 utter-project/EuroLLM-22B-Instruct-2512
- 36.8
Gemma 3 1B
- 36.2
DeepSeek-R1-Distill-Qwen-7B
- 36.2 meta-llama/Llama-4-Scout-17B-16E
- 36.0 PleIAs/Pleias-3b-Preview
- 35.4 tencent/Hunyuan-7B-Instruct
- 35.2 tiiuae/falcon-11B
- 33.6 AI-Sweden-Models/ModernBERT-large
- 33.4 infly/OpenCoder-8B-Base
- 33.2 PleIAs/Pleias-1.2b-Preview
- 32.4
DeepSeek-R1-Distill-Qwen-14B
- 31.6 ibm-granite/granite-4.0-h-tiny
- 31.3 OpenLLM-France/Lucie-7B
- 31.1 ibm-granite/granite-3b-code-base-2k
- 30.2 GLM-4.5-Air
- 30.1 LFM2.5-1.2B-Instruct
- 29.7 timpal0l/Mistral-7B-v0.1-flashback-v2
- 29.1 speakleash/Bielik-11B-v2.6-Instruct
- 28.8 google/gemma-7b-it
- 28.4 tencent/Hunyuan-1.8B-Instruct
- 27.4 jhu-clsp/mmBERT-small
- 26.6 infly/OpenCoder-1.5B-Instruct
- 26.4
Llama 3.2 1B
- 26.2 deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- 25.7
AFM-4.5B
- 25.0 LFM2.5-1.2B-Thinking
- 23.9 ibm-granite/granite-3b-code-instruct-2k
- 23.5 LiquidAI/LFM2.5-1.2B-Base
- 23.4 HPLT/hplt2c_deu_checkpoints
- 22.4 intfloat/multilingual-e5-base
- 21.9 LiquidAI/LFM2-700M
- 21.4 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct
- 21.2 deepcogito/cogito-v1-preview-llama-3B
- 20.9
Qwen1.5-14B
- 20.8 utter-project/EuroVLM-1.7B-Preview
- 20.6 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base
- 20.2
SmolLM2-360M
- 20.2
Gemma 3 270M
- 20.1 BSC-LT/salamandra-7b-instruct
- 19.7 LiquidAI/LFM2-350M
- 18.9 LFM2-1.2B
- 18.6
DeepSeek-R1-Distill-Qwen-1.5B
- 17.8
Phi-2
- 17.8 PleIAs/Pleias-350m-Preview
- 17.7
OLMo 2 32B Instruct
- 16.8 facebook/MobileLLM-R1-360M-base
- 16.8 HPLT/hplt2c_eng_checkpoints
- 15.9 baidu/ERNIE-4.5-0.3B-PT
- 14.9 arcee-ai/Trinity-Mini-Base
- 14.0 EuroBERT/EuroBERT-210m
- 14.0 answerdotai/ModernBERT-large
- 13.7 GLM-4.1V-9B-Thinking
- 13.5 Qwen/Qwen2.5-Math-1.5B
- 12.5 AI-Sweden-Models/bert-large-nordic-pile-1M-steps
- 12.3
Phi-4-mini-reasoning
- 12.1 PleIAs/Pleias-Pico
- 12.0 answerdotai/ModernBERT-base
- 11.5 meta-llama/Llama-3.2-1B-Instruct
- 10.8 HuggingFaceTB/SmolLM2-360M-Instruct
- 9.52 infly/OpenCoder-1.5B-Base
- 8.85 HPLT/hplt2c_nld_checkpoints
- 6.77 facebook/MobileLLM-R1-140M-base
- 6.55 PleIAs/Baguettotron@refs/pr/6
- 6.53
Nemotron 3 Nano 4B
- 5.87 EuropeanParliament/EUBERT
- 4.89
SmolLM2-135M
- 4.80 HuggingFaceTB/SmolLM2-135M-Instruct
- 4.55 AI-Sweden-Models/gpt-sw3-356m-instruct
- 4.21 AI-Sweden-Models/gpt-sw3-126m-instruct
- 4.20 AI-Sweden-Models/gpt-sw3-356m
- 3.96 Shekswess/trlm-135m
- 3.92 DiscoResearch/DiscoLM-70b
- 3.57 alea-institute/kl3m-003-3.7b
- 3.42 PleIAs/Monad
- 3.29 microsoft/mdeberta-v3-base
- 2.69 facebook/MobileLLM-R1-950M
- 2.21 AI-Sweden-Models/gpt-sw3-126m
- 0.77 distilbert/distilbert-base-multilingual-cased
- 0.72 Geotrend/distilbert-base-25lang-cased
- 0.16 facebook/MobileLLM-R1-360M
- 0.02 facebook/MobileLLM-R1-140M
- 0.0 fresh-electra-small
- 0.0 fresh-xlm-roberta-base
- 0.0 openai-community/gpt2
- 0.0 openai-community/gpt2-large
- 0.0 openai-community/gpt2-medium
- 1 allenai/Olmo-3-1125-32B 72.4%
- 2
Gemma 2 27B 70%
- 3
Llama 3.1-405B 69.4%
- 4
Llama 2-70B 69.2%
- 5 mistralai/Mistral-Small-3.1-24B-Base-2503 69%
- 6 allenai/OLMo-2-0325-32B 68.4%
- 7
Gemma 3 12B PT 68.4%
- 8
Gemma 3n E4B 68.4%
- 9 allenai/OLMo-2-1124-13B 68.3%
- 10
Yi-1.5-34B 68.2%
- 11
Llama 3.1-70B 68.1%
- 12 utter-project/EuroLLM-22B-Preview 68.1%
- 13 allenai/Olmo-3-1025-7B 68%
- 14 upstage/SOLAR-10.7B-v1.0 68%
- 15
Gemma 3 27B PT 68%
- 16 utter-project/EuroLLM-22B-2512 68%
- 17
Apertus 70B 67.6%
- 18 speakleash/Bielik-11B-v3-Base-20250730 67.5%
- 19 mistralai/Ministral-3-3B-Base-2512 67%
- 20 01-ai/Yi-1.5-9B 66.8%
- 21 allenai/OLMo-2-1124-7B 66.8%
- 22 tiiuae/Falcon3-10B-Base 66.8%
- 23
Llama 3.1-8B 66.5%
- 24 speakleash/Bielik-11B-v2.3-Instruct 66.3%
- 25
Llama 3-8B 65.8%
- 26 swiss-ai/Apertus-8B-2509 65.6%
- 27 ibm-granite/granite-34b-code-base 65.5%
- 28 mistralai/Magistral-Small-2509 65.5%
- 29
Mistral Small 3.1 65.4%
- 30 mistralai/Ministral-3-8B-Reasoning-2512 65.2%
- 31
Gemma 2 9B 65.2%
- 32 allenai/Olmo-3.1-32B-Instruct-SFT 64.9%
- 33
Mistral Small 3.2 64.8%
- 34
Nemotron 3 Nano 30B-A3B no-thinking 64.8%
- 35
Falcon3-10B-Instruct 64.6%
- 36 ai21labs/Jamba-v0.1 64.6%
- 37 TildeAI/TildeOpen-30b slow-tokenizer 64.5%
- 38 bullerwins/Magistral-Small-2506-fp8 64.5%
- 39 CohereForAI/aya-23-35B 64.4%
- 40
Gemma 7B 64.3%
- 41 BSC-LT/ALIA-40b 64.2%
- 42
Gemma 3 4B PT 64%
- 43 syvai/llama3-da-base 64%
- 44 mistralai/Voxtral-Mini-3B-2507 63.9%
- 45 meta-llama/Llama-2-13b-hf 63.8%
- 46 utter-project/EuroLLM-9B 63.7%
- 47 allenai/Llama-3.1-Tulu-3-8B-SFT 63.5%
- 48
Qwen3-32B no-thinking 63.2%
- 49
Command R7B 63.2%
- 50 allenai/Olmo-3.1-32B-Instruct-DPO 63%
- 51
Falcon3-7B-Instruct 62.7%
- 52
Mistral 7B v0.3 62.4%
- 53 Granite-3.0-8B-Instruct 62.4%
- 54 allenai/Llama-3.1-Tulu-3-8B-DPO 62%
- 55 Granite-3.0-8B-Base 61.9%
- 56 HuggingFaceTB/SmolLM3-3B-Base 61.5%
- 57
Qwen3-14B no-thinking 61.5%
- 58
Voxtral Small 61.3%
- 59 mii-llm/nesso-4B 61.2%
- 60 deepcogito/cogito-v1-preview-qwen-32B 61.1%
- 61 ibm-granite/granite-20b-code-base 60.9%
- 62
Mistral 7B v0.1 60.9%
- 63
Olmo 3.1 32B Instruct 60.7%
- 64 senseable/WestLake-7B-v2 60.6%
- 65 NovaSky-AI/Sky-T1-32B-Preview 60.4%
- 66 occiglot/occiglot-7b-eu5 60.1%
- 67 tiiuae/Falcon3-7B-Base 60.1%
- 68 NousResearch/DeepHermes-3-Llama-3-8B-Preview 59.8%
- 69 ibm-granite/granite-34b-code-instruct 59.5%
- 70 LumiOpen/Llama-Poro-2-70B-SFT 59.4%
- 71 baidu/ERNIE-4.5-21B-A3B-PT 59.2%
- 72 mistralai/Mistral-Small-24B-Instruct-2501 59%
- 73
Ministral 3 3B Reasoning 58.9%
- 74
Phi-4-reasoning 58.9%
- 75 norallm/normistral-11b-warm 58.6%
- 76
Apertus 8B Instruct 58.5%
- 77 MaLA-LM/emma-500-llama2-7b 58.3%
- 78 utter-project/EuroLLM-9B-Instruct 58.2%
- 79 kyutai/helium-1-2b 58.1%
- 80
Qwen1.5-14B-Chat 58%
- 81
Starling-LM-7B-beta 57.7%
- 82 allenai/OLMo-2-1124-7B-Instruct 57.6%
- 83 utter-project/EuroLLM-22B-Instruct-Preview 57.6%
- 84
Mistral-7B-Instruct-v0.1 57.6%
- 85 meta-llama/Llama-3.1-405B-Instruct-FP8 57.5%
- 86 TrustLLMeu/baseline-7-8b_2-3t-tokens_llama 57.5%
- 87
Llama-3.1-Tulu-3-8B 57.3%
- 88
Qwen3-30B-A3B no-thinking 57.3%
- 89 arcee-ai/AFM-4.5B-Base 57.2%
- 90 ibm-granite/granite-8b-code-base-4k 57.1%
- 91 google/gemma-2-9b-it 57.1%
- 92
Gemma 2 2B IT 56.6%
- 93 ibm-granite/granite-3.0-3b-a800m-instruct 56.6%
- 94
Cogito v1 Preview 70B 56.2%
- 95 HuggingFaceTB/SmolLM3-3B 56.1%
- 96
Aya Expanse 32B 55.8%
- 97 google/gemma-2-27b-it 55.7%
- 98 deepcogito/cogito-v1-preview-qwen-14B 55.6%
- 99
Qwen3-235B-A22B 55.5%
- 100 LumiOpen/Llama-Poro-2-70B-Instruct 55.5%
- 101 152334H/miqu-1-70b-sf 55.4%
- 102
Qwen3-8B no-thinking 55.4%
- 103 qwen3-4b-instruct-2507 55.4%
- 104 Granite 4.0 H Small 55.3%
- 105 Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 55.1%
- 106 deepcogito/cogito-v2-preview-llama-70B 55%
- 107 ThatsGroes/gemma-2-27b-it-FP8-Dynamic 54.9%
- 108
Qwen3-Next-80B-A3B-Instruct 54.9%
- 109
Gemma 3 12B 54.8%
- 110 allenai/Llama-3.1-Tulu-3.1-8B 54.7%
- 111 ibm-granite/granite-4.0-h-micro 54.5%
- 112 TrustLLMeu/baseline-7-8b_1t-tokens_llama 54.4%
- 113 granite-4.0-micro 54.3%
- 114
Gemma 3n E2B 54%
- 115 seedboxai/KafkaLM-70B-German-V0.1 54%
- 116 ibm-granite/granite-8b-code-instruct-4k 53.9%
- 117 Reka Flash 3 53.8%
- 118 Qwen/Qwen3-235B-A22B-Thinking-2507-FP8 53.8%
- 119 deepseek-r1-0528-qwen3-8b 53.6%
- 120 allenai/OLMo-2-1124-13B-Instruct 53.6%
- 121
Qwen3-1.7B 53.5%
- 122
Gemma 3 27B 53.5%
- 123
Qwen3-4B no-thinking 53.4%
- 124
Qwen3-4B-Thinking-2507 53.4%
- 125 google/gemma-2-2b 53.3%
- 126 infly/OpenCoder-8B-Instruct 53.1%
- 127 ollama_chat/gemma3:27b-it-fp16 53%
- 128 common-pile/comma-v0.1-2t 53%
- 129 Qwen/Qwen2.5-1.5B-Instruct 52.7%
- 130 meta-llama/Llama-3.1-8B-Instruct 52.4%
- 131 ibm-granite/granite-20b-code-instruct 52.3%
- 132 meta-llama/Llama-2-13b-chat-hf 51.8%
- 133 meta-llama/Llama-2-70b-chat-hf 51.5%
- 134
Llama 4 Scout 51.5%
- 135 LumiOpen/Viking-33B 50.8%
- 136 nvidia-nemotron-nano-9b-v2 50.8%
- 137
Falcon3-3B-Instruct 50.7%
- 138 LiquidAI/LFM2-2.6B 50.3%
- 139 TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49 50%
- 140 ibm-granite/granite-3.0-3b-a800m-base 49.9%
- 141 FacebookAI/xlm-roberta-large 49.8%
- 142 gpt-oss-20b medium 49.6%
- 143 ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf 49%
- 144 speakleash/Bielik-4.5B-v3.0-Instruct 48.6%
- 145 allenai/Olmo-3-7B-Instruct 48.6%
- 146 allenai/Olmo-3-7B-Think 48.6%
- 147
DeepSeek-R1-Distill-Llama-70B 48.5%
- 148 BSC-LT/salamandra-7b 48.3%
- 149 allenai/Olmo-3-7B-Instruct-SFT 48.2%
- 150 openGPT-X/Teuken-7B-instruct-commercial-v0.4 48.2%
- 151
Mistral-7B-Instruct-v0.2 47.9%
- 152 intfloat/multilingual-e5-large 47.7%
- 153
Qwen3-Next-80B-A3B thinking 47.6%
- 154
DeepSeek-R1-Distill-Qwen-32B 47.4%
- 155 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview 46.8%
- 156 deepcogito/cogito-v1-preview-llama-8B 46.5%
- 157 arcee-ai/Trinity-Nano-Preview 46.5%
- 158 allenai/Olmo-3-7B-Instruct-DPO 45.9%
- 159
QwQ-32B 45.9%
- 160 ollama_chat/gemma3:4b-it-q4_K_M 45.8%
- 161 meta-llama/Llama-2-7b-chat-hf 45.4%
- 162 arcee-ai/Trinity-Nano-Base 45.3%
- 163 meta-llama/Llama-3.2-3B-Instruct 45.3%
- 164 speakleash/Bielik-1.5B-v3.0-Instruct 45.2%
- 165 common-pile/comma-v0.1-1t 44.8%
- 166 Reka Flash 3.1 44.7%
- 167 Qwen/Qwen2.5-Math-7B 44%
- 168 jhu-clsp/mmBERT-base 43.9%
- 169 TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f zero-shot 43.4%
- 170 TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 43.4%
- 171
SmolLM2 1.7B Instruct 43.3%
- 172
Gemma 3 1B PT 43.2%
- 173 seedboxai/KafkaLM-13B-German-V0.1 43.1%
- 174 occiglot/occiglot-7b-eu5-instruct 43%
- 175 facebook/MobileLLM-R1-950M-base 42.7%
- 176 tiiuae/Falcon3-3B-Base 42.3%
- 177 TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894 41.8%
- 178 utter-project/EuroMoE-2.6B-A0.6B-Preview 41.4%
- 179 TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 41.3%
- 180 yulan-team/YuLan-Mini-Instruct 41.2%
- 181
Gemma 3 4B 41.1%
- 182 EuroBERT/EuroBERT-610m 40.6%
- 183
Qwen3-0.6B no-thinking 40.5%
- 184
SmolLM2-1.7B 39%
- 185
Phi-4 38.5%
- 186 utter-project/EuroLLM-22B-Instruct-2512 36.9%
- 187
Gemma 3 1B 36.8%
- 188
DeepSeek-R1-Distill-Qwen-7B 36.2%
- 189 meta-llama/Llama-4-Scout-17B-16E 36.2%
- 190 PleIAs/Pleias-3b-Preview 36%
- 191 tencent/Hunyuan-7B-Instruct 35.4%
- 192 tiiuae/falcon-11B 35.2%
- 193 AI-Sweden-Models/ModernBERT-large 33.6%
- 194 infly/OpenCoder-8B-Base 33.4%
- 195 PleIAs/Pleias-1.2b-Preview 33.2%
- 196
DeepSeek-R1-Distill-Qwen-14B 32.4%
- 197 ibm-granite/granite-4.0-h-tiny 31.6%
- 198 OpenLLM-France/Lucie-7B 31.3%
- 199 ibm-granite/granite-3b-code-base-2k 31.1%
- 200 GLM-4.5-Air no-thinking 30.2%
- 201 LFM2.5-1.2B-Instruct 30.1%
- 202 timpal0l/Mistral-7B-v0.1-flashback-v2 29.7%
- 203 speakleash/Bielik-11B-v2.6-Instruct 29.1%
- 204 google/gemma-7b-it 28.8%
- 205 tencent/Hunyuan-1.8B-Instruct 28.4%
- 206 jhu-clsp/mmBERT-small 27.4%
- 207 infly/OpenCoder-1.5B-Instruct 26.6%
- 208
Llama 3.2 1B 26.4%
- 209 deepseek-ai/DeepSeek-R1-Distill-Llama-8B 26.2%
- 210
AFM-4.5B 25.7%
- 211 LFM2.5-1.2B-Thinking 25%
- 212 ibm-granite/granite-3b-code-instruct-2k 23.9%
- 213 LiquidAI/LFM2.5-1.2B-Base 23.5%
- 214 HPLT/hplt2c_deu_checkpoints 23.4%
- 215 intfloat/multilingual-e5-base 22.4%
- 216 LiquidAI/LFM2-700M 21.9%
- 217 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct 21.4%
- 218 deepcogito/cogito-v1-preview-llama-3B 21.2%
- 219
Qwen1.5-14B 20.9%
- 220 utter-project/EuroVLM-1.7B-Preview 20.8%
- 221 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base 20.6%
- 222
SmolLM2-360M 20.2%
- 223
Gemma 3 270M 20.2%
- 224 BSC-LT/salamandra-7b-instruct 20.1%
- 225 LiquidAI/LFM2-350M 19.7%
- 226 LFM2-1.2B 18.9%
- 227
DeepSeek-R1-Distill-Qwen-1.5B 18.6%
- 228
Phi-2 17.8%
- 229 PleIAs/Pleias-350m-Preview 17.8%
- 230
OLMo 2 32B Instruct 17.7%
- 231 facebook/MobileLLM-R1-360M-base 16.8%
- 232 HPLT/hplt2c_eng_checkpoints 16.8%
- 233 baidu/ERNIE-4.5-0.3B-PT 15.9%
- 234 arcee-ai/Trinity-Mini-Base 14.9%
- 235 EuroBERT/EuroBERT-210m 14%
- 236 answerdotai/ModernBERT-large 14%
- 237 GLM-4.1V-9B-Thinking 13.7%
- 238 Qwen/Qwen2.5-Math-1.5B 13.5%
- 239 AI-Sweden-Models/bert-large-nordic-pile-1M-steps 12.5%
- 240
Phi-4-mini-reasoning 12.3%
- 241 PleIAs/Pleias-Pico 12.1%
- 242 answerdotai/ModernBERT-base 12%
- 243 meta-llama/Llama-3.2-1B-Instruct 11.5%
- 244 HuggingFaceTB/SmolLM2-360M-Instruct 10.8%
- 245 infly/OpenCoder-1.5B-Base 9.52%
- 246 HPLT/hplt2c_nld_checkpoints 8.85%
- 247 facebook/MobileLLM-R1-140M-base 6.77%
- 248 PleIAs/Baguettotron@refs/pr/6 no-thinking 6.55%
- 249
Nemotron 3 Nano 4B 6.53%
- 250 EuropeanParliament/EUBERT 5.87%
- 251
SmolLM2-135M 4.89%
- 252 HuggingFaceTB/SmolLM2-135M-Instruct 4.80%
- 253 AI-Sweden-Models/gpt-sw3-356m-instruct 4.55%
- 254 AI-Sweden-Models/gpt-sw3-126m-instruct 4.21%
- 255 AI-Sweden-Models/gpt-sw3-356m 4.20%
- 256 Shekswess/trlm-135m 3.96%
- 257 DiscoResearch/DiscoLM-70b 3.92%
- 258 alea-institute/kl3m-003-3.7b 3.57%
- 259 PleIAs/Monad 3.42%
- 260 microsoft/mdeberta-v3-base 3.29%
- 261 facebook/MobileLLM-R1-950M 2.69%
- 262 AI-Sweden-Models/gpt-sw3-126m 2.21%
- 263 distilbert/distilbert-base-multilingual-cased 0.77%
- 264 Geotrend/distilbert-base-25lang-cased 0.72%
- 265 facebook/MobileLLM-R1-360M 0.16%
- 266 facebook/MobileLLM-R1-140M 0.02%
- 267 fresh-electra-small 0%
- 268 fresh-xlm-roberta-base 0%
- 269 openai-community/gpt2 0%
- 270 openai-community/gpt2-large 0%
- 271 openai-community/gpt2-medium 0%
Source: EuroEval’s leaderboard
- 70.0
Gemma 2 27B
- 69.4
Llama 3.1-405B
- 69.2
Llama 2-70B
- 68.4
Gemma 3 12B PT
- 68.4
Gemma 3n E4B
- 68.2
Yi-1.5-34B
- 68.1
Llama 3.1-70B
- 68.0
Gemma 3 27B PT
- 67.6
Apertus 70B
- 66.5
Llama 3.1-8B
- 65.8
Llama 3-8B
- 65.4
Mistral Small 3.1
- 65.2
Gemma 2 9B
- 64.8
Mistral Small 3.2
- 64.8
Nemotron 3 Nano 30B-A3B
- 64.6
Falcon3-10B-Instruct
- 64.3
Gemma 7B
- 64.0
Gemma 3 4B PT
- 63.2
Qwen3-32B
- 63.2
Command R7B
- 62.7
Falcon3-7B-Instruct
- 62.4
Mistral 7B v0.3
- 62.4 Granite-3.0-8B-Instruct
- 61.9 Granite-3.0-8B-Base
- 61.5
Qwen3-14B
- 61.3
Voxtral Small
- 60.9
Mistral 7B v0.1
- 60.7
Olmo 3.1 32B Instruct
- 58.9
Ministral 3 3B Reasoning
- 58.9
Phi-4-reasoning
- 58.5
Apertus 8B Instruct
- 58.0
Qwen1.5-14B-Chat
- 57.7
Starling-LM-7B-beta
- 57.6
Mistral-7B-Instruct-v0.1
- 57.3
Llama-3.1-Tulu-3-8B
- 57.3
Qwen3-30B-A3B
- 56.6
Gemma 2 2B IT
- 56.2
Cogito v1 Preview 70B
- 55.8
Aya Expanse 32B
- 55.5
Qwen3-235B-A22B
- 55.4
Qwen3-8B
- 55.4 qwen3-4b-instruct-2507
- 55.3 Granite 4.0 H Small
- 54.9
Qwen3-Next-80B-A3B-Instruct
- 54.8
Gemma 3 12B
- 54.3 granite-4.0-micro
- 54.0
Gemma 3n E2B
- 53.8 Reka Flash 3
- 53.6 deepseek-r1-0528-qwen3-8b
- 53.5
Qwen3-1.7B
- 53.5
Gemma 3 27B
- 53.4
Qwen3-4B
- 53.4
Qwen3-4B-Thinking-2507
- 51.5
Llama 4 Scout
- 50.8 nvidia-nemotron-nano-9b-v2
- 50.7
Falcon3-3B-Instruct
- 49.6 gpt-oss-20b
- 48.5
DeepSeek-R1-Distill-Llama-70B
- 47.9
Mistral-7B-Instruct-v0.2
- 47.6
Qwen3-Next-80B-A3B
- 47.4
DeepSeek-R1-Distill-Qwen-32B
- 45.9
QwQ-32B
- 44.7 Reka Flash 3.1
- 43.3
SmolLM2 1.7B Instruct
- 43.2
Gemma 3 1B PT
- 41.1
Gemma 3 4B
- 40.5
Qwen3-0.6B
- 39.0
SmolLM2-1.7B
- 38.5
Phi-4
- 36.8
Gemma 3 1B
- 36.2
DeepSeek-R1-Distill-Qwen-7B
- 32.4
DeepSeek-R1-Distill-Qwen-14B
- 30.2 GLM-4.5-Air
- 30.1 LFM2.5-1.2B-Instruct
- 26.4
Llama 3.2 1B
- 25.7
AFM-4.5B
- 25.0 LFM2.5-1.2B-Thinking
- 20.9
Qwen1.5-14B
- 20.2
SmolLM2-360M
- 20.2
Gemma 3 270M
- 18.9 LFM2-1.2B
- 18.6
DeepSeek-R1-Distill-Qwen-1.5B
- 17.8
Phi-2
- 17.7
OLMo 2 32B Instruct
- 13.7 GLM-4.1V-9B-Thinking
- 12.3
Phi-4-mini-reasoning
- 6.53
Nemotron 3 Nano 4B
- 4.89
SmolLM2-135M
- 1
Gemma 2 27B 70%
- 2
Llama 3.1-405B 69.4%
- 3
Llama 2-70B 69.2%
- 4
Gemma 3 12B PT 68.4%
- 5
Gemma 3n E4B 68.4%
- 6
Yi-1.5-34B 68.2%
- 7
Llama 3.1-70B 68.1%
- 8
Gemma 3 27B PT 68%
- 9
Apertus 70B 67.6%
- 10
Llama 3.1-8B 66.5%
- 11
Llama 3-8B 65.8%
- 12
Mistral Small 3.1 65.4%
- 13
Gemma 2 9B 65.2%
- 14
Mistral Small 3.2 64.8%
- 15
Nemotron 3 Nano 30B-A3B no-thinking 64.8%
- 16
Falcon3-10B-Instruct 64.6%
- 17
Gemma 7B 64.3%
- 18
Gemma 3 4B PT 64%
- 19
Qwen3-32B no-thinking 63.2%
- 20
Command R7B 63.2%
- 21
Falcon3-7B-Instruct 62.7%
- 22
Mistral 7B v0.3 62.4%
- 23 Granite-3.0-8B-Instruct 62.4%
- 24 Granite-3.0-8B-Base 61.9%
- 25
Qwen3-14B no-thinking 61.5%
- 26
Voxtral Small 61.3%
- 27
Mistral 7B v0.1 60.9%
- 28
Olmo 3.1 32B Instruct 60.7%
- 29
Ministral 3 3B Reasoning 58.9%
- 30
Phi-4-reasoning 58.9%
- 31
Apertus 8B Instruct 58.5%
- 32
Qwen1.5-14B-Chat 58%
- 33
Starling-LM-7B-beta 57.7%
- 34
Mistral-7B-Instruct-v0.1 57.6%
- 35
Llama-3.1-Tulu-3-8B 57.3%
- 36
Qwen3-30B-A3B no-thinking 57.3%
- 37
Gemma 2 2B IT 56.6%
- 38
Cogito v1 Preview 70B 56.2%
- 39
Aya Expanse 32B 55.8%
- 40
Qwen3-235B-A22B 55.5%
- 41
Qwen3-8B no-thinking 55.4%
- 42 qwen3-4b-instruct-2507 55.4%
- 43 Granite 4.0 H Small 55.3%
- 44
Qwen3-Next-80B-A3B-Instruct 54.9%
- 45
Gemma 3 12B 54.8%
- 46 granite-4.0-micro 54.3%
- 47
Gemma 3n E2B 54%
- 48 Reka Flash 3 53.8%
- 49 deepseek-r1-0528-qwen3-8b 53.6%
- 50
Qwen3-1.7B 53.5%
- 51
Gemma 3 27B 53.5%
- 52
Qwen3-4B no-thinking 53.4%
- 53
Qwen3-4B-Thinking-2507 53.4%
- 54
Llama 4 Scout 51.5%
- 55 nvidia-nemotron-nano-9b-v2 50.8%
- 56
Falcon3-3B-Instruct 50.7%
- 57 gpt-oss-20b medium 49.6%
- 58
DeepSeek-R1-Distill-Llama-70B 48.5%
- 59
Mistral-7B-Instruct-v0.2 47.9%
- 60
Qwen3-Next-80B-A3B thinking 47.6%
- 61
DeepSeek-R1-Distill-Qwen-32B 47.4%
- 62
QwQ-32B 45.9%
- 63 Reka Flash 3.1 44.7%
- 64
SmolLM2 1.7B Instruct 43.3%
- 65
Gemma 3 1B PT 43.2%
- 66
Gemma 3 4B 41.1%
- 67
Qwen3-0.6B no-thinking 40.5%
- 68
SmolLM2-1.7B 39%
- 69
Phi-4 38.5%
- 70
Gemma 3 1B 36.8%
- 71
DeepSeek-R1-Distill-Qwen-7B 36.2%
- 72
DeepSeek-R1-Distill-Qwen-14B 32.4%
- 73 GLM-4.5-Air no-thinking 30.2%
- 74 LFM2.5-1.2B-Instruct 30.1%
- 75
Llama 3.2 1B 26.4%
- 76
AFM-4.5B 25.7%
- 77 LFM2.5-1.2B-Thinking 25%
- 78
Qwen1.5-14B 20.9%
- 79
SmolLM2-360M 20.2%
- 80
Gemma 3 270M 20.2%
- 81 LFM2-1.2B 18.9%
- 82
DeepSeek-R1-Distill-Qwen-1.5B 18.6%
- 83
Phi-2 17.8%
- 84
OLMo 2 32B Instruct 17.7%
- 85 GLM-4.1V-9B-Thinking 13.7%
- 86
Phi-4-mini-reasoning 12.3%
- 87
Nemotron 3 Nano 4B 6.53%
- 88
SmolLM2-135M 4.89%
Source: EuroEval’s leaderboard
| # | Entry | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | allenai/Olmo-3-1125-32B open weights | 72.4% ±0.9 | hf.co | Official leaderboard | ||
| 2 | | 70% ±1.6 | Jun 2024 | hf.co | Official leaderboard | |
| 3 | | 69.4% ±1.4 | Jul 2024 | hf.co | Official leaderboard | |
| 4 | | 69.2% ±1.3 | Jul 2023 | hf.co | Official leaderboard | |
| 5 | mistralai/Mistral-Small-3.1-24B-Base-2503 open weights | 69% ±1.7 | hf.co | Official leaderboard | ||
| 6 | allenai/OLMo-2-0325-32B open weights | 68.4% ±0.5 | hf.co | Official leaderboard | ||
| 7 | | 68.4% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 8 | | 68.4% ±1.4 | Jun 2025 | hf.co | Official leaderboard | |
| 9 | allenai/OLMo-2-1124-13B open weights | 68.3% ±0.4 | hf.co | Official leaderboard | ||
| 10 | | 68.2% ±1.3 | May 2024 | hf.co | Official leaderboard | |
| 11 | | 68.1% ±1.8 | Jul 2024 | hf.co | Official leaderboard | |
| 12 | utter-project/EuroLLM-22B-Preview open weights | 68.1% ±1.1 | hf.co | Official leaderboard | ||
| 13 | allenai/Olmo-3-1025-7B open weights | 68% ±0.4 | hf.co | Official leaderboard | ||
| 14 | upstage/SOLAR-10.7B-v1.0 open weights | 68% ±1 | hf.co | Official leaderboard | ||
| 15 | | 68% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 16 | utter-project/EuroLLM-22B-2512 open weights | 68% ±1.1 | hf.co | Official leaderboard | ||
| 17 | | 67.6% ±1.4 | Sep 2025 | hf.co | Official leaderboard | |
| 18 | speakleash/Bielik-11B-v3-Base-20250730 open weights | 67.5% ±0.9 | hf.co | Official leaderboard | ||
| 19 | mistralai/Ministral-3-3B-Base-2512 open weights | 67% ±1.7 | hf.co | Official leaderboard | ||
| 20 | 01-ai/Yi-1.5-9B open weights | 66.8% ±0.7 | hf.co | Official leaderboard | ||
| 21 | allenai/OLMo-2-1124-7B open weights | 66.8% ±0.5 | hf.co | Official leaderboard | ||
| 22 | tiiuae/Falcon3-10B-Base open weights | 66.8% ±1.4 | hf.co | Official leaderboard | ||
| 23 | | 66.5% ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 24 | speakleash/Bielik-11B-v2.3-Instruct open weights | 66.3% ±0.8 | hf.co | Official leaderboard | ||
| 25 | | 65.8% ±0.8 | Apr 2024 | hf.co | Official leaderboard | |
| 26 | swiss-ai/Apertus-8B-2509 open weights | 65.6% ±1.4 | hf.co | Official leaderboard | ||
| 27 | ibm-granite/granite-34b-code-base open weights | 65.5% ±0.7 | hf.co | Official leaderboard | ||
| 28 | mistralai/Magistral-Small-2509 open weights | 65.5% ±1.6 | hf.co | Official leaderboard | ||
| 29 | | 65.4% ±1.3 | Mar 2025 | hf.co | Official leaderboard | |
| 30 | mistralai/Ministral-3-8B-Reasoning-2512 open weights | 65.2% ±1.9 | hf.co | Official leaderboard | ||
| 31 | | 65.2% ±2 | Jun 2024 | hf.co | Official leaderboard | |
| 32 | allenai/Olmo-3.1-32B-Instruct-SFT open weights | 64.9% ±1.4 | hf.co | Official leaderboard | ||
| 33 | | 64.8% ±1.6 | Jun 2025 | hf.co | Official leaderboard | |
| 34 | | 64.8% ±0.8 | no-thinking | Dec 2025 | hf.co | Official leaderboard |
| 35 | | 64.6% ±1.3 | Dec 2024 | hf.co | Official leaderboard | |
| 36 | ai21labs/Jamba-v0.1 open weights | 64.6% ±1.4 | hf.co | Official leaderboard | ||
| 37 | TildeAI/TildeOpen-30b open weights | 64.5% ±1.6 | slow-tokenizer | hf.co | Official leaderboard | |
| 38 | bullerwins/Magistral-Small-2506-fp8 open weights | 64.5% ±1.6 | hf.co | Official leaderboard | ||
| 39 | CohereForAI/aya-23-35B open weights | 64.4% ±1.1 | hf.co | Official leaderboard | ||
| 40 | | 64.3% ±1.5 | Feb 2024 | hf.co | Official leaderboard | |
| 41 | BSC-LT/ALIA-40b open weights | 64.2% ±1.7 | hf.co | Official leaderboard | ||
| 42 | | 64% ±1.4 | Mar 2025 | hf.co | Official leaderboard | |
| 43 | syvai/llama3-da-base closed weights | 64% ±1.1 | Official leaderboard | |||
| 44 | mistralai/Voxtral-Mini-3B-2507 open weights | 63.9% ±1.9 | hf.co | Official leaderboard | ||
| 45 | meta-llama/Llama-2-13b-hf open weights | 63.8% ±0.9 | hf.co | Official leaderboard | ||
| 46 | utter-project/EuroLLM-9B open weights | 63.7% ±1.1 | hf.co | Official leaderboard | ||
| 47 | allenai/Llama-3.1-Tulu-3-8B-SFT open weights | 63.5% ±1.1 | hf.co | Official leaderboard | ||
| 48 | | 63.2% ±0.8 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 49 | | 63.2% ±0.9 | Dec 2024 | hf.co | Official leaderboard | |
| 50 | allenai/Olmo-3.1-32B-Instruct-DPO open weights | 63% ±0.6 | hf.co | Official leaderboard | ||
| 51 | | 62.7% ±0.6 | Dec 2024 | hf.co | Official leaderboard | |
| 52 | | 62.4% ±1 | Sep 2023 | hf.co | Official leaderboard | |
| 53 | Granite-3.0-8B-Instruct | 62.4% ±1 | Oct 2024 | hf.co | Official leaderboard | |
| 54 | allenai/Llama-3.1-Tulu-3-8B-DPO open weights | 62% ±1.1 | hf.co | Official leaderboard | ||
| 55 | Granite-3.0-8B-Base | 61.9% ±1.2 | Oct 2024 | hf.co | Official leaderboard | |
| 56 | HuggingFaceTB/SmolLM3-3B-Base open weights | 61.5% ±1.3 | hf.co | Official leaderboard | ||
| 57 | | 61.5% ±1 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 58 | | 61.3% ±1.6 | Jul 2025 | hf.co | Official leaderboard | |
| 59 | mii-llm/nesso-4B open weights | 61.2% ±1.4 | hf.co | Official leaderboard | ||
| 60 | deepcogito/cogito-v1-preview-qwen-32B open weights | 61.1% ±0.6 | hf.co | Official leaderboard | ||
| 61 | ibm-granite/granite-20b-code-base open weights | 60.9% ±0.4 | hf.co | Official leaderboard | ||
| 62 | | 60.9% ±1.1 | Sep 2023 | hf.co | Official leaderboard | |
| 63 | | 60.7% ±0.9 | Dec 2025 | hf.co | Official leaderboard | |
| 64 | senseable/WestLake-7B-v2 open weights | 60.6% ±1.6 | hf.co | Official leaderboard | ||
| 65 | NovaSky-AI/Sky-T1-32B-Preview open weights | 60.4% ±0.8 | hf.co | Official leaderboard | ||
| 66 | occiglot/occiglot-7b-eu5 open weights | 60.1% ±3 | hf.co | Official leaderboard | ||
| 67 | tiiuae/Falcon3-7B-Base open weights | 60.1% ±1.2 | hf.co | Official leaderboard | ||
| 68 | NousResearch/DeepHermes-3-Llama-3-8B-Preview open weights | 59.8% ±1.4 | hf.co | Official leaderboard | ||
| 69 | ibm-granite/granite-34b-code-instruct open weights | 59.5% ±0.6 | hf.co | Official leaderboard | ||
| 70 | LumiOpen/Llama-Poro-2-70B-SFT open weights | 59.4% ±1.6 | hf.co | Official leaderboard | ||
| 71 | baidu/ERNIE-4.5-21B-A3B-PT open weights | 59.2% ±0.6 | hf.co | Official leaderboard | ||
| 72 | mistralai/Mistral-Small-24B-Instruct-2501 open weights | 59% ±0.7 | hf.co | Official leaderboard | ||
| 73 | | 58.9% ±0.8 | Dec 2025 | hf.co | Official leaderboard | |
| 74 | | 58.9% ±1.6 | Apr 2025 | hf.co | Official leaderboard | |
| 75 | norallm/normistral-11b-warm open weights | 58.6% ±0.9 | hf.co | Official leaderboard | ||
| 76 | | 58.5% ±1 | Sep 2025 | hf.co | Official leaderboard | |
| 77 | MaLA-LM/emma-500-llama2-7b open weights | 58.3% ±0.7 | hf.co | Official leaderboard | ||
| 78 | utter-project/EuroLLM-9B-Instruct open weights | 58.2% ±1.7 | hf.co | Official leaderboard | ||
| 79 | kyutai/helium-1-2b open weights | 58.1% ±1 | hf.co | Official leaderboard | ||
| 80 | | 58% ±0.9 | Feb 2024 | hf.co | Official leaderboard | |
| 81 | | 57.7% ±1.6 | Mar 2024 | hf.co | Official leaderboard | |
| 82 | allenai/OLMo-2-1124-7B-Instruct open weights | 57.6% ±0.6 | hf.co | Official leaderboard | ||
| 83 | utter-project/EuroLLM-22B-Instruct-Preview open weights | 57.6% ±0.9 | hf.co | Official leaderboard | ||
| 84 | | 57.6% ±1.5 | Sep 2023 | hf.co | Official leaderboard | |
| 85 | meta-llama/Llama-3.1-405B-Instruct-FP8 open weights | 57.5% ±0.8 | hf.co | Official leaderboard | ||
| 86 | TrustLLMeu/baseline-7-8b_2-3t-tokens_llama open weights | 57.5% ±1 | hf.co | Official leaderboard | ||
| 87 | | 57.3% ±1.3 | Nov 2024 | hf.co | Official leaderboard | |
| 88 | | 57.3% ±0.6 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 89 | arcee-ai/AFM-4.5B-Base open weights | 57.2% ±0.8 | hf.co | Official leaderboard | ||
| 90 | ibm-granite/granite-8b-code-base-4k open weights | 57.1% ±0.6 | hf.co | Official leaderboard | ||
| 91 | google/gemma-2-9b-it open weights | 57.1% ±0.9 | hf.co | Official leaderboard | ||
| 92 | | 56.6% ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 93 | ibm-granite/granite-3.0-3b-a800m-instruct open weights | 56.6% ±0.7 | hf.co | Official leaderboard | ||
| 94 | | 56.2% ±0.7 | Apr 2025 | hf.co | Official leaderboard | |
| 95 | HuggingFaceTB/SmolLM3-3B open weights | 56.1% ±1 | hf.co | Official leaderboard | ||
| 96 | | 55.8% ±0.7 | Oct 2024 | hf.co | Official leaderboard | |
| 97 | google/gemma-2-27b-it open weights | 55.7% ±0.7 | hf.co | Official leaderboard | ||
| 98 | deepcogito/cogito-v1-preview-qwen-14B open weights | 55.6% ±0.7 | hf.co | Official leaderboard | ||
| 99 | | 55.5% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 100 | LumiOpen/Llama-Poro-2-70B-Instruct open weights | 55.5% ±1.2 | hf.co | Official leaderboard | ||
| 101 | 152334H/miqu-1-70b-sf open weights | 55.4% ±0.7 | hf.co | Official leaderboard | ||
| 102 | | 55.4% ±0.8 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 103 | qwen3-4b-instruct-2507 | 55.4% ±0.6 | Aug 2025 | hf.co | Official leaderboard | |
| 104 | Granite 4.0 H Small | 55.3% ±1.1 | Oct 2025 | hf.co | Official leaderboard | |
| 105 | Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 closed weights | 55.1% ±0.8 | hf.co | Official leaderboard | ||
| 106 | deepcogito/cogito-v2-preview-llama-70B open weights | 55% ±0.6 | hf.co | Official leaderboard | ||
| 107 | ThatsGroes/gemma-2-27b-it-FP8-Dynamic open weights | 54.9% ±0.6 | hf.co | Official leaderboard | ||
| 108 | | 54.9% ±0.5 | Sep 2025 | hf.co | Official leaderboard | |
| 109 | | 54.8% ±0.6 | Mar 2025 | hf.co | Official leaderboard | |
| 110 | allenai/Llama-3.1-Tulu-3.1-8B open weights | 54.7% ±1 | hf.co | Official leaderboard | ||
| 111 | ibm-granite/granite-4.0-h-micro open weights | 54.5% ±0.9 | hf.co | Official leaderboard | ||
| 112 | TrustLLMeu/baseline-7-8b_1t-tokens_llama open weights | 54.4% ±0.9 | hf.co | Official leaderboard | ||
| 113 | granite-4.0-micro | 54.3% ±1 | Oct 2025 | hf.co | Official leaderboard | |
| 114 | | 54% ±0.9 | Jun 2025 | hf.co | Official leaderboard | |
| 115 | seedboxai/KafkaLM-70B-German-V0.1 open weights | 54% ±1.4 | hf.co | Official leaderboard | ||
| 116 | ibm-granite/granite-8b-code-instruct-4k open weights | 53.9% ±0.6 | hf.co | Official leaderboard | ||
| 117 | Reka Flash 3 | 53.8% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 118 | Qwen/Qwen3-235B-A22B-Thinking-2507-FP8 closed weights | 53.8% ±0.2 | hf.co | Official leaderboard | ||
| 119 | deepseek-r1-0528-qwen3-8b | 53.6% ±0.5 | May 2025 | hf.co | Official leaderboard | |
| 120 | allenai/OLMo-2-1124-13B-Instruct open weights | 53.6% ±0.8 | hf.co | Official leaderboard | ||
| 121 | | 53.5% ±1 | Apr 2025 | hf.co | Official leaderboard | |
| 122 | | 53.5% ±0.4 | Mar 2025 | hf.co | Official leaderboard | |
| 123 | | 53.4% ±0.9 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 124 | | 53.4% ±0.5 | Aug 2025 | hf.co | Official leaderboard | |
| 125 | google/gemma-2-2b open weights | 53.3% ±1.4 | hf.co | Official leaderboard | ||
| 126 | infly/OpenCoder-8B-Instruct open weights | 53.1% ±0.5 | hf.co | Official leaderboard | ||
| 127 | ollama_chat/gemma3:27b-it-fp16 open weights | 53% ±0.7 | ollama.com | Official leaderboard | ||
| 128 | common-pile/comma-v0.1-2t open weights | 53% ±1.2 | hf.co | Official leaderboard | ||
| 129 | Qwen/Qwen2.5-1.5B-Instruct open weights | 52.7% ±1.1 | hf.co | Official leaderboard | ||
| 130 | meta-llama/Llama-3.1-8B-Instruct open weights | 52.4% ±0.8 | hf.co | Official leaderboard | ||
| 131 | ibm-granite/granite-20b-code-instruct open weights | 52.3% ±0.5 | hf.co | Official leaderboard | ||
| 132 | meta-llama/Llama-2-13b-chat-hf open weights | 51.8% ±0.6 | hf.co | Official leaderboard | ||
| 133 | meta-llama/Llama-2-70b-chat-hf open weights | 51.5% ±0.5 | hf.co | Official leaderboard | ||
| 134 | | 51.5% ±0.5 | Apr 2025 | hf.co | Official leaderboard | |
| 135 | LumiOpen/Viking-33B open weights | 50.8% ±0.9 | hf.co | Official leaderboard | ||
| 136 | nvidia-nemotron-nano-9b-v2 | 50.8% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 137 | | 50.7% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 138 | LiquidAI/LFM2-2.6B open weights | 50.3% ±0.5 | hf.co | Official leaderboard | ||
| 139 | TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49 open weights | 50% ±1.5 | hf.co | Official leaderboard | ||
| 140 | ibm-granite/granite-3.0-3b-a800m-base open weights | 49.9% ±0.9 | hf.co | Official leaderboard | ||
| 141 | FacebookAI/xlm-roberta-large open weights | 49.8% ±0.7 | hf.co | Official leaderboard | ||
| 142 | gpt-oss-20b | 49.6% ±0.3 | medium | Aug 2025 | hf.co | Official leaderboard |
| 143 | ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf open weights | 49% ±1 | ollama.com | Official leaderboard | ||
| 144 | speakleash/Bielik-4.5B-v3.0-Instruct open weights | 48.6% ±1.1 | hf.co | Official leaderboard | ||
| 145 | allenai/Olmo-3-7B-Instruct open weights | 48.6% ±0.7 | hf.co | Official leaderboard | ||
| 146 | allenai/Olmo-3-7B-Think open weights | 48.6% ±0.5 | hf.co | Official leaderboard | ||
| 147 | | 48.5% ±0.5 | Jan 2025 | hf.co | Official leaderboard | |
| 148 | BSC-LT/salamandra-7b open weights | 48.3% ±1.5 | hf.co | Official leaderboard | ||
| 149 | allenai/Olmo-3-7B-Instruct-SFT open weights | 48.2% ±1.2 | hf.co | Official leaderboard | ||
| 150 | openGPT-X/Teuken-7B-instruct-commercial-v0.4 open weights | 48.2% ±0.9 | hf.co | Official leaderboard | ||
| 151 | | 47.9% ±1 | Dec 2023 | hf.co | Official leaderboard | |
| 152 | intfloat/multilingual-e5-large open weights | 47.7% ±0.9 | hf.co | Official leaderboard | ||
| 153 | | 47.6% ±0.3 | thinking | Sep 2025 | hf.co | Official leaderboard |
| 154 | | 47.4% ±0.7 | Jan 2025 | hf.co | Official leaderboard | |
| 155 | utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview open weights | 46.8% ±0.6 | hf.co | Official leaderboard | ||
| 156 | deepcogito/cogito-v1-preview-llama-8B open weights | 46.5% ±2.5 | hf.co | Official leaderboard | ||
| 157 | arcee-ai/Trinity-Nano-Preview open weights | 46.5% ±2.4 | hf.co | Official leaderboard | ||
| 158 | allenai/Olmo-3-7B-Instruct-DPO open weights | 45.9% ±1 | hf.co | Official leaderboard | ||
| 159 | | 45.9% ±4.7 | Mar 2025 | hf.co | Official leaderboard | |
| 160 | ollama_chat/gemma3:4b-it-q4_K_M open weights | 45.8% ±0.8 | ollama.com | Official leaderboard | ||
| 161 | meta-llama/Llama-2-7b-chat-hf open weights | 45.4% ±0.7 | hf.co | Official leaderboard | ||
| 162 | arcee-ai/Trinity-Nano-Base open weights | 45.3% ±1.7 | hf.co | Official leaderboard | ||
| 163 | meta-llama/Llama-3.2-3B-Instruct open weights | 45.3% ±0.9 | hf.co | Official leaderboard | ||
| 164 | speakleash/Bielik-1.5B-v3.0-Instruct open weights | 45.2% ±1.5 | hf.co | Official leaderboard | ||
| 165 | common-pile/comma-v0.1-1t open weights | 44.8% ±1.3 | hf.co | Official leaderboard | ||
| 166 | Reka Flash 3.1 | 44.7% ±0.6 | May 2025 | hf.co | Official leaderboard | |
| 167 | Qwen/Qwen2.5-Math-7B open weights | 44% ±2.9 | hf.co | Official leaderboard | ||
| 168 | jhu-clsp/mmBERT-base open weights | 43.9% ±0.7 | hf.co | Official leaderboard | ||
| 169 | TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f open weights | 43.4% ±0.2 | zero-shot | hf.co | Official leaderboard | |
| 170 | TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 open weights | 43.4% ±1.8 | hf.co | Official leaderboard | ||
| 171 | | 43.3% ±0.8 | Oct 2024 | hf.co | Official leaderboard | |
| 172 | | 43.2% ±0.6 | Mar 2025 | hf.co | Official leaderboard | |
| 173 | seedboxai/KafkaLM-13B-German-V0.1 open weights | 43.1% ±1.8 | hf.co | Official leaderboard | ||
| 174 | occiglot/occiglot-7b-eu5-instruct open weights | 43% ±1.1 | hf.co | Official leaderboard | ||
| 175 | facebook/MobileLLM-R1-950M-base open weights | 42.7% ±0.9 | hf.co | Official leaderboard | ||
| 176 | tiiuae/Falcon3-3B-Base open weights | 42.3% ±1.3 | hf.co | Official leaderboard | ||
| 177 | TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894 open weights | 41.8% ±2.6 | hf.co | Official leaderboard | ||
| 178 | utter-project/EuroMoE-2.6B-A0.6B-Preview open weights | 41.4% ±0.8 | hf.co | Official leaderboard | ||
| 179 | TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 open weights | 41.3% ±0.9 | hf.co | Official leaderboard | ||
| 180 | yulan-team/YuLan-Mini-Instruct open weights | 41.2% ±0.9 | hf.co | Official leaderboard | ||
| 181 | | 41.1% ±2.3 | Mar 2025 | hf.co | Official leaderboard | |
| 182 | EuroBERT/EuroBERT-610m open weights | 40.6% ±1.1 | hf.co | Official leaderboard | ||
| 183 | | 40.5% ±0.6 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 184 | | 39% ±1.5 | Oct 2024 | hf.co | Official leaderboard | |
| 185 | | 38.5% ±1.6 | Dec 2024 | hf.co | Official leaderboard | |
| 186 | utter-project/EuroLLM-22B-Instruct-2512 open weights | 36.9% ±0.9 | hf.co | Official leaderboard | ||
| 187 | | 36.8% ±0.4 | Mar 2025 | ollama.com | Official leaderboard | |
| 188 | | 36.2% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 189 | meta-llama/Llama-4-Scout-17B-16E open weights | 36.2% ±1.9 | hf.co | Official leaderboard | ||
| 190 | PleIAs/Pleias-3b-Preview open weights | 36% ±1.4 | hf.co | Official leaderboard | ||
| 191 | tencent/Hunyuan-7B-Instruct open weights | 35.4% ±0.4 | hf.co | Official leaderboard | ||
| 192 | tiiuae/falcon-11B open weights | 35.2% ±1.8 | hf.co | Official leaderboard | ||
| 193 | AI-Sweden-Models/ModernBERT-large open weights | 33.6% ±1.1 | hf.co | Official leaderboard | ||
| 194 | infly/OpenCoder-8B-Base open weights | 33.4% ±0.8 | hf.co | Official leaderboard | ||
| 195 | PleIAs/Pleias-1.2b-Preview open weights | 33.2% ±1.2 | hf.co | Official leaderboard | ||
| 196 | | 32.4% ±1.2 | Jan 2025 | hf.co | Official leaderboard | |
| 197 | ibm-granite/granite-4.0-h-tiny open weights | 31.6% ±1.8 | hf.co | Official leaderboard | ||
| 198 | OpenLLM-France/Lucie-7B open weights | 31.3% ±1.1 | hf.co | Official leaderboard | ||
| 199 | ibm-granite/granite-3b-code-base-2k open weights | 31.1% ±1.8 | hf.co | Official leaderboard | ||
| 200 | GLM-4.5-Air | 30.2% ±1.2 | no-thinking | Jul 2025 | hf.co | Official leaderboard |
| 201 | LFM2.5-1.2B-Instruct | 30.1% ±0.5 | Jan 2026 | hf.co | Official leaderboard | |
| 202 | timpal0l/Mistral-7B-v0.1-flashback-v2 open weights | 29.7% ±2.8 | hf.co | Official leaderboard | ||
| 203 | speakleash/Bielik-11B-v2.6-Instruct open weights | 29.1% ±1.4 | hf.co | Official leaderboard | ||
| 204 | google/gemma-7b-it open weights | 28.8% ±0.9 | hf.co | Official leaderboard | ||
| 205 | tencent/Hunyuan-1.8B-Instruct open weights | 28.4% ±0.5 | hf.co | Official leaderboard | ||
| 206 | jhu-clsp/mmBERT-small open weights | 27.4% ±2.2 | hf.co | Official leaderboard | ||
| 207 | infly/OpenCoder-1.5B-Instruct open weights | 26.6% ±0.7 | hf.co | Official leaderboard | ||
| 208 | | 26.4% ±1.7 | Sep 2024 | hf.co | Official leaderboard | |
| 209 | deepseek-ai/DeepSeek-R1-Distill-Llama-8B open weights | 26.2% ±0.3 | hf.co | Official leaderboard | ||
| 210 | | 25.7% ±0.7 | Jul 2025 | hf.co | Official leaderboard | |
| 211 | LFM2.5-1.2B-Thinking | 25% ±0.4 | Jan 2026 | hf.co | Official leaderboard | |
| 212 | ibm-granite/granite-3b-code-instruct-2k open weights | 23.9% ±2.1 | hf.co | Official leaderboard | ||
| 213 | LiquidAI/LFM2.5-1.2B-Base open weights | 23.5% ±0.8 | hf.co | Official leaderboard | ||
| 214 | HPLT/hplt2c_deu_checkpoints open weights | 23.4% ±1.2 | hf.co | Official leaderboard | ||
| 215 | intfloat/multilingual-e5-base open weights | 22.4% ±2.2 | hf.co | Official leaderboard | ||
| 216 | LiquidAI/LFM2-700M open weights | 21.9% ±0.4 | hf.co | Official leaderboard | ||
| 217 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct open weights | 21.4% ±0.6 | hf.co | Official leaderboard | ||
| 218 | deepcogito/cogito-v1-preview-llama-3B open weights | 21.2% ±1.3 | hf.co | Official leaderboard | ||
| 219 | | 20.9% ±0.2 | Feb 2024 | hf.co | Official leaderboard | |
| 220 | utter-project/EuroVLM-1.7B-Preview open weights | 20.8% ±0.8 | hf.co | Official leaderboard | ||
| 221 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base open weights | 20.6% ±0.7 | hf.co | Official leaderboard | ||
| 222 | | 20.2% ±0.5 | Oct 2024 | hf.co | Official leaderboard | |
| 223 | | 20.2% ±0.8 | Aug 2025 | hf.co | Official leaderboard | |
| 224 | BSC-LT/salamandra-7b-instruct open weights | 20.1% ±0.6 | hf.co | Official leaderboard | ||
| 225 | LiquidAI/LFM2-350M open weights | 19.7% ±0.8 | hf.co | Official leaderboard | ||
| 226 | LFM2-1.2B | 18.9% ±0.7 | Jul 2025 | hf.co | Official leaderboard | |
| 227 | | 18.6% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 228 | | 17.8% ±1.4 | Dec 2023 | hf.co | Official leaderboard | |
| 229 | PleIAs/Pleias-350m-Preview open weights | 17.8% ±0.9 | hf.co | Official leaderboard | ||
| 230 | | 17.7% ±0.8 | Mar 2025 | hf.co | Official leaderboard | |
| 231 | facebook/MobileLLM-R1-360M-base open weights | 16.8% ±0.6 | hf.co | Official leaderboard | ||
| 232 | HPLT/hplt2c_eng_checkpoints open weights | 16.8% ±0.8 | hf.co | Official leaderboard | ||
| 233 | baidu/ERNIE-4.5-0.3B-PT open weights | 15.9% ±1.3 | hf.co | Official leaderboard | ||
| 234 | arcee-ai/Trinity-Mini-Base open weights | 14.9% ±1.6 | hf.co | Official leaderboard | ||
| 235 | EuroBERT/EuroBERT-210m open weights | 14% ±2.5 | hf.co | Official leaderboard | ||
| 236 | answerdotai/ModernBERT-large open weights | 14% ±1.2 | hf.co | Official leaderboard | ||
| 237 | GLM-4.1V-9B-Thinking | 13.7% ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 238 | Qwen/Qwen2.5-Math-1.5B open weights | 13.5% ±1.1 | hf.co | Official leaderboard | ||
| 239 | AI-Sweden-Models/bert-large-nordic-pile-1M-steps open weights | 12.5% ±2 | hf.co | Official leaderboard | ||
| 240 | | 12.3% ±0.2 | Apr 2025 | hf.co | Official leaderboard | |
| 241 | PleIAs/Pleias-Pico open weights | 12.1% ±0.8 | hf.co | Official leaderboard | ||
| 242 | answerdotai/ModernBERT-base open weights | 12% ±1 | hf.co | Official leaderboard | ||
| 243 | meta-llama/Llama-3.2-1B-Instruct open weights | 11.5% ±1 | hf.co | Official leaderboard | ||
| 244 | HuggingFaceTB/SmolLM2-360M-Instruct open weights | 10.8% ±0.4 | hf.co | Official leaderboard | ||
| 245 | infly/OpenCoder-1.5B-Base open weights | 9.52% ±0.6 | hf.co | Official leaderboard | ||
| 246 | HPLT/hplt2c_nld_checkpoints open weights | 8.85% ±0.8 | hf.co | Official leaderboard | ||
| 247 | facebook/MobileLLM-R1-140M-base open weights | 6.77% ±0.8 | hf.co | Official leaderboard | ||
| 248 | PleIAs/Baguettotron@refs/pr/6 open weights | 6.55% ±0.3 | no-thinking | hf.co | Official leaderboard | |
| 249 | | 6.53% ±0.9 | Mar 2026 | hf.co | Official leaderboard | |
| 250 | EuropeanParliament/EUBERT open weights | 5.87% ±0.8 | hf.co | Official leaderboard | ||
| 251 | | 4.89% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 252 | HuggingFaceTB/SmolLM2-135M-Instruct open weights | 4.80% ±0.4 | hf.co | Official leaderboard | ||
| 253 | AI-Sweden-Models/gpt-sw3-356m-instruct open weights | 4.55% ±0.3 | hf.co | Official leaderboard | ||
| 254 | AI-Sweden-Models/gpt-sw3-126m-instruct open weights | 4.21% ±0.3 | hf.co | Official leaderboard | ||
| 255 | AI-Sweden-Models/gpt-sw3-356m open weights | 4.20% ±0.4 | hf.co | Official leaderboard | ||
| 256 | Shekswess/trlm-135m open weights | 3.96% ±0.6 | hf.co | Official leaderboard | ||
| 257 | DiscoResearch/DiscoLM-70b open weights | 3.92% ±0.1 | hf.co | Official leaderboard | ||
| 258 | alea-institute/kl3m-003-3.7b open weights | 3.57% ±0.6 | hf.co | Official leaderboard | ||
| 259 | PleIAs/Monad open weights | 3.42% ±0.1 | hf.co | Official leaderboard | ||
| 260 | microsoft/mdeberta-v3-base open weights | 3.29% ±2.2 | hf.co | Official leaderboard | ||
| 261 | facebook/MobileLLM-R1-950M open weights | 2.69% ±0.3 | hf.co | Official leaderboard | ||
| 262 | AI-Sweden-Models/gpt-sw3-126m open weights | 2.21% ±0.4 | hf.co | Official leaderboard | ||
| 263 | distilbert/distilbert-base-multilingual-cased open weights | 0.77% ±0.4 | hf.co | Official leaderboard | ||
| 264 | Geotrend/distilbert-base-25lang-cased open weights | 0.72% ±0.4 | hf.co | Official leaderboard | ||
| 265 | facebook/MobileLLM-R1-360M open weights | 0.16% ±5.9 | hf.co | Official leaderboard | ||
| 266 | facebook/MobileLLM-R1-140M open weights | 0.02% ±0.5 | hf.co | Official leaderboard | ||
| 267 | fresh-electra-small open weights | 0% | Official leaderboard | |||
| 268 | fresh-xlm-roberta-base open weights | 0% | Official leaderboard | |||
| 269 | openai-community/gpt2 open weights | 0% | hf.co | Official leaderboard | ||
| 270 | openai-community/gpt2-large open weights | 0% | hf.co | Official leaderboard | ||
| 271 | openai-community/gpt2-medium open weights | 0% | hf.co | Official leaderboard |
| # | Model | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 70% ±1.6 | Jun 2024 | hf.co | Official leaderboard | |
| 2 | | 69.4% ±1.4 | Jul 2024 | hf.co | Official leaderboard | |
| 3 | | 69.2% ±1.3 | Jul 2023 | hf.co | Official leaderboard | |
| 4 | | 68.4% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 5 | | 68.4% ±1.4 | Jun 2025 | hf.co | Official leaderboard | |
| 6 | | 68.2% ±1.3 | May 2024 | hf.co | Official leaderboard | |
| 7 | | 68.1% ±1.8 | Jul 2024 | hf.co | Official leaderboard | |
| 8 | | 68% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 9 | | 67.6% ±1.4 | Sep 2025 | hf.co | Official leaderboard | |
| 10 | | 66.5% ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 11 | | 65.8% ±0.8 | Apr 2024 | hf.co | Official leaderboard | |
| 12 | | 65.4% ±1.3 | Mar 2025 | hf.co | Official leaderboard | |
| 13 | | 65.2% ±2 | Jun 2024 | hf.co | Official leaderboard | |
| 14 | | 64.8% ±1.6 | Jun 2025 | hf.co | Official leaderboard | |
| 15 | | 64.8% ±0.8 | no-thinking | Dec 2025 | hf.co | Official leaderboard |
| 16 | | 64.6% ±1.3 | Dec 2024 | hf.co | Official leaderboard | |
| 17 | | 64.3% ±1.5 | Feb 2024 | hf.co | Official leaderboard | |
| 18 | | 64% ±1.4 | Mar 2025 | hf.co | Official leaderboard | |
| 19 | | 63.2% ±0.8 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 20 | | 63.2% ±0.9 | Dec 2024 | hf.co | Official leaderboard | |
| 21 | | 62.7% ±0.6 | Dec 2024 | hf.co | Official leaderboard | |
| 22 | | 62.4% ±1 | Sep 2023 | hf.co | Official leaderboard | |
| 23 | Granite-3.0-8B-Instruct | 62.4% ±1 | Oct 2024 | hf.co | Official leaderboard | |
| 24 | Granite-3.0-8B-Base | 61.9% ±1.2 | Oct 2024 | hf.co | Official leaderboard | |
| 25 | | 61.5% ±1 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 26 | | 61.3% ±1.6 | Jul 2025 | hf.co | Official leaderboard | |
| 27 | | 60.9% ±1.1 | Sep 2023 | hf.co | Official leaderboard | |
| 28 | | 60.7% ±0.9 | Dec 2025 | hf.co | Official leaderboard | |
| 29 | | 58.9% ±0.8 | Dec 2025 | hf.co | Official leaderboard | |
| 30 | | 58.9% ±1.6 | Apr 2025 | hf.co | Official leaderboard | |
| 31 | | 58.5% ±1 | Sep 2025 | hf.co | Official leaderboard | |
| 32 | | 58% ±0.9 | Feb 2024 | hf.co | Official leaderboard | |
| 33 | | 57.7% ±1.6 | Mar 2024 | hf.co | Official leaderboard | |
| 34 | | 57.6% ±1.5 | Sep 2023 | hf.co | Official leaderboard | |
| 35 | | 57.3% ±1.3 | Nov 2024 | hf.co | Official leaderboard | |
| 36 | | 57.3% ±0.6 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 37 | | 56.6% ±0.9 | Jul 2024 | hf.co | Official leaderboard | |
| 38 | | 56.2% ±0.7 | Apr 2025 | hf.co | Official leaderboard | |
| 39 | | 55.8% ±0.7 | Oct 2024 | hf.co | Official leaderboard | |
| 40 | | 55.5% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 41 | | 55.4% ±0.8 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 42 | qwen3-4b-instruct-2507 | 55.4% ±0.6 | Aug 2025 | hf.co | Official leaderboard | |
| 43 | Granite 4.0 H Small | 55.3% ±1.1 | Oct 2025 | hf.co | Official leaderboard | |
| 44 | | 54.9% ±0.5 | Sep 2025 | hf.co | Official leaderboard | |
| 45 | | 54.8% ±0.6 | Mar 2025 | hf.co | Official leaderboard | |
| 46 | granite-4.0-micro | 54.3% ±1 | Oct 2025 | hf.co | Official leaderboard | |
| 47 | | 54% ±0.9 | Jun 2025 | hf.co | Official leaderboard | |
| 48 | Reka Flash 3 | 53.8% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 49 | deepseek-r1-0528-qwen3-8b | 53.6% ±0.5 | May 2025 | hf.co | Official leaderboard | |
| 50 | | 53.5% ±1 | Apr 2025 | hf.co | Official leaderboard | |
| 51 | | 53.5% ±0.4 | Mar 2025 | hf.co | Official leaderboard | |
| 52 | | 53.4% ±0.9 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 53 | | 53.4% ±0.5 | Aug 2025 | hf.co | Official leaderboard | |
| 54 | | 51.5% ±0.5 | Apr 2025 | hf.co | Official leaderboard | |
| 55 | nvidia-nemotron-nano-9b-v2 | 50.8% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 56 | | 50.7% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 57 | gpt-oss-20b | 49.6% ±0.3 | medium | Aug 2025 | hf.co | Official leaderboard |
| 58 | | 48.5% ±0.5 | Jan 2025 | hf.co | Official leaderboard | |
| 59 | | 47.9% ±1 | Dec 2023 | hf.co | Official leaderboard | |
| 60 | | 47.6% ±0.3 | thinking | Sep 2025 | hf.co | Official leaderboard |
| 61 | | 47.4% ±0.7 | Jan 2025 | hf.co | Official leaderboard | |
| 62 | | 45.9% ±4.7 | Mar 2025 | hf.co | Official leaderboard | |
| 63 | Reka Flash 3.1 | 44.7% ±0.6 | May 2025 | hf.co | Official leaderboard | |
| 64 | | 43.3% ±0.8 | Oct 2024 | hf.co | Official leaderboard | |
| 65 | | 43.2% ±0.6 | Mar 2025 | hf.co | Official leaderboard | |
| 66 | | 41.1% ±2.3 | Mar 2025 | hf.co | Official leaderboard | |
| 67 | | 40.5% ±0.6 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 68 | | 39% ±1.5 | Oct 2024 | hf.co | Official leaderboard | |
| 69 | | 38.5% ±1.6 | Dec 2024 | hf.co | Official leaderboard | |
| 70 | | 36.8% ±0.4 | Mar 2025 | ollama.com | Official leaderboard | |
| 71 | | 36.2% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 72 | | 32.4% ±1.2 | Jan 2025 | hf.co | Official leaderboard | |
| 73 | GLM-4.5-Air | 30.2% ±1.2 | no-thinking | Jul 2025 | hf.co | Official leaderboard |
| 74 | LFM2.5-1.2B-Instruct | 30.1% ±0.5 | Jan 2026 | hf.co | Official leaderboard | |
| 75 | | 26.4% ±1.7 | Sep 2024 | hf.co | Official leaderboard | |
| 76 | | 25.7% ±0.7 | Jul 2025 | hf.co | Official leaderboard | |
| 77 | LFM2.5-1.2B-Thinking | 25% ±0.4 | Jan 2026 | hf.co | Official leaderboard | |
| 78 | | 20.9% ±0.2 | Feb 2024 | hf.co | Official leaderboard | |
| 79 | | 20.2% ±0.5 | Oct 2024 | hf.co | Official leaderboard | |
| 80 | | 20.2% ±0.8 | Aug 2025 | hf.co | Official leaderboard | |
| 81 | LFM2-1.2B | 18.9% ±0.7 | Jul 2025 | hf.co | Official leaderboard | |
| 82 | | 18.6% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 83 | | 17.8% ±1.4 | Dec 2023 | hf.co | Official leaderboard | |
| 84 | | 17.7% ±0.8 | Mar 2025 | hf.co | Official leaderboard | |
| 85 | GLM-4.1V-9B-Thinking | 13.7% ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 86 | | 12.3% ±0.2 | Apr 2025 | hf.co | Official leaderboard | |
| 87 | | 6.53% ±0.9 | Mar 2026 | hf.co | Official leaderboard | |
| 88 | | 4.89% ±0.3 | Oct 2024 | hf.co | Official leaderboard |
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: EuroEval’s leaderboard
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: EuroEval’s leaderboard
2 models have held number one on EuroEval’s leaderboard since 2023
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: EuroEval’s leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: EuroEval’s leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
9 of 10 checks pass, 1 warning. Look first at the Newest score check. The newest came 8 months ago, in March 2026, for Nemotron 3 Nano 4B. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 1 warning 3 pass 1 note
- Pass Independent runs Scores from the official leaderboard (271 entries).
- Pass Models scored 88 models we track, plus 183 other entries on its leaderboard.
- Warning Newest score The newest came 8 months ago, in March 2026, for Nemotron 3 Nano 4B.
- Note Frontier models None of the top 10 has a score. The strongest tested is Qwen3-235B-A22B (#131).
- Pass Headroom The best is 70%, under 85%, so it still separates models.
Leaderboard import 3 pass
- Pass Importer We read the board on EuroEval: 101 rows for models we track and 183 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.