Dutch Book Reviews Dataset
Models classify the sentiment of Dutch book reviews from Hebban using ratings supplied by readers.
EuroEval scores sentiment labels with the Matthews correlation coefficient.
- Made by
- Benjamin van der Burgh and Suzan Verberne
- Released
- October 2019
- Kind
- Reading in many languages
- Level
- Everyday
- Scored
- Checked automatically
- Answers
- Multiple choice
- Tasks
- All public
- Measures
- Capability
- Language
- Dutch
- Interaction
- Single turn
- Items from
- Real work and use
- Refresh
- One fixed set
- Run by
- Anyone
- Strongest model tested
-
Qwen3-235B-A22B #131 on the capability index
- Last model added
- March 2026
- Scores refreshed
- November 20th, 2026
Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 tops the leaderboard with 93% OLMo 2 32B Instruct leads with 92.5% among models released by March 2026
Best score per entry from EuroEval’s leaderboard, read on November 20th, 2026. EuroEval reports Matthews correlation on its DBRD-mini test split, scaled by 100. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is OLMo 2 32B Instruct, at 92.5%. This view shows only models we track, each at its best.
The newest model with a score here came out in March 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- and 16 more
- 93.0 Qwen/Qwen3-235B-A22B-Instruct-2507-FP8
- 92.5
OLMo 2 32B Instruct
- 92.5
Gemma 3 27B
- 92.3
Llama 3.1-405B
- 92.3 NovaSky-AI/Sky-T1-32B-Preview
- 92.1
Qwen3-Next-80B-A3B-Instruct
- 92.1
Llama 3.3 70B Instruct
- 92.0 ThatsGroes/gemma-2-27b-it-FP8-Dynamic
- 91.9
Apertus 70B
- 91.9
Mistral Small 3.1
- 91.9
Llama 3-8B
- 91.8
Qwen3-14B
- 91.7
Aya Expanse 8B
- 91.7
Qwen3-32B
- 91.7
Llama 3.1-8B
- 91.6 allenai/Olmo-3.1-32B-Instruct-DPO
- 91.5
Llama-3.1-Tulu-3-8B
- 91.5 allenai/Llama-3.1-Tulu-3-8B-DPO
- 91.4
Olmo 3.1 32B Instruct
- 91.4 Qwen/Qwen3-235B-A22B-Thinking-2507-FP8
- 91.4
Mistral Small 3.2
- 91.4 01-ai/Yi-1.5-9B
- 91.4 ai21labs/Jamba-v0.1
- 91.4 allenai/Llama-3.1-Tulu-3.1-8B
- 91.3
Aya Expanse 32B
- 91.3
Cogito v1 Preview 70B
- 91.3 google/gemma-2-9b-it
- 91.3
Llama-3.1-Nemotron-70B-Instruct
- 91.3 google/gemma-2-27b-it
- 91.2 LumiOpen/Llama-Poro-2-70B-SFT
- 91.2
Gemma 3 12B
- 91.1 mistralai/Magistral-Small-2509
- 91.1 deepcogito/cogito-v2-preview-llama-70B
- 91.1 meta-llama/Llama-3.1-405B-Instruct-FP8
- 91.0
Mixtral 8x7B
- 91.0 deepcogito/cogito-v1-preview-qwen-32B
- 90.9 meta-llama/Llama-4-Scout-17B-16E
- 90.8 GLM-4.5-Air
- 90.8
QwQ-32B
- 90.8 meta-llama/Llama-3.1-70B-Instruct
- 90.7
Qwen3-30B-A3B
- 90.7 mistralai/Mistral-Small-24B-Instruct-2501
- 90.7 Reka Flash 3
- 90.7
Qwen2.5-72B
- 90.7
Voxtral Small
- 90.7
Llama 3-70B
- 90.7
Gemma 3 12B PT
- 90.6 utter-project/EuroLLM-22B-Instruct-Preview
- 90.5 speakleash/Bielik-11B-v2.3-Instruct
- 90.5
Qwen3-Next-80B-A3B
- 90.5
Mistral 7B v0.3
- 90.5 tiiuae/falcon-11B
- 90.5
Llama 2-70B
- 90.4 allenai/Olmo-3.1-32B-Instruct-SFT
- 90.4 utter-project/EuroLLM-22B-Instruct-2512
- 90.3 bullerwins/Magistral-Small-2506-fp8
- 90.3 utter-project/EuroLLM-22B-Preview
- 90.2
Gemma 2 9B
- 90.2 deepcogito/cogito-v1-preview-llama-8B
- 90.2 meta-llama/Llama-2-13b-hf
- 90.2
Command R (03-2024)
- 90.2 Granite 4.0 H Small
- 90.2
Llama 3.1-70B
- 90.2 GLM-4.1V-9B-Thinking
- 90.1
Gemma 3 27B PT
- 90.1 meta-llama/Meta-Llama-3-70B-Instruct
- 90.1 c4ai-command-r-08-2024
- 90.0
Qwen3-235B-A22B
- 90.0
Nemotron 3 Nano 30B-A3B
- 90.0 ChocoLlama/Llama-3-ChocoLlama-8B-instruct
- 90.0 meta-llama/Llama-3.1-8B-Instruct
- 90.0 deepcogito/cogito-v1-preview-qwen-14B
- 89.9 occiglot/occiglot-7b-eu5
- 89.9 BSC-LT/salamandra-7b
- 89.9 Reka Flash 3.1
- 89.9
Yi-1.5-34B
- 89.8 LumiOpen/Llama-Poro-2-70B-Instruct
- 89.8
DeepSeek-R1-Distill-Llama-70B
- 89.7 LumiOpen/Viking-33B
- 89.7 HuggingFaceTB/SmolLM3-3B-Base
- 89.7
Phi-4
- 89.7
Llama 4 Scout
- 89.6
Qwen3-8B
- 89.5
Qwen1.5-14B-Chat
- 89.3 allenai/OLMo-2-0325-32B
- 89.3 ibm-granite/granite-4.0-h-tiny
- 89.3 occiglot/occiglot-7b-eu5-instruct
- 89.2 mistralai/Mixtral-8x7B-Instruct-v0.1
- 89.2 152334H/miqu-1-70b-sf
- 89.2 ibm-granite/granite-3.0-3b-a800m-base
- 89.2 meta-llama/Meta-Llama-3-8B-Instruct
- 89.1 ibm-granite/granite-4.0-h-micro
- 89.1 Granite-3.0-2B-Base
- 89.0 utter-project/EuroLLM-9B-Instruct
- 89.0
Gemma 3n E2B
- 89.0 CohereForAI/aya-23-8B
- 89.0 mistralai/Ministral-3-8B-Reasoning-2512
- 89.0 mistralai/Mistral-Nemo-Instruct-2407
- 89.0 mistralai/Ministral-8B-Instruct-2410
- 88.9 meta-llama/Llama-2-7b-hf
- 88.9 typesafe/jev-1.13.0
- 88.8 allenai/Olmo-3-1025-7B
- 88.8 allenai/Olmo-3-1125-32B
- 88.8
Llama 3.2 3B
- 88.8
DeepSeek-R1-Distill-Qwen-32B
- 88.7 allenai/OLMo-2-1124-13B-Instruct
- 88.6
Gemma 3n E4B
- 88.5
DeepSeek-R1-Distill-Qwen-14B
- 88.5
Ministral 3 3B Reasoning
- 88.5 utter-project/EuroLLM-22B-2512
- 88.5 BramVanroy/GEITje-7B-ultra
- 88.4 ibm-granite/granite-3.0-3b-a800m-instruct
- 88.4
Qwen3-4B-Thinking-2507
- 88.4 NousResearch/DeepHermes-3-Llama-3-8B-Preview
- 88.4 deepseek-r1-0528-qwen3-8b
- 88.3
Gemma 7B
- 88.2 allenai/Llama-3.1-Tulu-3-8B-SFT
- 88.1 Granite-3.0-8B-Instruct
- 88.1 mistralai/Mistral-Small-3.1-24B-Base-2503
- 88.0
Mistral 7B v0.1
- 88.0 allenai/OLMo-2-1124-13B
- 88.0 neuralmagic/Sparse-Llama-3.1-8B-2of4
- 88.0 Granite-3.0-8B-Base
- 87.9 gpt-oss-20b
- 87.8 norallm/normistral-11b-warm
- 87.8 upstage/SOLAR-10.7B-v1.0
- 87.8 01-ai/Yi-1.5-6B
- 87.7
Falcon3-7B-Instruct
- 87.6 CohereForAI/aya-23-35B
- 87.6 nvidia/mistral-nemo-minitron-8b-base
- 87.5 swiss-ai/Apertus-8B-2509
- 87.5 ibm-granite/granite-34b-code-base
- 87.5
Qwen1.5-14B
- 87.5 google/gemma-2-2b
- 87.4 mistralai/Voxtral-Mini-3B-2507
- 87.2 granite-4.0-micro
- 87.1 meta-llama/Llama-3.2-3B-Instruct
- 86.9 utter-project/EuroLLM-9B
- 86.9 tiiuae/Falcon3-7B-Base
- 86.7 deepcogito/cogito-v1-preview-llama-3B
- 86.6 nvidia/mistral-nemo-minitron-8b-instruct
- 86.6
Gemma 3 4B
- 86.6 HuggingFaceTB/SmolLM3-3B
- 86.5 mistralai/Ministral-3-3B-Base-2512
- 86.5
Gemma 2B
- 86.5
Mistral-7B-Instruct-v0.2
- 86.3 qwen3-4b-instruct-2507
- 86.2 TrustLLMeu/baseline-7-8b_2-3t-tokens_llama
- 86.1 Granite-3.0-2B-Instruct
- 86.1
Gemma 3 4B PT
- 86.1 BSC-LT/salamandra-7b-instruct
- 86.0 mii-llm/nesso-4B
- 85.9 allenai/OLMo-2-1124-7B-Instruct
- 85.8 stabilityai/stablelm-2-1_6b
- 85.8 speakleash/Bielik-One-4B-r1@567d29b0f15df28794acf0f6187f9216860d4551
- 85.6
Starling-LM-7B-beta
- 85.6 nvidia-nemotron-nano-9b-v2
- 85.4 ibm-granite/granite-34b-code-instruct
- 85.3 speakleash/Bielik-One-11B-v3.1-r1@75a2d83890e3c68bf7fac2fe5bbe2bff6372036c
- 85.3
Command R7B
- 85.3
Gemma 2 27B
- 85.3 intfloat/multilingual-e5-large
- 85.3 ibm-granite/granite-20b-code-base
- 85.2 NorwAI/NorwAI-Mistral-7B
- 85.1 allenai/OLMo-2-1124-7B
- 85.1 TildeAI/TildeOpen-30b
- 85.0 ollama_chat/gemma3:4b-it-q4_K_M
- 85.0 google/rembert
- 84.9
Gemma 2 2B IT
- 84.8
AFM-4.5B
- 84.8 baidu/ERNIE-4.5-21B-A3B-PT
- 84.7 senseable/WestLake-7B-v2
- 84.6 LumiOpen/Viking-13B
- 84.5 speakleash/Bielik-11B-v2.6-Instruct
- 84.4 meta-llama/Llama-2-13b-chat-hf
- 84.3
Qwen3-4B
- 84.2 meta-llama/Llama-2-70b-chat-hf
- 84.2
Apertus 8B Instruct
- 84.1 TrustLLMeu/baseline-7-8b_1t-tokens_llama
- 83.9 MaLA-LM/emma-500-llama2-7b
- 83.8 TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49
- 83.7 Qwen/Qwen1.5-4B
- 83.7
Mistral-7B-Instruct-v0.1
- 83.2 ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf
- 82.9
Trinity Mini
- 82.9 arcee-ai/AFM-4.5B-Base
- 82.9
Qwen3-1.7B
- 82.8 ChocoLlama/ChocoLlama-2-7B-base
- 82.7 Qwen/Qwen2.5-Math-7B
- 82.4 ibm-granite/granite-7b-base
- 82.3
Qwen1.5-4B-Chat
- 81.5 ChocoLlama/Llama-3-ChocoLlama-8B-base
- 81.0 EuroBERT/EuroBERT-610m
- 80.6
Llama 3.2 1B
- 80.1 Qwen/Qwen2.5-1.5B-Instruct
- 80.1 ibm-granite/granite-8b-code-base-4k
- 80.0 jhu-clsp/mmBERT-base
- 79.9 allenai/Olmo-3-7B-Instruct
- 79.8 allenai/Olmo-3-7B-Instruct-DPO
- 79.6 allenai/Olmo-3-7B-Think
- 79.5 ibm-granite/granite-8b-code-instruct-4k
- 79.4
Phi-3-mini-128k-instruct
- 79.1 allenai/Olmo-3-7B-Instruct-SFT
- 78.7
Nemotron 3 Nano 4B
- 78.7 LiquidAI/LFM2-2.6B
- 78.1 OmniJev/OneJev1.6-0.8B
- 77.2 setu4993/LaBSE
- 77.0 deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- 77.0 intfloat/multilingual-e5-base
- 75.2 TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6
- 74.9
Hunyuan-4B-Instruct
- 74.9 ZurichNLP/unsup-simcse-xlm-roberta-base
- 74.8 syvai/claes-preview
- 74.6 EuroBERT/EuroBERT-210m
- 74.5 timpal0l/Mistral-7B-v0.1-flashback-v2
- 74.4
DeepSeek-R1-Distill-Qwen-7B
- 74.3
SmolLM2-1.7B
- 74.1
SmolLM2 1.7B Instruct
- 74.1
Gemma 3 1B
- 73.4 ibm-granite/granite-3.0-1b-a400m-base
- 73.2 TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f
- 72.2 TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660
- 71.4 TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894
- 71.1 AI-Sweden-Models/ModernBERT-large
- 71.0 common-pile/comma-v0.1-2t
- 70.8 convaiinnovations/laya-multilingual
- 70.7 ibm-granite/granite-20b-code-instruct
- 70.2 HPLT/gpt-13b-nordic-prerelease
- 70.1 jaredpalmer/kev-0.5b
- 70.0 state-spaces/mamba-2.8b-hf
- 69.4 infly/OpenCoder-8B-Instruct
- 69.2 jhu-clsp/mmBERT-small
- 68.8 HPLT/hplt2c_nld_checkpoints
- 68.5 ChocoLlama/ChocoLlama-2-7B-tokentrans-base
- 68.3 FacebookAI/xlm-roberta-large
- 68.0 speakleash/Bielik-11B-v3-Base-20250730
- 67.7 infly/OpenCoder-8B-Base
- 67.1 Qwen/Qwen1.5-1.8B-Chat
- 66.9 ChocoLlama/ChocoLlama-2-7B-instruct
- 66.5 utter-project/EuroMoE-2.6B-A0.6B-Preview
- 66.4 tencent/Hunyuan-7B-Instruct
- 65.8 arcee-ai/Trinity-Mini-Base
- 65.8 syvai/claes-v1
- 65.5 LFM2.5-1.2B-Instruct
- 65.1 common-pile/comma-v0.1-1t
- 65.0 fastino/GLiNER2.5-Decide
- 64.6 ibm-granite/granite-3.0-1b-a400m-instruct
- 64.1
Qwen3-0.6B
- 63.1 openGPT-X/Teuken-7B-instruct-research-v0.4
- 62.2 yulan-team/YuLan-Mini-Instruct
- 61.5 microsoft/mdeberta-v3-base
- 61.0
Falcon3-3B-Instruct
- 60.1 openGPT-X/Teuken-7B-instruct-commercial-v0.4
- 59.6 sentence-transformers/stsb-xlm-r-multilingual
- 58.9 google/gemma-2b-it
- 58.1 LiquidAI/LFM2.5-1.2B-Base
- 58.0 facebook/MobileLLM-R1-950M-base
- 56.4
Gemma 3 1B PT
- 55.1 Twitter/twhin-bert-base
- 54.9 arcee-ai/Trinity-Nano-Base
- 53.2 swiss-ai/Apertus-v1.1-1.5B
- 53.2 PleIAs/Pleias-3b-Preview
- 53.1 BSC-LT/ALIA-40b
- 52.4 meta-llama/Llama-2-7b-chat-hf
- 51.7
Phi-4-mini-reasoning
- 49.6 ibm-granite/granite-3b-code-base-2k
- 49.3 google/gemma-7b-it
- 49.2 RuterNorway/Llama-2-7b-chat-norwegian
- 48.3 sentence-transformers/paraphrase-xlm-r-multilingual-v1
- 48.2 PleIAs/Pleias-Nano
- 47.7 microsoft/xlm-align-base
- 46.9 tiiuae/Falcon3-3B-Base
- 45.0 NorwAI/NorwAI-Mixtral-8x7B-instruct
- 44.8 speakleash/Bielik-4.5B-v3.0-Instruct
- 44.6 tencent/Hunyuan-1.8B-Instruct
- 43.0
Phi-4-reasoning
- 40.3 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2
- 38.7
Falcon3-1B-Instruct
- 38.5 sentence-transformers/distiluse-base-multilingual-cased-v1
- 37.9 LFM2-1.2B
- 37.6 PleIAs/Pleias-1.2b-Preview
- 37.2 sentence-transformers/distiluse-base-multilingual-cased
- 37.2 sentence-transformers/distiluse-base-multilingual-cased-v2
- 37.2 speakleash/Bielik-1.5B-v3.0-Instruct
- 35.0 distilbert/distilbert-base-multilingual-cased
- 33.9
DeepSeek-R1-Distill-Qwen-1.5B
- 33.9 sentence-transformers/quora-distilbert-multilingual
- 33.8 sentence-transformers/distilbert-multilingual-nli-stsb-quora-ranking
- 33.5 answerdotai/ModernBERT-base
- 33.1 LFM2.5-1.2B-Thinking
- 32.8 AI-Sweden-Models/gpt-sw3-20b
- 31.2 Twitter/twhin-bert-large
- 30.1 AI-Sweden-Models/gpt-sw3-20b-instruct
- 29.5 EuropeanParliament/EUBERT
- 29.5 Geotrend/distilbert-base-25lang-cased
- 28.3 answerdotai/ModernBERT-large
- 27.5 AI-Sweden-Models/roberta-large-1160k
- 27.5 facebook/MobileLLM-R1-360M-base
- 27.3 Qwen/Qwen1.5-1.8B
- 27.0 arcee-ai/Trinity-Nano-Preview
- 26.7 Qwen/Qwen2.5-Math-1.5B
- 25.5 infly/OpenCoder-1.5B-Instruct
- 25.4 cardiffnlp/twitter-xlm-roberta-base
- 24.2
Phi-2
- 23.9 AI-Sweden-Models/bert-large-nordic-pile-1M-steps
- 23.6 ibm-granite/granite-3b-code-instruct-2k
- 22.1 convaiinnovations/laya
- 21.8
Gemma 3 270M
- 17.8 meta-llama/Llama-3.2-1B-Instruct
- 17.5
Phi-4-Reasoning-plus
- 14.9 HPLT/hplt2c_eng_checkpoints
- 14.6
SmolLM2-360M
- 13.7 LiquidAI/LFM2-350M
- 13.6 dbmdz/bert-base-historic-multilingual-cased
- 13.2 LiquidAI/LFM2-700M
- 13.2 Qwen/Qwen1.5-0.5B-Chat
- 10.9 Qwen/Qwen1.5-0.5B
- 10.3 utter-project/EuroVLM-1.7B-Preview
- 9.67 PleIAs/Pleias-Pico
- 9.54 fresh-xlm-roberta-base
- 8.96 PleIAs/Pleias-350m-Preview
- 7.64 baidu/ERNIE-4.5-0.3B-PT
- 6.87 HPLT/hplt2c_deu_checkpoints
- 6.81 facebook/MobileLLM-R1-140M-base
- 5.61 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview
- 4.28 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base
- 3.50 DiscoResearch/DiscoLM-70b
- 2.62 AI-Sweden-Models/gpt-sw3-356m-instruct
- 2.13 dbmdz/bert-tiny-historic-multilingual-cased
- 1.78
SmolLM2-135M
- 0.91 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct
- 0.86 PleIAs/Baguettotron@refs/pr/6
- 0.67 AI-Sweden-Models/gpt-sw3-126m-instruct
- 0.38 AI-Sweden-Models/gpt-sw3-356m
- 0.23 fresh-electra-small
- 0.23 infly/OpenCoder-1.5B-Base
- 0.06 facebook/MobileLLM-R1-360M
- 0.0 ChocoLlama/ChocoLlama-2-7B-tokentrans-instruct
- 0.0 facebook/MobileLLM-R1-950M
- 0.0 kyutai/helium-1-2b
- 0.0 openai-community/gpt2
- 0.0 openai-community/gpt2-large
- 0.0 openai-community/gpt2-medium
- 0.0 Shekswess/trlm-135m
- -0.76 facebook/MobileLLM-R1-140M
- -0.98 HuggingFaceTB/SmolLM2-135M-Instruct
- -1.28 PleIAs/Monad
- -1.60 AI-Sweden-Models/gpt-sw3-126m
- -2.34 ibm-granite/granite-7b-instruct
- -4.94 ssmits/Falcon2-5.5B-multilingual
- -6.52 HuggingFaceTB/SmolLM2-360M-Instruct
- -13.48 RJuro/kanelsnegl-v0.1
- 1 Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 93%
- 2
OLMo 2 32B Instruct 92.5%
- 3
Gemma 3 27B 92.5%
- 4
Llama 3.1-405B 92.3%
- 5 NovaSky-AI/Sky-T1-32B-Preview 92.3%
- 6
Qwen3-Next-80B-A3B-Instruct 92.1%
- 7
Llama 3.3 70B Instruct 92.1%
- 8 ThatsGroes/gemma-2-27b-it-FP8-Dynamic 92%
- 9
Apertus 70B 91.9%
- 10
Mistral Small 3.1 91.9%
- 11
Llama 3-8B 91.9%
- 12
Qwen3-14B no-thinking 91.8%
- 13
Aya Expanse 8B 91.7%
- 14
Qwen3-32B no-thinking 91.7%
- 15
Llama 3.1-8B 91.7%
- 16 allenai/Olmo-3.1-32B-Instruct-DPO 91.6%
- 17
Llama-3.1-Tulu-3-8B 91.5%
- 18 allenai/Llama-3.1-Tulu-3-8B-DPO 91.5%
- 19
Olmo 3.1 32B Instruct 91.4%
- 20 Qwen/Qwen3-235B-A22B-Thinking-2507-FP8 91.4%
- 21
Mistral Small 3.2 91.4%
- 22 01-ai/Yi-1.5-9B 91.4%
- 23 ai21labs/Jamba-v0.1 91.4%
- 24 allenai/Llama-3.1-Tulu-3.1-8B 91.4%
- 25
Aya Expanse 32B 91.3%
- 26
Cogito v1 Preview 70B 91.3%
- 27 google/gemma-2-9b-it 91.3%
- 28
Llama-3.1-Nemotron-70B-Instruct 91.3%
- 29 google/gemma-2-27b-it 91.3%
- 30 LumiOpen/Llama-Poro-2-70B-SFT 91.2%
- 31
Gemma 3 12B 91.2%
- 32 mistralai/Magistral-Small-2509 91.1%
- 33 deepcogito/cogito-v2-preview-llama-70B 91.1%
- 34 meta-llama/Llama-3.1-405B-Instruct-FP8 91.1%
- 35
Mixtral 8x7B 91%
- 36 deepcogito/cogito-v1-preview-qwen-32B 91%
- 37 meta-llama/Llama-4-Scout-17B-16E 90.9%
- 38 GLM-4.5-Air thinking 90.8%
- 39
QwQ-32B 90.8%
- 40 meta-llama/Llama-3.1-70B-Instruct 90.8%
- 41
Qwen3-30B-A3B no-thinking 90.7%
- 42 mistralai/Mistral-Small-24B-Instruct-2501 90.7%
- 43 Reka Flash 3 90.7%
- 44
Qwen2.5-72B 90.7%
- 45
Voxtral Small 90.7%
- 46
Llama 3-70B 90.7%
- 47
Gemma 3 12B PT 90.7%
- 48 utter-project/EuroLLM-22B-Instruct-Preview 90.6%
- 49 speakleash/Bielik-11B-v2.3-Instruct 90.5%
- 50
Qwen3-Next-80B-A3B thinking 90.5%
- 51
Mistral 7B v0.3 90.5%
- 52 tiiuae/falcon-11B 90.5%
- 53
Llama 2-70B 90.5%
- 54 allenai/Olmo-3.1-32B-Instruct-SFT 90.4%
- 55 utter-project/EuroLLM-22B-Instruct-2512 90.4%
- 56 bullerwins/Magistral-Small-2506-fp8 90.3%
- 57 utter-project/EuroLLM-22B-Preview 90.3%
- 58
Gemma 2 9B 90.2%
- 59 deepcogito/cogito-v1-preview-llama-8B 90.2%
- 60 meta-llama/Llama-2-13b-hf 90.2%
- 61
Command R (03-2024) 90.2%
- 62 Granite 4.0 H Small 90.2%
- 63
Llama 3.1-70B 90.2%
- 64 GLM-4.1V-9B-Thinking 90.2%
- 65
Gemma 3 27B PT 90.1%
- 66 meta-llama/Meta-Llama-3-70B-Instruct 90.1%
- 67 c4ai-command-r-08-2024 90.1%
- 68
Qwen3-235B-A22B 90%
- 69
Nemotron 3 Nano 30B-A3B no-thinking 90%
- 70 ChocoLlama/Llama-3-ChocoLlama-8B-instruct 90%
- 71 meta-llama/Llama-3.1-8B-Instruct 90%
- 72 deepcogito/cogito-v1-preview-qwen-14B 90%
- 73 occiglot/occiglot-7b-eu5 89.9%
- 74 BSC-LT/salamandra-7b 89.9%
- 75 Reka Flash 3.1 89.9%
- 76
Yi-1.5-34B 89.9%
- 77 LumiOpen/Llama-Poro-2-70B-Instruct 89.8%
- 78
DeepSeek-R1-Distill-Llama-70B 89.8%
- 79 LumiOpen/Viking-33B 89.7%
- 80 HuggingFaceTB/SmolLM3-3B-Base 89.7%
- 81
Phi-4 89.7%
- 82
Llama 4 Scout 89.7%
- 83
Qwen3-8B 89.6%
- 84
Qwen1.5-14B-Chat 89.5%
- 85 allenai/OLMo-2-0325-32B 89.3%
- 86 ibm-granite/granite-4.0-h-tiny 89.3%
- 87 occiglot/occiglot-7b-eu5-instruct 89.3%
- 88 mistralai/Mixtral-8x7B-Instruct-v0.1 89.2%
- 89 152334H/miqu-1-70b-sf 89.2%
- 90 ibm-granite/granite-3.0-3b-a800m-base 89.2%
- 91 meta-llama/Meta-Llama-3-8B-Instruct 89.2%
- 92 ibm-granite/granite-4.0-h-micro 89.1%
- 93 Granite-3.0-2B-Base 89.1%
- 94 utter-project/EuroLLM-9B-Instruct 89%
- 95
Gemma 3n E2B 89%
- 96 CohereForAI/aya-23-8B 89%
- 97 mistralai/Ministral-3-8B-Reasoning-2512 89%
- 98 mistralai/Mistral-Nemo-Instruct-2407 89%
- 99 mistralai/Ministral-8B-Instruct-2410 89%
- 100 meta-llama/Llama-2-7b-hf 88.9%
- 101 typesafe/jev-1.13.0 zero-shot 88.9%
- 102 allenai/Olmo-3-1025-7B 88.8%
- 103 allenai/Olmo-3-1125-32B 88.8%
- 104
Llama 3.2 3B 88.8%
- 105
DeepSeek-R1-Distill-Qwen-32B 88.8%
- 106 allenai/OLMo-2-1124-13B-Instruct 88.7%
- 107
Gemma 3n E4B 88.6%
- 108
DeepSeek-R1-Distill-Qwen-14B 88.5%
- 109
Ministral 3 3B Reasoning 88.5%
- 110 utter-project/EuroLLM-22B-2512 88.5%
- 111 BramVanroy/GEITje-7B-ultra 88.5%
- 112 ibm-granite/granite-3.0-3b-a800m-instruct 88.4%
- 113
Qwen3-4B-Thinking-2507 88.4%
- 114 NousResearch/DeepHermes-3-Llama-3-8B-Preview 88.4%
- 115 deepseek-r1-0528-qwen3-8b 88.4%
- 116
Gemma 7B 88.3%
- 117 allenai/Llama-3.1-Tulu-3-8B-SFT 88.2%
- 118 Granite-3.0-8B-Instruct 88.1%
- 119 mistralai/Mistral-Small-3.1-24B-Base-2503 88.1%
- 120
Mistral 7B v0.1 88%
- 121 allenai/OLMo-2-1124-13B 88%
- 122 neuralmagic/Sparse-Llama-3.1-8B-2of4 88%
- 123 Granite-3.0-8B-Base 88%
- 124 gpt-oss-20b medium 87.9%
- 125 norallm/normistral-11b-warm 87.8%
- 126 upstage/SOLAR-10.7B-v1.0 87.8%
- 127 01-ai/Yi-1.5-6B 87.8%
- 128
Falcon3-7B-Instruct 87.7%
- 129 CohereForAI/aya-23-35B 87.6%
- 130 nvidia/mistral-nemo-minitron-8b-base 87.6%
- 131 swiss-ai/Apertus-8B-2509 87.5%
- 132 ibm-granite/granite-34b-code-base 87.5%
- 133
Qwen1.5-14B 87.5%
- 134 google/gemma-2-2b 87.5%
- 135 mistralai/Voxtral-Mini-3B-2507 87.4%
- 136 granite-4.0-micro 87.2%
- 137 meta-llama/Llama-3.2-3B-Instruct 87.1%
- 138 utter-project/EuroLLM-9B 86.9%
- 139 tiiuae/Falcon3-7B-Base 86.9%
- 140 deepcogito/cogito-v1-preview-llama-3B 86.7%
- 141 nvidia/mistral-nemo-minitron-8b-instruct 86.6%
- 142
Gemma 3 4B 86.6%
- 143 HuggingFaceTB/SmolLM3-3B no-thinking 86.6%
- 144 mistralai/Ministral-3-3B-Base-2512 86.5%
- 145
Gemma 2B 86.5%
- 146
Mistral-7B-Instruct-v0.2 86.5%
- 147 qwen3-4b-instruct-2507 86.3%
- 148 TrustLLMeu/baseline-7-8b_2-3t-tokens_llama 86.2%
- 149 Granite-3.0-2B-Instruct 86.1%
- 150
Gemma 3 4B PT 86.1%
- 151 BSC-LT/salamandra-7b-instruct 86.1%
- 152 mii-llm/nesso-4B 86%
- 153 allenai/OLMo-2-1124-7B-Instruct 85.9%
- 154 stabilityai/stablelm-2-1_6b 85.8%
- 155 speakleash/Bielik-One-4B-r1@567d29b0f15df28794acf0f6187f9216860d4551 zero-shot 85.8%
- 156
Starling-LM-7B-beta 85.6%
- 157 nvidia-nemotron-nano-9b-v2 85.6%
- 158 ibm-granite/granite-34b-code-instruct 85.4%
- 159 speakleash/Bielik-One-11B-v3.1-r1@75a2d83890e3c68bf7fac2fe5bbe2bff6372036c zero-shot 85.3%
- 160
Command R7B 85.3%
- 161
Gemma 2 27B 85.3%
- 162 intfloat/multilingual-e5-large 85.3%
- 163 ibm-granite/granite-20b-code-base 85.3%
- 164 NorwAI/NorwAI-Mistral-7B 85.2%
- 165 allenai/OLMo-2-1124-7B 85.1%
- 166 TildeAI/TildeOpen-30b slow-tokenizer 85.1%
- 167 ollama_chat/gemma3:4b-it-q4_K_M 85%
- 168 google/rembert 85%
- 169
Gemma 2 2B IT 84.9%
- 170
AFM-4.5B 84.8%
- 171 baidu/ERNIE-4.5-21B-A3B-PT 84.8%
- 172 senseable/WestLake-7B-v2 84.7%
- 173 LumiOpen/Viking-13B 84.6%
- 174 speakleash/Bielik-11B-v2.6-Instruct 84.5%
- 175 meta-llama/Llama-2-13b-chat-hf 84.4%
- 176
Qwen3-4B no-thinking 84.3%
- 177 meta-llama/Llama-2-70b-chat-hf 84.2%
- 178
Apertus 8B Instruct 84.2%
- 179 TrustLLMeu/baseline-7-8b_1t-tokens_llama 84.1%
- 180 MaLA-LM/emma-500-llama2-7b 83.9%
- 181 TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49 83.8%
- 182 Qwen/Qwen1.5-4B 83.7%
- 183
Mistral-7B-Instruct-v0.1 83.7%
- 184 ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf 83.2%
- 185
Trinity Mini 82.9%
- 186 arcee-ai/AFM-4.5B-Base 82.9%
- 187
Qwen3-1.7B no-thinking 82.9%
- 188 ChocoLlama/ChocoLlama-2-7B-base 82.8%
- 189 Qwen/Qwen2.5-Math-7B 82.7%
- 190 ibm-granite/granite-7b-base 82.4%
- 191
Qwen1.5-4B-Chat 82.3%
- 192 ChocoLlama/Llama-3-ChocoLlama-8B-base 81.5%
- 193 EuroBERT/EuroBERT-610m 81%
- 194
Llama 3.2 1B 80.6%
- 195 Qwen/Qwen2.5-1.5B-Instruct 80.1%
- 196 ibm-granite/granite-8b-code-base-4k 80.1%
- 197 jhu-clsp/mmBERT-base 80%
- 198 allenai/Olmo-3-7B-Instruct 79.9%
- 199 allenai/Olmo-3-7B-Instruct-DPO 79.8%
- 200 allenai/Olmo-3-7B-Think 79.6%
- 201 ibm-granite/granite-8b-code-instruct-4k 79.5%
- 202
Phi-3-mini-128k-instruct 79.4%
- 203 allenai/Olmo-3-7B-Instruct-SFT 79.1%
- 204
Nemotron 3 Nano 4B 78.7%
- 205 LiquidAI/LFM2-2.6B 78.7%
- 206 OmniJev/OneJev1.6-0.8B zero-shot 78.1%
- 207 setu4993/LaBSE 77.2%
- 208 deepseek-ai/DeepSeek-R1-Distill-Llama-8B 77%
- 209 intfloat/multilingual-e5-base 77%
- 210 TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 75.2%
- 211
Hunyuan-4B-Instruct 74.9%
- 212 ZurichNLP/unsup-simcse-xlm-roberta-base 74.9%
- 213 syvai/claes-preview zero-shot 74.8%
- 214 EuroBERT/EuroBERT-210m 74.6%
- 215 timpal0l/Mistral-7B-v0.1-flashback-v2 74.5%
- 216
DeepSeek-R1-Distill-Qwen-7B 74.4%
- 217
SmolLM2-1.7B 74.3%
- 218
SmolLM2 1.7B Instruct 74.1%
- 219
Gemma 3 1B 74.1%
- 220 ibm-granite/granite-3.0-1b-a400m-base 73.4%
- 221 TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f 73.2%
- 222 TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 72.2%
- 223 TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894 71.4%
- 224 AI-Sweden-Models/ModernBERT-large 71.1%
- 225 common-pile/comma-v0.1-2t 71%
- 226 convaiinnovations/laya-multilingual zero-shot 70.8%
- 227 ibm-granite/granite-20b-code-instruct 70.7%
- 228 HPLT/gpt-13b-nordic-prerelease 70.2%
- 229 jaredpalmer/kev-0.5b zero-shot 70.1%
- 230 state-spaces/mamba-2.8b-hf 70%
- 231 infly/OpenCoder-8B-Instruct 69.4%
- 232 jhu-clsp/mmBERT-small 69.2%
- 233 HPLT/hplt2c_nld_checkpoints 68.8%
- 234 ChocoLlama/ChocoLlama-2-7B-tokentrans-base 68.5%
- 235 FacebookAI/xlm-roberta-large 68.3%
- 236 speakleash/Bielik-11B-v3-Base-20250730 68%
- 237 infly/OpenCoder-8B-Base 67.7%
- 238 Qwen/Qwen1.5-1.8B-Chat 67.1%
- 239 ChocoLlama/ChocoLlama-2-7B-instruct 66.9%
- 240 utter-project/EuroMoE-2.6B-A0.6B-Preview 66.5%
- 241 tencent/Hunyuan-7B-Instruct 66.4%
- 242 arcee-ai/Trinity-Mini-Base 65.8%
- 243 syvai/claes-v1 zero-shot 65.8%
- 244 LFM2.5-1.2B-Instruct 65.5%
- 245 common-pile/comma-v0.1-1t 65.1%
- 246 fastino/GLiNER2.5-Decide zero-shot 65%
- 247 ibm-granite/granite-3.0-1b-a400m-instruct 64.6%
- 248
Qwen3-0.6B no-thinking 64.1%
- 249 openGPT-X/Teuken-7B-instruct-research-v0.4 63.1%
- 250 yulan-team/YuLan-Mini-Instruct 62.2%
- 251 microsoft/mdeberta-v3-base 61.5%
- 252
Falcon3-3B-Instruct 61%
- 253 openGPT-X/Teuken-7B-instruct-commercial-v0.4 60.1%
- 254 sentence-transformers/stsb-xlm-r-multilingual 59.6%
- 255 google/gemma-2b-it 58.9%
- 256 LiquidAI/LFM2.5-1.2B-Base 58.1%
- 257 facebook/MobileLLM-R1-950M-base 58%
- 258
Gemma 3 1B PT 56.4%
- 259 Twitter/twhin-bert-base 55.1%
- 260 arcee-ai/Trinity-Nano-Base 54.9%
- 261 swiss-ai/Apertus-v1.1-1.5B zero-shot 53.2%
- 262 PleIAs/Pleias-3b-Preview 53.2%
- 263 BSC-LT/ALIA-40b 53.1%
- 264 meta-llama/Llama-2-7b-chat-hf 52.4%
- 265
Phi-4-mini-reasoning 51.7%
- 266 ibm-granite/granite-3b-code-base-2k 49.6%
- 267 google/gemma-7b-it 49.3%
- 268 RuterNorway/Llama-2-7b-chat-norwegian 49.2%
- 269 sentence-transformers/paraphrase-xlm-r-multilingual-v1 48.3%
- 270 PleIAs/Pleias-Nano 48.2%
- 271 microsoft/xlm-align-base 47.7%
- 272 tiiuae/Falcon3-3B-Base 46.9%
- 273 NorwAI/NorwAI-Mixtral-8x7B-instruct 45%
- 274 speakleash/Bielik-4.5B-v3.0-Instruct 44.8%
- 275 tencent/Hunyuan-1.8B-Instruct 44.6%
- 276
Phi-4-reasoning 43%
- 277 sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 40.3%
- 278
Falcon3-1B-Instruct 38.7%
- 279 sentence-transformers/distiluse-base-multilingual-cased-v1 38.5%
- 280 LFM2-1.2B 37.9%
- 281 PleIAs/Pleias-1.2b-Preview 37.6%
- 282 sentence-transformers/distiluse-base-multilingual-cased 37.2%
- 283 sentence-transformers/distiluse-base-multilingual-cased-v2 37.2%
- 284 speakleash/Bielik-1.5B-v3.0-Instruct 37.2%
- 285 distilbert/distilbert-base-multilingual-cased 35%
- 286
DeepSeek-R1-Distill-Qwen-1.5B 33.9%
- 287 sentence-transformers/quora-distilbert-multilingual 33.9%
- 288 sentence-transformers/distilbert-multilingual-nli-stsb-quora-ranking 33.8%
- 289 answerdotai/ModernBERT-base 33.5%
- 290 LFM2.5-1.2B-Thinking 33.1%
- 291 AI-Sweden-Models/gpt-sw3-20b 32.8%
- 292 Twitter/twhin-bert-large 31.2%
- 293 AI-Sweden-Models/gpt-sw3-20b-instruct 30.1%
- 294 EuropeanParliament/EUBERT 29.5%
- 295 Geotrend/distilbert-base-25lang-cased 29.5%
- 296 answerdotai/ModernBERT-large 28.3%
- 297 AI-Sweden-Models/roberta-large-1160k 27.5%
- 298 facebook/MobileLLM-R1-360M-base 27.5%
- 299 Qwen/Qwen1.5-1.8B 27.3%
- 300 arcee-ai/Trinity-Nano-Preview 27%
- 301 Qwen/Qwen2.5-Math-1.5B 26.7%
- 302 infly/OpenCoder-1.5B-Instruct 25.5%
- 303 cardiffnlp/twitter-xlm-roberta-base 25.4%
- 304
Phi-2 24.2%
- 305 AI-Sweden-Models/bert-large-nordic-pile-1M-steps 23.9%
- 306 ibm-granite/granite-3b-code-instruct-2k 23.6%
- 307 convaiinnovations/laya zero-shot 22.1%
- 308
Gemma 3 270M 21.8%
- 309 meta-llama/Llama-3.2-1B-Instruct 17.8%
- 310
Phi-4-Reasoning-plus 17.5%
- 311 HPLT/hplt2c_eng_checkpoints 14.9%
- 312
SmolLM2-360M 14.6%
- 313 LiquidAI/LFM2-350M 13.7%
- 314 dbmdz/bert-base-historic-multilingual-cased 13.6%
- 315 LiquidAI/LFM2-700M 13.2%
- 316 Qwen/Qwen1.5-0.5B-Chat 13.2%
- 317 Qwen/Qwen1.5-0.5B 10.9%
- 318 utter-project/EuroVLM-1.7B-Preview 10.3%
- 319 PleIAs/Pleias-Pico 9.67%
- 320 fresh-xlm-roberta-base 9.54%
- 321 PleIAs/Pleias-350m-Preview 8.96%
- 322 baidu/ERNIE-4.5-0.3B-PT 7.64%
- 323 HPLT/hplt2c_deu_checkpoints 6.87%
- 324 facebook/MobileLLM-R1-140M-base 6.81%
- 325 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview 5.61%
- 326 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base 4.28%
- 327 DiscoResearch/DiscoLM-70b 3.50%
- 328 AI-Sweden-Models/gpt-sw3-356m-instruct 2.62%
- 329 dbmdz/bert-tiny-historic-multilingual-cased 2.13%
- 330
SmolLM2-135M 1.78%
- 331 tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct 0.91%
- 332 PleIAs/Baguettotron@refs/pr/6 no-thinking 0.86%
- 333 AI-Sweden-Models/gpt-sw3-126m-instruct 0.67%
- 334 AI-Sweden-Models/gpt-sw3-356m 0.38%
- 335 fresh-electra-small 0.23%
- 336 infly/OpenCoder-1.5B-Base 0.23%
- 337 facebook/MobileLLM-R1-360M 0.06%
- 338 ChocoLlama/ChocoLlama-2-7B-tokentrans-instruct 0%
- 339 facebook/MobileLLM-R1-950M 0%
- 340 kyutai/helium-1-2b 0%
- 341 openai-community/gpt2 0%
- 342 openai-community/gpt2-large 0%
- 343 openai-community/gpt2-medium 0%
- 344 Shekswess/trlm-135m 0%
- 345 facebook/MobileLLM-R1-140M -0.76%
- 346 HuggingFaceTB/SmolLM2-135M-Instruct -0.98%
- 347 PleIAs/Monad -1.28%
- 348 AI-Sweden-Models/gpt-sw3-126m -1.60%
- 349 ibm-granite/granite-7b-instruct -2.34%
- 350 ssmits/Falcon2-5.5B-multilingual -4.94%
- 351 HuggingFaceTB/SmolLM2-360M-Instruct -6.52%
- 352 RJuro/kanelsnegl-v0.1 -13.48%
Source: EuroEval’s leaderboard
- 92.5
OLMo 2 32B Instruct
- 92.5
Gemma 3 27B
- 92.3
Llama 3.1-405B
- 92.1
Qwen3-Next-80B-A3B-Instruct
- 92.1
Llama 3.3 70B Instruct
- 91.9
Apertus 70B
- 91.9
Mistral Small 3.1
- 91.9
Llama 3-8B
- 91.8
Qwen3-14B
- 91.7
Aya Expanse 8B
- 91.7
Qwen3-32B
- 91.7
Llama 3.1-8B
- 91.5
Llama-3.1-Tulu-3-8B
- 91.4
Olmo 3.1 32B Instruct
- 91.4
Mistral Small 3.2
- 91.3
Aya Expanse 32B
- 91.3
Cogito v1 Preview 70B
- 91.3
Llama-3.1-Nemotron-70B-Instruct
- 91.2
Gemma 3 12B
- 91.0
Mixtral 8x7B
- 90.8 GLM-4.5-Air
- 90.8
QwQ-32B
- 90.7
Qwen3-30B-A3B
- 90.7 Reka Flash 3
- 90.7
Qwen2.5-72B
- 90.7
Voxtral Small
- 90.7
Llama 3-70B
- 90.7
Gemma 3 12B PT
- 90.5
Qwen3-Next-80B-A3B
- 90.5
Mistral 7B v0.3
- 90.5
Llama 2-70B
- 90.2
Gemma 2 9B
- 90.2
Command R (03-2024)
- 90.2 Granite 4.0 H Small
- 90.2
Llama 3.1-70B
- 90.2 GLM-4.1V-9B-Thinking
- 90.1
Gemma 3 27B PT
- 90.1 c4ai-command-r-08-2024
- 90.0
Qwen3-235B-A22B
- 90.0
Nemotron 3 Nano 30B-A3B
- 89.9 Reka Flash 3.1
- 89.9
Yi-1.5-34B
- 89.8
DeepSeek-R1-Distill-Llama-70B
- 89.7
Phi-4
- 89.7
Llama 4 Scout
- 89.6
Qwen3-8B
- 89.5
Qwen1.5-14B-Chat
- 89.1 Granite-3.0-2B-Base
- 89.0
Gemma 3n E2B
- 88.8
Llama 3.2 3B
- 88.8
DeepSeek-R1-Distill-Qwen-32B
- 88.6
Gemma 3n E4B
- 88.5
DeepSeek-R1-Distill-Qwen-14B
- 88.5
Ministral 3 3B Reasoning
- 88.4
Qwen3-4B-Thinking-2507
- 88.4 deepseek-r1-0528-qwen3-8b
- 88.3
Gemma 7B
- 88.1 Granite-3.0-8B-Instruct
- 88.0
Mistral 7B v0.1
- 88.0 Granite-3.0-8B-Base
- 87.9 gpt-oss-20b
- 87.7
Falcon3-7B-Instruct
- 87.5
Qwen1.5-14B
- 87.2 granite-4.0-micro
- 86.6
Gemma 3 4B
- 86.5
Gemma 2B
- 86.5
Mistral-7B-Instruct-v0.2
- 86.3 qwen3-4b-instruct-2507
- 86.1 Granite-3.0-2B-Instruct
- 86.1
Gemma 3 4B PT
- 85.6
Starling-LM-7B-beta
- 85.6 nvidia-nemotron-nano-9b-v2
- 85.3
Command R7B
- 85.3
Gemma 2 27B
- 84.9
Gemma 2 2B IT
- 84.8
AFM-4.5B
- 84.3
Qwen3-4B
- 84.2
Apertus 8B Instruct
- 83.7
Mistral-7B-Instruct-v0.1
- 82.9
Trinity Mini
- 82.9
Qwen3-1.7B
- 82.3
Qwen1.5-4B-Chat
- 80.6
Llama 3.2 1B
- 79.4
Phi-3-mini-128k-instruct
- 78.7
Nemotron 3 Nano 4B
- 74.9
Hunyuan-4B-Instruct
- 74.4
DeepSeek-R1-Distill-Qwen-7B
- 74.3
SmolLM2-1.7B
- 74.1
SmolLM2 1.7B Instruct
- 74.1
Gemma 3 1B
- 65.5 LFM2.5-1.2B-Instruct
- 64.1
Qwen3-0.6B
- 61.0
Falcon3-3B-Instruct
- 56.4
Gemma 3 1B PT
- 51.7
Phi-4-mini-reasoning
- 43.0
Phi-4-reasoning
- 38.7
Falcon3-1B-Instruct
- 37.9 LFM2-1.2B
- 33.9
DeepSeek-R1-Distill-Qwen-1.5B
- 33.1 LFM2.5-1.2B-Thinking
- 24.2
Phi-2
- 21.8
Gemma 3 270M
- 17.5
Phi-4-Reasoning-plus
- 14.6
SmolLM2-360M
- 1.78
SmolLM2-135M
- 1
OLMo 2 32B Instruct 92.5%
- 2
Gemma 3 27B 92.5%
- 3
Llama 3.1-405B 92.3%
- 4
Qwen3-Next-80B-A3B-Instruct 92.1%
- 5
Llama 3.3 70B Instruct 92.1%
- 6
Apertus 70B 91.9%
- 7
Mistral Small 3.1 91.9%
- 8
Llama 3-8B 91.9%
- 9
Qwen3-14B no-thinking 91.8%
- 10
Aya Expanse 8B 91.7%
- 11
Qwen3-32B no-thinking 91.7%
- 12
Llama 3.1-8B 91.7%
- 13
Llama-3.1-Tulu-3-8B 91.5%
- 14
Olmo 3.1 32B Instruct 91.4%
- 15
Mistral Small 3.2 91.4%
- 16
Aya Expanse 32B 91.3%
- 17
Cogito v1 Preview 70B 91.3%
- 18
Llama-3.1-Nemotron-70B-Instruct 91.3%
- 19
Gemma 3 12B 91.2%
- 20
Mixtral 8x7B 91%
- 21 GLM-4.5-Air thinking 90.8%
- 22
QwQ-32B 90.8%
- 23
Qwen3-30B-A3B no-thinking 90.7%
- 24 Reka Flash 3 90.7%
- 25
Qwen2.5-72B 90.7%
- 26
Voxtral Small 90.7%
- 27
Llama 3-70B 90.7%
- 28
Gemma 3 12B PT 90.7%
- 29
Qwen3-Next-80B-A3B thinking 90.5%
- 30
Mistral 7B v0.3 90.5%
- 31
Llama 2-70B 90.5%
- 32
Gemma 2 9B 90.2%
- 33
Command R (03-2024) 90.2%
- 34 Granite 4.0 H Small 90.2%
- 35
Llama 3.1-70B 90.2%
- 36 GLM-4.1V-9B-Thinking 90.2%
- 37
Gemma 3 27B PT 90.1%
- 38 c4ai-command-r-08-2024 90.1%
- 39
Qwen3-235B-A22B 90%
- 40
Nemotron 3 Nano 30B-A3B no-thinking 90%
- 41 Reka Flash 3.1 89.9%
- 42
Yi-1.5-34B 89.9%
- 43
DeepSeek-R1-Distill-Llama-70B 89.8%
- 44
Phi-4 89.7%
- 45
Llama 4 Scout 89.7%
- 46
Qwen3-8B 89.6%
- 47
Qwen1.5-14B-Chat 89.5%
- 48 Granite-3.0-2B-Base 89.1%
- 49
Gemma 3n E2B 89%
- 50
Llama 3.2 3B 88.8%
- 51
DeepSeek-R1-Distill-Qwen-32B 88.8%
- 52
Gemma 3n E4B 88.6%
- 53
DeepSeek-R1-Distill-Qwen-14B 88.5%
- 54
Ministral 3 3B Reasoning 88.5%
- 55
Qwen3-4B-Thinking-2507 88.4%
- 56 deepseek-r1-0528-qwen3-8b 88.4%
- 57
Gemma 7B 88.3%
- 58 Granite-3.0-8B-Instruct 88.1%
- 59
Mistral 7B v0.1 88%
- 60 Granite-3.0-8B-Base 88%
- 61 gpt-oss-20b medium 87.9%
- 62
Falcon3-7B-Instruct 87.7%
- 63
Qwen1.5-14B 87.5%
- 64 granite-4.0-micro 87.2%
- 65
Gemma 3 4B 86.6%
- 66
Gemma 2B 86.5%
- 67
Mistral-7B-Instruct-v0.2 86.5%
- 68 qwen3-4b-instruct-2507 86.3%
- 69 Granite-3.0-2B-Instruct 86.1%
- 70
Gemma 3 4B PT 86.1%
- 71
Starling-LM-7B-beta 85.6%
- 72 nvidia-nemotron-nano-9b-v2 85.6%
- 73
Command R7B 85.3%
- 74
Gemma 2 27B 85.3%
- 75
Gemma 2 2B IT 84.9%
- 76
AFM-4.5B 84.8%
- 77
Qwen3-4B no-thinking 84.3%
- 78
Apertus 8B Instruct 84.2%
- 79
Mistral-7B-Instruct-v0.1 83.7%
- 80
Trinity Mini 82.9%
- 81
Qwen3-1.7B no-thinking 82.9%
- 82
Qwen1.5-4B-Chat 82.3%
- 83
Llama 3.2 1B 80.6%
- 84
Phi-3-mini-128k-instruct 79.4%
- 85
Nemotron 3 Nano 4B 78.7%
- 86
Hunyuan-4B-Instruct 74.9%
- 87
DeepSeek-R1-Distill-Qwen-7B 74.4%
- 88
SmolLM2-1.7B 74.3%
- 89
SmolLM2 1.7B Instruct 74.1%
- 90
Gemma 3 1B 74.1%
- 91 LFM2.5-1.2B-Instruct 65.5%
- 92
Qwen3-0.6B no-thinking 64.1%
- 93
Falcon3-3B-Instruct 61%
- 94
Gemma 3 1B PT 56.4%
- 95
Phi-4-mini-reasoning 51.7%
- 96
Phi-4-reasoning 43%
- 97
Falcon3-1B-Instruct 38.7%
- 98 LFM2-1.2B 37.9%
- 99
DeepSeek-R1-Distill-Qwen-1.5B 33.9%
- 100 LFM2.5-1.2B-Thinking 33.1%
- 101
Phi-2 24.2%
- 102
Gemma 3 270M 21.8%
- 103
Phi-4-Reasoning-plus 17.5%
- 104
SmolLM2-360M 14.6%
- 105
SmolLM2-135M 1.78%
Source: EuroEval’s leaderboard
| # | Entry | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | Qwen/Qwen3-235B-A22B-Instruct-2507-FP8 closed weights | 93% ±0.2 | hf.co | Official leaderboard | ||
| 2 | | 92.5% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 3 | | 92.5% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 4 | | 92.3% ±0.4 | Jul 2024 | hf.co | Official leaderboard | |
| 5 | NovaSky-AI/Sky-T1-32B-Preview open weights | 92.3% ±0.3 | hf.co | Official leaderboard | ||
| 6 | | 92.1% ±0.3 | Sep 2025 | hf.co | Official leaderboard | |
| 7 | | 92.1% ±0.2 | Dec 2024 | hf.co | Official leaderboard | |
| 8 | ThatsGroes/gemma-2-27b-it-FP8-Dynamic open weights | 92% ±0.3 | hf.co | Official leaderboard | ||
| 9 | | 91.9% ±0.4 | Sep 2025 | hf.co | Official leaderboard | |
| 10 | | 91.9% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 11 | | 91.9% ±0.1 | Apr 2024 | hf.co | Official leaderboard | |
| 12 | | 91.8% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 13 | | 91.7% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 14 | | 91.7% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 15 | | 91.7% ±0.1 | Jul 2024 | hf.co | Official leaderboard | |
| 16 | allenai/Olmo-3.1-32B-Instruct-DPO open weights | 91.6% ±0.4 | hf.co | Official leaderboard | ||
| 17 | | 91.5% ±0.3 | Nov 2024 | hf.co | Official leaderboard | |
| 18 | allenai/Llama-3.1-Tulu-3-8B-DPO open weights | 91.5% ±0.3 | hf.co | Official leaderboard | ||
| 19 | | 91.4% ±0.4 | Dec 2025 | hf.co | Official leaderboard | |
| 20 | Qwen/Qwen3-235B-A22B-Thinking-2507-FP8 closed weights | 91.4% ±0.3 | hf.co | Official leaderboard | ||
| 21 | | 91.4% ±0.4 | Jun 2025 | hf.co | Official leaderboard | |
| 22 | 01-ai/Yi-1.5-9B open weights | 91.4% ±0.4 | hf.co | Official leaderboard | ||
| 23 | ai21labs/Jamba-v0.1 open weights | 91.4% ±0.7 | hf.co | Official leaderboard | ||
| 24 | allenai/Llama-3.1-Tulu-3.1-8B open weights | 91.4% ±0.3 | hf.co | Official leaderboard | ||
| 25 | | 91.3% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 26 | | 91.3% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 27 | google/gemma-2-9b-it open weights | 91.3% ±0.4 | hf.co | Official leaderboard | ||
| 28 | | 91.3% ±0.4 | Oct 2024 | hf.co | Official leaderboard | |
| 29 | google/gemma-2-27b-it open weights | 91.3% ±0.4 | hf.co | Official leaderboard | ||
| 30 | LumiOpen/Llama-Poro-2-70B-SFT open weights | 91.2% ±0.4 | hf.co | Official leaderboard | ||
| 31 | | 91.2% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 32 | mistralai/Magistral-Small-2509 open weights | 91.1% ±0.4 | hf.co | Official leaderboard | ||
| 33 | deepcogito/cogito-v2-preview-llama-70B open weights | 91.1% ±0.4 | hf.co | Official leaderboard | ||
| 34 | meta-llama/Llama-3.1-405B-Instruct-FP8 open weights | 91.1% ±0.4 | hf.co | Official leaderboard | ||
| 35 | | 91% ±0.6 | Dec 2023 | hf.co | Official leaderboard | |
| 36 | deepcogito/cogito-v1-preview-qwen-32B open weights | 91% ±0.4 | hf.co | Official leaderboard | ||
| 37 | meta-llama/Llama-4-Scout-17B-16E open weights | 90.9% ±0.7 | hf.co | Official leaderboard | ||
| 38 | GLM-4.5-Air | 90.8% ±0.4 | thinking | Jul 2025 | hf.co | Official leaderboard |
| 39 | | 90.8% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 40 | meta-llama/Llama-3.1-70B-Instruct open weights | 90.8% ±0.4 | hf.co | Official leaderboard | ||
| 41 | | 90.7% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 42 | mistralai/Mistral-Small-24B-Instruct-2501 open weights | 90.7% ±0.4 | hf.co | Official leaderboard | ||
| 43 | Reka Flash 3 | 90.7% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 44 | | 90.7% ±0.4 | Sep 2024 | hf.co | Official leaderboard | |
| 45 | | 90.7% ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 46 | | 90.7% ±0.5 | Apr 2024 | hf.co | Official leaderboard | |
| 47 | | 90.7% ±0.9 | Mar 2025 | hf.co | Official leaderboard | |
| 48 | utter-project/EuroLLM-22B-Instruct-Preview open weights | 90.6% ±0.3 | hf.co | Official leaderboard | ||
| 49 | speakleash/Bielik-11B-v2.3-Instruct open weights | 90.5% ±0.3 | hf.co | Official leaderboard | ||
| 50 | | 90.5% ±0.3 | thinking | Sep 2025 | hf.co | Official leaderboard |
| 51 | | 90.5% ±0.5 | Sep 2023 | hf.co | Official leaderboard | |
| 52 | tiiuae/falcon-11B open weights | 90.5% ±0.3 | hf.co | Official leaderboard | ||
| 53 | | 90.5% ±1.4 | Jul 2023 | hf.co | Official leaderboard | |
| 54 | allenai/Olmo-3.1-32B-Instruct-SFT open weights | 90.4% ±0.3 | hf.co | Official leaderboard | ||
| 55 | utter-project/EuroLLM-22B-Instruct-2512 open weights | 90.4% ±0.2 | hf.co | Official leaderboard | ||
| 56 | bullerwins/Magistral-Small-2506-fp8 open weights | 90.3% ±0.6 | hf.co | Official leaderboard | ||
| 57 | utter-project/EuroLLM-22B-Preview open weights | 90.3% ±0.4 | hf.co | Official leaderboard | ||
| 58 | | 90.2% ±0.6 | Jun 2024 | hf.co | Official leaderboard | |
| 59 | deepcogito/cogito-v1-preview-llama-8B open weights | 90.2% ±0.3 | hf.co | Official leaderboard | ||
| 60 | meta-llama/Llama-2-13b-hf open weights | 90.2% ±0.8 | hf.co | Official leaderboard | ||
| 61 | | 90.2% ±0.4 | Mar 2024 | hf.co | Official leaderboard | |
| 62 | Granite 4.0 H Small | 90.2% ±0.3 | Oct 2025 | hf.co | Official leaderboard | |
| 63 | | 90.2% ±0.5 | Jul 2024 | hf.co | Official leaderboard | |
| 64 | GLM-4.1V-9B-Thinking | 90.2% ±0.3 | Jul 2025 | hf.co | Official leaderboard | |
| 65 | | 90.1% ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 66 | meta-llama/Meta-Llama-3-70B-Instruct open weights | 90.1% ±0.5 | hf.co | Official leaderboard | ||
| 67 | c4ai-command-r-08-2024 | 90.1% ±0.4 | Aug 2024 | hf.co | Official leaderboard | |
| 68 | | 90% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 69 | | 90% ±0.3 | no-thinking | Dec 2025 | hf.co | Official leaderboard |
| 70 | ChocoLlama/Llama-3-ChocoLlama-8B-instruct open weights | 90% ±0.4 | hf.co | Official leaderboard | ||
| 71 | meta-llama/Llama-3.1-8B-Instruct open weights | 90% ±0.3 | hf.co | Official leaderboard | ||
| 72 | deepcogito/cogito-v1-preview-qwen-14B open weights | 90% ±0.5 | hf.co | Official leaderboard | ||
| 73 | occiglot/occiglot-7b-eu5 open weights | 89.9% ±0.7 | hf.co | Official leaderboard | ||
| 74 | BSC-LT/salamandra-7b open weights | 89.9% ±0.5 | hf.co | Official leaderboard | ||
| 75 | Reka Flash 3.1 | 89.9% ±0.4 | May 2025 | hf.co | Official leaderboard | |
| 76 | | 89.9% ±0.6 | May 2024 | hf.co | Official leaderboard | |
| 77 | LumiOpen/Llama-Poro-2-70B-Instruct open weights | 89.8% ±0.5 | hf.co | Official leaderboard | ||
| 78 | | 89.8% ±0.4 | Jan 2025 | hf.co | Official leaderboard | |
| 79 | LumiOpen/Viking-33B open weights | 89.7% ±0.5 | hf.co | Official leaderboard | ||
| 80 | HuggingFaceTB/SmolLM3-3B-Base open weights | 89.7% ±0.7 | hf.co | Official leaderboard | ||
| 81 | | 89.7% ±0.3 | Dec 2024 | hf.co | Official leaderboard | |
| 82 | | 89.7% ±0.6 | Apr 2025 | hf.co | Official leaderboard | |
| 83 | | 89.6% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 84 | | 89.5% ±0.5 | Feb 2024 | hf.co | Official leaderboard | |
| 85 | allenai/OLMo-2-0325-32B open weights | 89.3% ±0.4 | hf.co | Official leaderboard | ||
| 86 | ibm-granite/granite-4.0-h-tiny open weights | 89.3% ±0.6 | hf.co | Official leaderboard | ||
| 87 | occiglot/occiglot-7b-eu5-instruct open weights | 89.3% ±0.6 | hf.co | Official leaderboard | ||
| 88 | mistralai/Mixtral-8x7B-Instruct-v0.1 open weights | 89.2% ±0.5 | hf.co | Official leaderboard | ||
| 89 | 152334H/miqu-1-70b-sf open weights | 89.2% ±0.3 | hf.co | Official leaderboard | ||
| 90 | ibm-granite/granite-3.0-3b-a800m-base open weights | 89.2% ±0.7 | hf.co | Official leaderboard | ||
| 91 | meta-llama/Meta-Llama-3-8B-Instruct open weights | 89.2% ±0.7 | hf.co | Official leaderboard | ||
| 92 | ibm-granite/granite-4.0-h-micro open weights | 89.1% ±0.4 | hf.co | Official leaderboard | ||
| 93 | Granite-3.0-2B-Base | 89.1% ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 94 | utter-project/EuroLLM-9B-Instruct open weights | 89% ±0.5 | hf.co | Official leaderboard | ||
| 95 | | 89% ±0.4 | Jun 2025 | hf.co | Official leaderboard | |
| 96 | CohereForAI/aya-23-8B open weights | 89% ±0.6 | hf.co | Official leaderboard | ||
| 97 | mistralai/Ministral-3-8B-Reasoning-2512 open weights | 89% ±0.5 | hf.co | Official leaderboard | ||
| 98 | mistralai/Mistral-Nemo-Instruct-2407 open weights | 89% ±0.6 | hf.co | Official leaderboard | ||
| 99 | mistralai/Ministral-8B-Instruct-2410 open weights | 89% ±0.4 | hf.co | Official leaderboard | ||
| 100 | meta-llama/Llama-2-7b-hf open weights | 88.9% ±0.8 | hf.co | Official leaderboard | ||
| 101 | typesafe/jev-1.13.0 closed weights | 88.9% ±0.3 | zero-shot | docs.typesafe.ai | Official leaderboard | |
| 102 | allenai/Olmo-3-1025-7B open weights | 88.8% ±0.4 | hf.co | Official leaderboard | ||
| 103 | allenai/Olmo-3-1125-32B open weights | 88.8% ±0.6 | hf.co | Official leaderboard | ||
| 104 | | 88.8% ±0.4 | Sep 2024 | hf.co | Official leaderboard | |
| 105 | | 88.8% ±0.5 | Jan 2025 | hf.co | Official leaderboard | |
| 106 | allenai/OLMo-2-1124-13B-Instruct open weights | 88.7% ±0.4 | hf.co | Official leaderboard | ||
| 107 | | 88.6% ±0.5 | Jun 2025 | hf.co | Official leaderboard | |
| 108 | | 88.5% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 109 | | 88.5% ±0.3 | Dec 2025 | hf.co | Official leaderboard | |
| 110 | utter-project/EuroLLM-22B-2512 open weights | 88.5% ±2.1 | hf.co | Official leaderboard | ||
| 111 | BramVanroy/GEITje-7B-ultra open weights | 88.5% ±0.6 | hf.co | Official leaderboard | ||
| 112 | ibm-granite/granite-3.0-3b-a800m-instruct open weights | 88.4% ±0.4 | hf.co | Official leaderboard | ||
| 113 | | 88.4% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 114 | NousResearch/DeepHermes-3-Llama-3-8B-Preview open weights | 88.4% ±0.5 | hf.co | Official leaderboard | ||
| 115 | deepseek-r1-0528-qwen3-8b | 88.4% ±0.3 | May 2025 | hf.co | Official leaderboard | |
| 116 | | 88.3% ±0.9 | Feb 2024 | hf.co | Official leaderboard | |
| 117 | allenai/Llama-3.1-Tulu-3-8B-SFT open weights | 88.2% ±0.4 | hf.co | Official leaderboard | ||
| 118 | Granite-3.0-8B-Instruct | 88.1% ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 119 | mistralai/Mistral-Small-3.1-24B-Base-2503 open weights | 88.1% ±2.7 | hf.co | Official leaderboard | ||
| 120 | | 88% ±0.8 | Sep 2023 | hf.co | Official leaderboard | |
| 121 | allenai/OLMo-2-1124-13B open weights | 88% ±0.5 | hf.co | Official leaderboard | ||
| 122 | neuralmagic/Sparse-Llama-3.1-8B-2of4 open weights | 88% ±0.3 | hf.co | Official leaderboard | ||
| 123 | Granite-3.0-8B-Base | 88% ±0.9 | Oct 2024 | hf.co | Official leaderboard | |
| 124 | gpt-oss-20b | 87.9% ±0.3 | medium | Aug 2025 | hf.co | Official leaderboard |
| 125 | norallm/normistral-11b-warm open weights | 87.8% ±0.5 | hf.co | Official leaderboard | ||
| 126 | upstage/SOLAR-10.7B-v1.0 open weights | 87.8% ±0.6 | hf.co | Official leaderboard | ||
| 127 | 01-ai/Yi-1.5-6B open weights | 87.8% ±0.7 | hf.co | Official leaderboard | ||
| 128 | | 87.7% ±0.5 | Dec 2024 | hf.co | Official leaderboard | |
| 129 | CohereForAI/aya-23-35B open weights | 87.6% ±0.5 | hf.co | Official leaderboard | ||
| 130 | nvidia/mistral-nemo-minitron-8b-base open weights | 87.6% ±0.9 | hf.co | Official leaderboard | ||
| 131 | swiss-ai/Apertus-8B-2509 open weights | 87.5% ±0.8 | hf.co | Official leaderboard | ||
| 132 | ibm-granite/granite-34b-code-base open weights | 87.5% ±0.4 | hf.co | Official leaderboard | ||
| 133 | | 87.5% ±0.4 | Feb 2024 | hf.co | Official leaderboard | |
| 134 | google/gemma-2-2b open weights | 87.5% ±0.9 | hf.co | Official leaderboard | ||
| 135 | mistralai/Voxtral-Mini-3B-2507 open weights | 87.4% ±0.4 | hf.co | Official leaderboard | ||
| 136 | granite-4.0-micro | 87.2% ±0.7 | Oct 2025 | hf.co | Official leaderboard | |
| 137 | meta-llama/Llama-3.2-3B-Instruct open weights | 87.1% ±0.4 | hf.co | Official leaderboard | ||
| 138 | utter-project/EuroLLM-9B open weights | 86.9% ±1.9 | hf.co | Official leaderboard | ||
| 139 | tiiuae/Falcon3-7B-Base open weights | 86.9% ±0.3 | hf.co | Official leaderboard | ||
| 140 | deepcogito/cogito-v1-preview-llama-3B open weights | 86.7% ±0.8 | hf.co | Official leaderboard | ||
| 141 | nvidia/mistral-nemo-minitron-8b-instruct open weights | 86.6% ±0.6 | hf.co | Official leaderboard | ||
| 142 | | 86.6% ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 143 | HuggingFaceTB/SmolLM3-3B open weights | 86.6% ±0.7 | no-thinking | hf.co | Official leaderboard | |
| 144 | mistralai/Ministral-3-3B-Base-2512 open weights | 86.5% ±1 | hf.co | Official leaderboard | ||
| 145 | | 86.5% ±1 | Feb 2024 | hf.co | Official leaderboard | |
| 146 | | 86.5% ±0.6 | Dec 2023 | hf.co | Official leaderboard | |
| 147 | qwen3-4b-instruct-2507 | 86.3% ±0.7 | Aug 2025 | hf.co | Official leaderboard | |
| 148 | TrustLLMeu/baseline-7-8b_2-3t-tokens_llama open weights | 86.2% ±1.1 | hf.co | Official leaderboard | ||
| 149 | Granite-3.0-2B-Instruct | 86.1% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 150 | | 86.1% ±1 | Mar 2025 | hf.co | Official leaderboard | |
| 151 | BSC-LT/salamandra-7b-instruct open weights | 86.1% ±0.5 | hf.co | Official leaderboard | ||
| 152 | mii-llm/nesso-4B open weights | 86% ±0.9 | hf.co | Official leaderboard | ||
| 153 | allenai/OLMo-2-1124-7B-Instruct open weights | 85.9% ±0.5 | hf.co | Official leaderboard | ||
| 154 | stabilityai/stablelm-2-1_6b open weights | 85.8% ±0.6 | hf.co | Official leaderboard | ||
| 155 | speakleash/Bielik-One-4B-r1@567d29b0f15df28794acf0f6187f9216860d4551 open weights | 85.8% ±0.2 | zero-shot | hf.co | Official leaderboard | |
| 156 | | 85.6% ±0.6 | Mar 2024 | hf.co | Official leaderboard | |
| 157 | nvidia-nemotron-nano-9b-v2 | 85.6% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 158 | ibm-granite/granite-34b-code-instruct open weights | 85.4% ±0.4 | hf.co | Official leaderboard | ||
| 159 | speakleash/Bielik-One-11B-v3.1-r1@75a2d83890e3c68bf7fac2fe5bbe2bff6372036c open weights | 85.3% ±0.3 | zero-shot | hf.co | Official leaderboard | |
| 160 | | 85.3% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 161 | | 85.3% ±5.9 | Jun 2024 | hf.co | Official leaderboard | |
| 162 | intfloat/multilingual-e5-large open weights | 85.3% ±0.5 | hf.co | Official leaderboard | ||
| 163 | ibm-granite/granite-20b-code-base open weights | 85.3% ±0.7 | hf.co | Official leaderboard | ||
| 164 | NorwAI/NorwAI-Mistral-7B open weights | 85.2% ±0.9 | hf.co | Official leaderboard | ||
| 165 | allenai/OLMo-2-1124-7B open weights | 85.1% ±0.8 | hf.co | Official leaderboard | ||
| 166 | TildeAI/TildeOpen-30b open weights | 85.1% ±0.9 | slow-tokenizer | hf.co | Official leaderboard | |
| 167 | ollama_chat/gemma3:4b-it-q4_K_M open weights | 85% ±0.6 | ollama.com | Official leaderboard | ||
| 168 | google/rembert open weights | 85% ±0.5 | hf.co | Official leaderboard | ||
| 169 | | 84.9% ±0.8 | Jul 2024 | hf.co | Official leaderboard | |
| 170 | | 84.8% ±0.6 | Jul 2025 | hf.co | Official leaderboard | |
| 171 | baidu/ERNIE-4.5-21B-A3B-PT open weights | 84.8% ±1 | hf.co | Official leaderboard | ||
| 172 | senseable/WestLake-7B-v2 open weights | 84.7% ±0.7 | hf.co | Official leaderboard | ||
| 173 | LumiOpen/Viking-13B open weights | 84.6% ±1 | hf.co | Official leaderboard | ||
| 174 | speakleash/Bielik-11B-v2.6-Instruct open weights | 84.5% ±0.8 | hf.co | Official leaderboard | ||
| 175 | meta-llama/Llama-2-13b-chat-hf open weights | 84.4% ±1.6 | hf.co | Official leaderboard | ||
| 176 | | 84.3% ±0.7 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 177 | meta-llama/Llama-2-70b-chat-hf open weights | 84.2% ±2.2 | hf.co | Official leaderboard | ||
| 178 | | 84.2% ±1 | Sep 2025 | hf.co | Official leaderboard | |
| 179 | TrustLLMeu/baseline-7-8b_1t-tokens_llama open weights | 84.1% ±1.1 | hf.co | Official leaderboard | ||
| 180 | MaLA-LM/emma-500-llama2-7b open weights | 83.9% ±0.8 | hf.co | Official leaderboard | ||
| 181 | TrustLLMeu/trustllm-v2-8b-midtrain@3c7af30bc43bb3c8607e0fab6e7f2a23dd64af49 open weights | 83.8% ±0.5 | hf.co | Official leaderboard | ||
| 182 | Qwen/Qwen1.5-4B open weights | 83.7% ±0.5 | hf.co | Official leaderboard | ||
| 183 | | 83.7% ±0.9 | Sep 2023 | hf.co | Official leaderboard | |
| 184 | ollama_chat/hf.co/google/gemma-3-4b-it-qat-q4_0-gguf open weights | 83.2% ±0.7 | ollama.com | Official leaderboard | ||
| 185 | | 82.9% ±0.5 | Dec 2025 | hf.co | Official leaderboard | |
| 186 | arcee-ai/AFM-4.5B-Base open weights | 82.9% ±0.6 | hf.co | Official leaderboard | ||
| 187 | | 82.9% ±0.7 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 188 | ChocoLlama/ChocoLlama-2-7B-base open weights | 82.8% ±1.2 | hf.co | Official leaderboard | ||
| 189 | Qwen/Qwen2.5-Math-7B open weights | 82.7% ±0.6 | hf.co | Official leaderboard | ||
| 190 | ibm-granite/granite-7b-base open weights | 82.4% ±1 | hf.co | Official leaderboard | ||
| 191 | | 82.3% ±0.6 | Feb 2024 | hf.co | Official leaderboard | |
| 192 | ChocoLlama/Llama-3-ChocoLlama-8B-base open weights | 81.5% ±2.1 | hf.co | Official leaderboard | ||
| 193 | EuroBERT/EuroBERT-610m open weights | 81% ±1 | hf.co | Official leaderboard | ||
| 194 | | 80.6% ±1.5 | Sep 2024 | hf.co | Official leaderboard | |
| 195 | Qwen/Qwen2.5-1.5B-Instruct open weights | 80.1% ±0.9 | hf.co | Official leaderboard | ||
| 196 | ibm-granite/granite-8b-code-base-4k open weights | 80.1% ±0.6 | hf.co | Official leaderboard | ||
| 197 | jhu-clsp/mmBERT-base open weights | 80% ±0.8 | hf.co | Official leaderboard | ||
| 198 | allenai/Olmo-3-7B-Instruct open weights | 79.9% ±0.6 | hf.co | Official leaderboard | ||
| 199 | allenai/Olmo-3-7B-Instruct-DPO open weights | 79.8% ±0.7 | hf.co | Official leaderboard | ||
| 200 | allenai/Olmo-3-7B-Think open weights | 79.6% ±0.9 | hf.co | Official leaderboard | ||
| 201 | ibm-granite/granite-8b-code-instruct-4k open weights | 79.5% ±1.2 | hf.co | Official leaderboard | ||
| 202 | | 79.4% ±0.6 | Apr 2024 | hf.co | Official leaderboard | |
| 203 | allenai/Olmo-3-7B-Instruct-SFT open weights | 79.1% ±1.2 | hf.co | Official leaderboard | ||
| 204 | | 78.7% ±1.3 | Mar 2026 | hf.co | Official leaderboard | |
| 205 | LiquidAI/LFM2-2.6B open weights | 78.7% ±0.6 | hf.co | Official leaderboard | ||
| 206 | OmniJev/OneJev1.6-0.8B open weights | 78.1% ±0.3 | zero-shot | hf.co | Official leaderboard | |
| 207 | setu4993/LaBSE open weights | 77.2% ±0.6 | hf.co | Official leaderboard | ||
| 208 | deepseek-ai/DeepSeek-R1-Distill-Llama-8B open weights | 77% ±1.4 | hf.co | Official leaderboard | ||
| 209 | intfloat/multilingual-e5-base open weights | 77% ±1.1 | hf.co | Official leaderboard | ||
| 210 | TrustLLMeu/trustllm-v2-8b-sft-mixb2-exp@f33c260efa853437a55d780ce5b910944b1395f6 open weights | 75.2% ±1.9 | hf.co | Official leaderboard | ||
| 211 | | 74.9% ±0.9 | Jul 2025 | hf.co | Official leaderboard | |
| 212 | ZurichNLP/unsup-simcse-xlm-roberta-base open weights | 74.9% ±0.5 | hf.co | Official leaderboard | ||
| 213 | syvai/claes-preview open weights | 74.8% ±0.3 | zero-shot | hf.co | Official leaderboard | |
| 214 | EuroBERT/EuroBERT-210m open weights | 74.6% ±1.7 | hf.co | Official leaderboard | ||
| 215 | timpal0l/Mistral-7B-v0.1-flashback-v2 open weights | 74.5% ±1.6 | hf.co | Official leaderboard | ||
| 216 | | 74.4% ±0.9 | Jan 2025 | hf.co | Official leaderboard | |
| 217 | | 74.3% ±1.5 | Oct 2024 | hf.co | Official leaderboard | |
| 218 | | 74.1% ±1 | Oct 2024 | hf.co | Official leaderboard | |
| 219 | | 74.1% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 220 | ibm-granite/granite-3.0-1b-a400m-base open weights | 73.4% ±0.9 | hf.co | Official leaderboard | ||
| 221 | TrustLLMeu/trustllm-v2-8b-sft-8k@2aadff8653393e41abf583222164e279461a619f open weights | 73.2% ±3.1 | hf.co | Official leaderboard | ||
| 222 | TrustLLMeu/trustllm-v2-8b-sft@f442f651172c1a97143738fc30c3a6342d1e8660 open weights | 72.2% ±3.1 | hf.co | Official leaderboard | ||
| 223 | TrustLLMeu/trustllm-v2-8b@d8cc924fa550fbf9474f5251e8e2f92d1c1bf894 open weights | 71.4% ±2.7 | hf.co | Official leaderboard | ||
| 224 | AI-Sweden-Models/ModernBERT-large open weights | 71.1% ±3.2 | hf.co | Official leaderboard | ||
| 225 | common-pile/comma-v0.1-2t open weights | 71% ±1.1 | hf.co | Official leaderboard | ||
| 226 | convaiinnovations/laya-multilingual open weights | 70.8% ±0.4 | zero-shot | hf.co | Official leaderboard | |
| 227 | ibm-granite/granite-20b-code-instruct open weights | 70.7% ±2.9 | hf.co | Official leaderboard | ||
| 228 | HPLT/gpt-13b-nordic-prerelease open weights | 70.2% ±1.6 | hf.co | Official leaderboard | ||
| 229 | jaredpalmer/kev-0.5b open weights | 70.1% ±0.4 | zero-shot | hf.co | Official leaderboard | |
| 230 | state-spaces/mamba-2.8b-hf open weights | 70% ±2.3 | hf.co | Official leaderboard | ||
| 231 | infly/OpenCoder-8B-Instruct open weights | 69.4% ±1.2 | hf.co | Official leaderboard | ||
| 232 | jhu-clsp/mmBERT-small open weights | 69.2% ±1.9 | hf.co | Official leaderboard | ||
| 233 | HPLT/hplt2c_nld_checkpoints open weights | 68.8% ±2.3 | hf.co | Official leaderboard | ||
| 234 | ChocoLlama/ChocoLlama-2-7B-tokentrans-base open weights | 68.5% ±6.6 | hf.co | Official leaderboard | ||
| 235 | FacebookAI/xlm-roberta-large open weights | 68.3% ±11.4 | hf.co | Official leaderboard | ||
| 236 | speakleash/Bielik-11B-v3-Base-20250730 open weights | 68% ±6.1 | hf.co | Official leaderboard | ||
| 237 | infly/OpenCoder-8B-Base open weights | 67.7% ±0.8 | hf.co | Official leaderboard | ||
| 238 | Qwen/Qwen1.5-1.8B-Chat open weights | 67.1% ±1.5 | hf.co | Official leaderboard | ||
| 239 | ChocoLlama/ChocoLlama-2-7B-instruct open weights | 66.9% ±3.8 | hf.co | Official leaderboard | ||
| 240 | utter-project/EuroMoE-2.6B-A0.6B-Preview open weights | 66.5% ±2.3 | hf.co | Official leaderboard | ||
| 241 | tencent/Hunyuan-7B-Instruct open weights | 66.4% ±0.9 | hf.co | Official leaderboard | ||
| 242 | arcee-ai/Trinity-Mini-Base open weights | 65.8% ±3.4 | hf.co | Official leaderboard | ||
| 243 | syvai/claes-v1 open weights | 65.8% ±0.4 | zero-shot | hf.co | Official leaderboard | |
| 244 | LFM2.5-1.2B-Instruct | 65.5% ±2 | Jan 2026 | hf.co | Official leaderboard | |
| 245 | common-pile/comma-v0.1-1t open weights | 65.1% ±0.6 | hf.co | Official leaderboard | ||
| 246 | fastino/GLiNER2.5-Decide open weights | 65% ±0.4 | zero-shot | hf.co | Official leaderboard | |
| 247 | ibm-granite/granite-3.0-1b-a400m-instruct open weights | 64.6% ±1.4 | hf.co | Official leaderboard | ||
| 248 | | 64.1% ±2.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 249 | openGPT-X/Teuken-7B-instruct-research-v0.4 open weights | 63.1% ±2.3 | hf.co | Official leaderboard | ||
| 250 | yulan-team/YuLan-Mini-Instruct open weights | 62.2% ±2.6 | hf.co | Official leaderboard | ||
| 251 | microsoft/mdeberta-v3-base open weights | 61.5% ±10.3 | hf.co | Official leaderboard | ||
| 252 | | 61% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 253 | openGPT-X/Teuken-7B-instruct-commercial-v0.4 open weights | 60.1% ±2 | hf.co | Official leaderboard | ||
| 254 | sentence-transformers/stsb-xlm-r-multilingual open weights | 59.6% ±0.6 | hf.co | Official leaderboard | ||
| 255 | google/gemma-2b-it open weights | 58.9% ±2.3 | hf.co | Official leaderboard | ||
| 256 | LiquidAI/LFM2.5-1.2B-Base open weights | 58.1% ±3 | hf.co | Official leaderboard | ||
| 257 | facebook/MobileLLM-R1-950M-base open weights | 58% ±1.1 | hf.co | Official leaderboard | ||
| 258 | | 56.4% ±4.8 | Mar 2025 | hf.co | Official leaderboard | |
| 259 | Twitter/twhin-bert-base open weights | 55.1% ±3.1 | hf.co | Official leaderboard | ||
| 260 | arcee-ai/Trinity-Nano-Base open weights | 54.9% ±7.3 | hf.co | Official leaderboard | ||
| 261 | swiss-ai/Apertus-v1.1-1.5B open weights | 53.2% ±0.3 | zero-shot | hf.co | Official leaderboard | |
| 262 | PleIAs/Pleias-3b-Preview open weights | 53.2% ±2.7 | hf.co | Official leaderboard | ||
| 263 | BSC-LT/ALIA-40b open weights | 53.1% ±8.2 | hf.co | Official leaderboard | ||
| 264 | meta-llama/Llama-2-7b-chat-hf open weights | 52.4% ±3.5 | hf.co | Official leaderboard | ||
| 265 | | 51.7% ±2.8 | Apr 2025 | hf.co | Official leaderboard | |
| 266 | ibm-granite/granite-3b-code-base-2k open weights | 49.6% ±3.2 | hf.co | Official leaderboard | ||
| 267 | google/gemma-7b-it open weights | 49.3% ±5.6 | hf.co | Official leaderboard | ||
| 268 | RuterNorway/Llama-2-7b-chat-norwegian open weights | 49.2% ±4.9 | hf.co | Official leaderboard | ||
| 269 | sentence-transformers/paraphrase-xlm-r-multilingual-v1 open weights | 48.3% ±6.4 | hf.co | Official leaderboard | ||
| 270 | PleIAs/Pleias-Nano open weights | 48.2% ±5.7 | hf.co | Official leaderboard | ||
| 271 | microsoft/xlm-align-base open weights | 47.7% ±12.1 | hf.co | Official leaderboard | ||
| 272 | tiiuae/Falcon3-3B-Base open weights | 46.9% ±1.2 | hf.co | Official leaderboard | ||
| 273 | NorwAI/NorwAI-Mixtral-8x7B-instruct open weights | 45% ±9.7 | hf.co | Official leaderboard | ||
| 274 | speakleash/Bielik-4.5B-v3.0-Instruct open weights | 44.8% ±14.9 | hf.co | Official leaderboard | ||
| 275 | tencent/Hunyuan-1.8B-Instruct open weights | 44.6% ±1.5 | hf.co | Official leaderboard | ||
| 276 | | 43% ±1.8 | Apr 2025 | hf.co | Official leaderboard | |
| 277 | sentence-transformers/paraphrase-multilingual-MiniLM-L12-v2 open weights | 40.3% ±5.9 | hf.co | Official leaderboard | ||
| 278 | | 38.7% ±0.9 | Dec 2024 | hf.co | Official leaderboard | |
| 279 | sentence-transformers/distiluse-base-multilingual-cased-v1 open weights | 38.5% ±4 | hf.co | Official leaderboard | ||
| 280 | LFM2-1.2B | 37.9% ±3 | Jul 2025 | hf.co | Official leaderboard | |
| 281 | PleIAs/Pleias-1.2b-Preview open weights | 37.6% ±4.4 | hf.co | Official leaderboard | ||
| 282 | sentence-transformers/distiluse-base-multilingual-cased open weights | 37.2% ±2.4 | hf.co | Official leaderboard | ||
| 283 | sentence-transformers/distiluse-base-multilingual-cased-v2 open weights | 37.2% ±2.4 | hf.co | Official leaderboard | ||
| 284 | speakleash/Bielik-1.5B-v3.0-Instruct open weights | 37.2% ±12.4 | hf.co | Official leaderboard | ||
| 285 | distilbert/distilbert-base-multilingual-cased open weights | 35% ±5.1 | hf.co | Official leaderboard | ||
| 286 | | 33.9% ±1.4 | Jan 2025 | hf.co | Official leaderboard | |
| 287 | sentence-transformers/quora-distilbert-multilingual open weights | 33.9% ±3.6 | hf.co | Official leaderboard | ||
| 288 | sentence-transformers/distilbert-multilingual-nli-stsb-quora-ranking open weights | 33.8% ±3.6 | hf.co | Official leaderboard | ||
| 289 | answerdotai/ModernBERT-base open weights | 33.5% ±2.7 | hf.co | Official leaderboard | ||
| 290 | LFM2.5-1.2B-Thinking | 33.1% ±3.3 | Jan 2026 | hf.co | Official leaderboard | |
| 291 | AI-Sweden-Models/gpt-sw3-20b open weights | 32.8% ±3.1 | hf.co | Official leaderboard | ||
| 292 | Twitter/twhin-bert-large open weights | 31.2% ±9.9 | hf.co | Official leaderboard | ||
| 293 | AI-Sweden-Models/gpt-sw3-20b-instruct open weights | 30.1% ±5.4 | hf.co | Official leaderboard | ||
| 294 | EuropeanParliament/EUBERT open weights | 29.5% ±1.2 | hf.co | Official leaderboard | ||
| 295 | Geotrend/distilbert-base-25lang-cased open weights | 29.5% ±5.4 | hf.co | Official leaderboard | ||
| 296 | answerdotai/ModernBERT-large open weights | 28.3% ±4.3 | hf.co | Official leaderboard | ||
| 297 | AI-Sweden-Models/roberta-large-1160k open weights | 27.5% ±4.5 | hf.co | Official leaderboard | ||
| 298 | facebook/MobileLLM-R1-360M-base open weights | 27.5% ±1.9 | hf.co | Official leaderboard | ||
| 299 | Qwen/Qwen1.5-1.8B open weights | 27.3% ±4 | hf.co | Official leaderboard | ||
| 300 | arcee-ai/Trinity-Nano-Preview open weights | 27% ±4.9 | hf.co | Official leaderboard | ||
| 301 | Qwen/Qwen2.5-Math-1.5B open weights | 26.7% ±3.4 | hf.co | Official leaderboard | ||
| 302 | infly/OpenCoder-1.5B-Instruct open weights | 25.5% ±3.2 | hf.co | Official leaderboard | ||
| 303 | cardiffnlp/twitter-xlm-roberta-base open weights | 25.4% ±7.7 | hf.co | Official leaderboard | ||
| 304 | | 24.2% ±2.7 | Dec 2023 | hf.co | Official leaderboard | |
| 305 | AI-Sweden-Models/bert-large-nordic-pile-1M-steps open weights | 23.9% ±2.6 | hf.co | Official leaderboard | ||
| 306 | ibm-granite/granite-3b-code-instruct-2k open weights | 23.6% ±4.8 | hf.co | Official leaderboard | ||
| 307 | convaiinnovations/laya open weights | 22.1% ±0.8 | zero-shot | hf.co | Official leaderboard | |
| 308 | | 21.8% ±4.4 | Aug 2025 | hf.co | Official leaderboard | |
| 309 | meta-llama/Llama-3.2-1B-Instruct open weights | 17.8% ±3.5 | hf.co | Official leaderboard | ||
| 310 | | 17.5% ±4.4 | Apr 2025 | hf.co | Official leaderboard | |
| 311 | HPLT/hplt2c_eng_checkpoints open weights | 14.9% ±2.8 | hf.co | Official leaderboard | ||
| 312 | | 14.6% ±3.4 | Oct 2024 | hf.co | Official leaderboard | |
| 313 | LiquidAI/LFM2-350M open weights | 13.7% ±3.3 | hf.co | Official leaderboard | ||
| 314 | dbmdz/bert-base-historic-multilingual-cased open weights | 13.6% ±2.1 | hf.co | Official leaderboard | ||
| 315 | LiquidAI/LFM2-700M open weights | 13.2% ±1.5 | hf.co | Official leaderboard | ||
| 316 | Qwen/Qwen1.5-0.5B-Chat open weights | 13.2% ±3.6 | hf.co | Official leaderboard | ||
| 317 | Qwen/Qwen1.5-0.5B open weights | 10.9% ±2.3 | hf.co | Official leaderboard | ||
| 318 | utter-project/EuroVLM-1.7B-Preview open weights | 10.3% ±1.7 | hf.co | Official leaderboard | ||
| 319 | PleIAs/Pleias-Pico open weights | 9.67% ±1.9 | hf.co | Official leaderboard | ||
| 320 | fresh-xlm-roberta-base open weights | 9.54% ±4 | Official leaderboard | |||
| 321 | PleIAs/Pleias-350m-Preview open weights | 8.96% ±3.2 | hf.co | Official leaderboard | ||
| 322 | baidu/ERNIE-4.5-0.3B-PT open weights | 7.64% ±1.7 | hf.co | Official leaderboard | ||
| 323 | HPLT/hplt2c_deu_checkpoints open weights | 6.87% ±1.8 | hf.co | Official leaderboard | ||
| 324 | facebook/MobileLLM-R1-140M-base open weights | 6.81% ±1.2 | hf.co | Official leaderboard | ||
| 325 | utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview open weights | 5.61% ±1.4 | hf.co | Official leaderboard | ||
| 326 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Base open weights | 4.28% ±1 | hf.co | Official leaderboard | ||
| 327 | DiscoResearch/DiscoLM-70b open weights | 3.50% ±0.5 | hf.co | Official leaderboard | ||
| 328 | AI-Sweden-Models/gpt-sw3-356m-instruct open weights | 2.62% ±1.5 | hf.co | Official leaderboard | ||
| 329 | dbmdz/bert-tiny-historic-multilingual-cased open weights | 2.13% ±1 | hf.co | Official leaderboard | ||
| 330 | | 1.78% ±1.4 | Oct 2024 | hf.co | Official leaderboard | |
| 331 | tiiuae/Falcon-H1-Tiny-Multilingual-100M-Instruct open weights | 0.91% ±0.5 | hf.co | Official leaderboard | ||
| 332 | PleIAs/Baguettotron@refs/pr/6 open weights | 0.86% ±1.1 | no-thinking | hf.co | Official leaderboard | |
| 333 | AI-Sweden-Models/gpt-sw3-126m-instruct open weights | 0.67% ±0.8 | hf.co | Official leaderboard | ||
| 334 | AI-Sweden-Models/gpt-sw3-356m open weights | 0.38% ±3.2 | hf.co | Official leaderboard | ||
| 335 | fresh-electra-small open weights | 0.23% ±0.2 | Official leaderboard | |||
| 336 | infly/OpenCoder-1.5B-Base open weights | 0.23% ±0.8 | hf.co | Official leaderboard | ||
| 337 | facebook/MobileLLM-R1-360M open weights | 0.06% ±0.4 | hf.co | Official leaderboard | ||
| 338 | ChocoLlama/ChocoLlama-2-7B-tokentrans-instruct open weights | 0% | hf.co | Official leaderboard | ||
| 339 | facebook/MobileLLM-R1-950M open weights | 0% | hf.co | Official leaderboard | ||
| 340 | kyutai/helium-1-2b open weights | 0% | hf.co | Official leaderboard | ||
| 341 | openai-community/gpt2 open weights | 0% | hf.co | Official leaderboard | ||
| 342 | openai-community/gpt2-large open weights | 0% | hf.co | Official leaderboard | ||
| 343 | openai-community/gpt2-medium open weights | 0% | hf.co | Official leaderboard | ||
| 344 | Shekswess/trlm-135m open weights | 0% | hf.co | Official leaderboard | ||
| 345 | facebook/MobileLLM-R1-140M open weights | -0.76% ±0.6 | hf.co | Official leaderboard | ||
| 346 | HuggingFaceTB/SmolLM2-135M-Instruct open weights | -0.98% ±0.9 | hf.co | Official leaderboard | ||
| 347 | PleIAs/Monad open weights | -1.28% ±0.9 | hf.co | Official leaderboard | ||
| 348 | AI-Sweden-Models/gpt-sw3-126m open weights | -1.60% ±1.9 | hf.co | Official leaderboard | ||
| 349 | ibm-granite/granite-7b-instruct open weights | -2.34% ±1.8 | hf.co | Official leaderboard | ||
| 350 | ssmits/Falcon2-5.5B-multilingual open weights | -4.94% ±1.3 | hf.co | Official leaderboard | ||
| 351 | HuggingFaceTB/SmolLM2-360M-Instruct open weights | -6.52% ±2.4 | hf.co | Official leaderboard | ||
| 352 | RJuro/kanelsnegl-v0.1 open weights | -13.48% ±2 | hf.co | Official leaderboard |
| # | Model | Score ± | Setting | Date | Link | Source |
|---|---|---|---|---|---|---|
| 1 | | 92.5% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 2 | | 92.5% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 3 | | 92.3% ±0.4 | Jul 2024 | hf.co | Official leaderboard | |
| 4 | | 92.1% ±0.3 | Sep 2025 | hf.co | Official leaderboard | |
| 5 | | 92.1% ±0.2 | Dec 2024 | hf.co | Official leaderboard | |
| 6 | | 91.9% ±0.4 | Sep 2025 | hf.co | Official leaderboard | |
| 7 | | 91.9% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 8 | | 91.9% ±0.1 | Apr 2024 | hf.co | Official leaderboard | |
| 9 | | 91.8% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 10 | | 91.7% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 11 | | 91.7% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 12 | | 91.7% ±0.1 | Jul 2024 | hf.co | Official leaderboard | |
| 13 | | 91.5% ±0.3 | Nov 2024 | hf.co | Official leaderboard | |
| 14 | | 91.4% ±0.4 | Dec 2025 | hf.co | Official leaderboard | |
| 15 | | 91.4% ±0.4 | Jun 2025 | hf.co | Official leaderboard | |
| 16 | | 91.3% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 17 | | 91.3% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 18 | | 91.3% ±0.4 | Oct 2024 | hf.co | Official leaderboard | |
| 19 | | 91.2% ±0.5 | Mar 2025 | hf.co | Official leaderboard | |
| 20 | | 91% ±0.6 | Dec 2023 | hf.co | Official leaderboard | |
| 21 | GLM-4.5-Air | 90.8% ±0.4 | thinking | Jul 2025 | hf.co | Official leaderboard |
| 22 | | 90.8% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 23 | | 90.7% ±0.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 24 | Reka Flash 3 | 90.7% ±0.3 | Mar 2025 | hf.co | Official leaderboard | |
| 25 | | 90.7% ±0.4 | Sep 2024 | hf.co | Official leaderboard | |
| 26 | | 90.7% ±0.4 | Jul 2025 | hf.co | Official leaderboard | |
| 27 | | 90.7% ±0.5 | Apr 2024 | hf.co | Official leaderboard | |
| 28 | | 90.7% ±0.9 | Mar 2025 | hf.co | Official leaderboard | |
| 29 | | 90.5% ±0.3 | thinking | Sep 2025 | hf.co | Official leaderboard |
| 30 | | 90.5% ±0.5 | Sep 2023 | hf.co | Official leaderboard | |
| 31 | | 90.5% ±1.4 | Jul 2023 | hf.co | Official leaderboard | |
| 32 | | 90.2% ±0.6 | Jun 2024 | hf.co | Official leaderboard | |
| 33 | | 90.2% ±0.4 | Mar 2024 | hf.co | Official leaderboard | |
| 34 | Granite 4.0 H Small | 90.2% ±0.3 | Oct 2025 | hf.co | Official leaderboard | |
| 35 | | 90.2% ±0.5 | Jul 2024 | hf.co | Official leaderboard | |
| 36 | GLM-4.1V-9B-Thinking | 90.2% ±0.3 | Jul 2025 | hf.co | Official leaderboard | |
| 37 | | 90.1% ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 38 | c4ai-command-r-08-2024 | 90.1% ±0.4 | Aug 2024 | hf.co | Official leaderboard | |
| 39 | | 90% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 40 | | 90% ±0.3 | no-thinking | Dec 2025 | hf.co | Official leaderboard |
| 41 | Reka Flash 3.1 | 89.9% ±0.4 | May 2025 | hf.co | Official leaderboard | |
| 42 | | 89.9% ±0.6 | May 2024 | hf.co | Official leaderboard | |
| 43 | | 89.8% ±0.4 | Jan 2025 | hf.co | Official leaderboard | |
| 44 | | 89.7% ±0.3 | Dec 2024 | hf.co | Official leaderboard | |
| 45 | | 89.7% ±0.6 | Apr 2025 | hf.co | Official leaderboard | |
| 46 | | 89.6% ±0.4 | Apr 2025 | hf.co | Official leaderboard | |
| 47 | | 89.5% ±0.5 | Feb 2024 | hf.co | Official leaderboard | |
| 48 | Granite-3.0-2B-Base | 89.1% ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 49 | | 89% ±0.4 | Jun 2025 | hf.co | Official leaderboard | |
| 50 | | 88.8% ±0.4 | Sep 2024 | hf.co | Official leaderboard | |
| 51 | | 88.8% ±0.5 | Jan 2025 | hf.co | Official leaderboard | |
| 52 | | 88.6% ±0.5 | Jun 2025 | hf.co | Official leaderboard | |
| 53 | | 88.5% ±0.3 | Jan 2025 | hf.co | Official leaderboard | |
| 54 | | 88.5% ±0.3 | Dec 2025 | hf.co | Official leaderboard | |
| 55 | | 88.4% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 56 | deepseek-r1-0528-qwen3-8b | 88.4% ±0.3 | May 2025 | hf.co | Official leaderboard | |
| 57 | | 88.3% ±0.9 | Feb 2024 | hf.co | Official leaderboard | |
| 58 | Granite-3.0-8B-Instruct | 88.1% ±0.6 | Oct 2024 | hf.co | Official leaderboard | |
| 59 | | 88% ±0.8 | Sep 2023 | hf.co | Official leaderboard | |
| 60 | Granite-3.0-8B-Base | 88% ±0.9 | Oct 2024 | hf.co | Official leaderboard | |
| 61 | gpt-oss-20b | 87.9% ±0.3 | medium | Aug 2025 | hf.co | Official leaderboard |
| 62 | | 87.7% ±0.5 | Dec 2024 | hf.co | Official leaderboard | |
| 63 | | 87.5% ±0.4 | Feb 2024 | hf.co | Official leaderboard | |
| 64 | granite-4.0-micro | 87.2% ±0.7 | Oct 2025 | hf.co | Official leaderboard | |
| 65 | | 86.6% ±0.7 | Mar 2025 | hf.co | Official leaderboard | |
| 66 | | 86.5% ±1 | Feb 2024 | hf.co | Official leaderboard | |
| 67 | | 86.5% ±0.6 | Dec 2023 | hf.co | Official leaderboard | |
| 68 | qwen3-4b-instruct-2507 | 86.3% ±0.7 | Aug 2025 | hf.co | Official leaderboard | |
| 69 | Granite-3.0-2B-Instruct | 86.1% ±0.3 | Oct 2024 | hf.co | Official leaderboard | |
| 70 | | 86.1% ±1 | Mar 2025 | hf.co | Official leaderboard | |
| 71 | | 85.6% ±0.6 | Mar 2024 | hf.co | Official leaderboard | |
| 72 | nvidia-nemotron-nano-9b-v2 | 85.6% ±0.3 | Aug 2025 | hf.co | Official leaderboard | |
| 73 | | 85.3% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 74 | | 85.3% ±5.9 | Jun 2024 | hf.co | Official leaderboard | |
| 75 | | 84.9% ±0.8 | Jul 2024 | hf.co | Official leaderboard | |
| 76 | | 84.8% ±0.6 | Jul 2025 | hf.co | Official leaderboard | |
| 77 | | 84.3% ±0.7 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 78 | | 84.2% ±1 | Sep 2025 | hf.co | Official leaderboard | |
| 79 | | 83.7% ±0.9 | Sep 2023 | hf.co | Official leaderboard | |
| 80 | | 82.9% ±0.5 | Dec 2025 | hf.co | Official leaderboard | |
| 81 | | 82.9% ±0.7 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 82 | | 82.3% ±0.6 | Feb 2024 | hf.co | Official leaderboard | |
| 83 | | 80.6% ±1.5 | Sep 2024 | hf.co | Official leaderboard | |
| 84 | | 79.4% ±0.6 | Apr 2024 | hf.co | Official leaderboard | |
| 85 | | 78.7% ±1.3 | Mar 2026 | hf.co | Official leaderboard | |
| 86 | | 74.9% ±0.9 | Jul 2025 | hf.co | Official leaderboard | |
| 87 | | 74.4% ±0.9 | Jan 2025 | hf.co | Official leaderboard | |
| 88 | | 74.3% ±1.5 | Oct 2024 | hf.co | Official leaderboard | |
| 89 | | 74.1% ±1 | Oct 2024 | hf.co | Official leaderboard | |
| 90 | | 74.1% ±1.8 | Mar 2025 | hf.co | Official leaderboard | |
| 91 | LFM2.5-1.2B-Instruct | 65.5% ±2 | Jan 2026 | hf.co | Official leaderboard | |
| 92 | | 64.1% ±2.3 | no-thinking | Apr 2025 | hf.co | Official leaderboard |
| 93 | | 61% ±0.7 | Dec 2024 | hf.co | Official leaderboard | |
| 94 | | 56.4% ±4.8 | Mar 2025 | hf.co | Official leaderboard | |
| 95 | | 51.7% ±2.8 | Apr 2025 | hf.co | Official leaderboard | |
| 96 | | 43% ±1.8 | Apr 2025 | hf.co | Official leaderboard | |
| 97 | | 38.7% ±0.9 | Dec 2024 | hf.co | Official leaderboard | |
| 98 | LFM2-1.2B | 37.9% ±3 | Jul 2025 | hf.co | Official leaderboard | |
| 99 | | 33.9% ±1.4 | Jan 2025 | hf.co | Official leaderboard | |
| 100 | LFM2.5-1.2B-Thinking | 33.1% ±3.3 | Jan 2026 | hf.co | Official leaderboard | |
| 101 | | 24.2% ±2.7 | Dec 2023 | hf.co | Official leaderboard | |
| 102 | | 21.8% ±4.4 | Aug 2025 | hf.co | Official leaderboard | |
| 103 | | 17.5% ±4.4 | Apr 2025 | hf.co | Official leaderboard | |
| 104 | | 14.6% ±3.4 | Oct 2024 | hf.co | Official leaderboard | |
| 105 | | 1.78% ±1.4 | Oct 2024 | hf.co | Official leaderboard |
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: EuroEval’s leaderboard
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: EuroEval’s leaderboard
7 models have held number one on EuroEval’s leaderboard since 2023
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: EuroEval’s leaderboard
Llama 2-70B on the official leaderboard passed 85% in July 2023
That was 45 months after its release. All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: EuroEval’s leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
All 8 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
- Pass Independent runs Scores from the official leaderboard (352 entries).
- Pass Models scored 105 models we track, plus 247 other entries on its leaderboard.
- Note Newest score The newest came 8 months ago, in March 2026, for Nemotron 3 Nano 4B. That’s expected for a saturated test.
- Note Frontier models None of the top 10 has a score, which is fine for a retired test. The strongest tested is Qwen3-235B-A22B (#131).
- Note Headroom Saturated. The best is 92.5%, past 85% since July 2023.
Leaderboard import 3 pass
- Pass Importer We read the board on EuroEval: 118 rows for models we track and 247 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.