BLUEX
Models answer questions from two Brazilian university entrance examinations. The questions cover high school subjects in Portuguese.
- Made by
- Thales Sales Almeida and colleagues
- Released
- July 2023
- Kind
- Knowledge in many languages
- Level
- School
- Scored
- Checked automatically
- Answers
- Multiple choice
- Tasks
- All public
- Measures
- Capability
- Subject
- Mathematics, Physical sciences, Biological sciences, History and archaeology, Languages and literature
- Language
- Portuguese
- Interaction
- Single turn
- Items from
- Exams and contests
- Refresh
- One fixed set
- Run by
- Anyone
- In views
- Vision, Biology and medicine
- Strongest model tested
- GPT-5 #71 on the capability index
- Last model added
- August 2025
- Scores refreshed
- November 20th, 2026
Gemini 2.5 Pro leads with 95% among models released by August 2025 Gemini 2.5 Pro leads with 95% among models released by August 2025
Best score per entry from Open Portuguese LLM Leaderboard’s leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.
The newest model with a score here came out in August 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- and 16 more
- 95.0
Gemini 2.5 Pro
- 91.4 GPT-5 mini
- 89.8 Grok-3 mini
- 86.5
Gemini 2.5 Flash
- 85.8
Qwen3-32B
- 85.3 GPT-5 nano
- 84.6 Claude 3.7 Sonnet
- 84.1
DeepSeek-V3
- 84.0
Gemini 2.5 Flash-Lite
- 83.3
Qwen3-14B
- 83.0
Qwen3-30B-A3B
- 82.8 Kimi K2
- 81.8
DeepSeek-V3.1
- 81.8 Sabiá-3.1 (2025-05-08)
- 81.2
Llama 4 Maverick
- 80.7
Qwen3-8B
- 80.5
Qwen2.5-VL-72B
- 80.5
Qwen2.5-VL-32B
- 80.4
Gemini 2.0 Flash
- 80.1 meta-llama/Llama-3.1-405B-Instruct (Vertex AI)
- 79.7 GPT-4o
- 79.0 Sabiá-3 (2024-07-15)
- 79.0
Qwen2.5-72B
- 78.9 GPT-5
- 78.7
Gemini 2.0 Flash-Lite
- 78.7 Sabiá-3 (2024-12-11)
- 78.6 huihui-ai/Qwen2.5-32B-Instruct-abliterated
- 78.6 rombodawg/Rombos-LLM-V2.5-Qwen-32b
- 78.6 Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B
- 78.6 Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B
- 78.4 maldv/Qwentile2.5-32B-Instruct
- 78.3 Qwen/Qwen2.5-32B-Instruct
- 78.3 AXCXEPT/EZO-Qwen2.5-32B-Instruct
- 78.3 Sakalti/Oxyge1-33B
- 78.3
Falcon-H1-34B
- 78.0 fblgit/TheBeagle-v2beta-32B-MGS
- 78.0
Qwen3-4B
- 77.8 tiiuae/Falcon-H1-34B-Base
- 77.6 huihui-ai/QwQ-32B-Coder-Fusion-9010
- 77.2 Gemini 1.5 Pro Preview (0409)
- 76.9
Qwen3-30B-A3B-Instruct
- 76.8
Qwen2.5-32B
- 76.6
QwQ-32B-Preview
- 76.5 huihui-ai/QwQ-32B-Preview-abliterated
- 76.5
DeepSeek-R1-Distill-Qwen-14B
- 76.5 OpenBuddy/openbuddy-qwq-32b-v24.1-200k
- 76.1
Gemini 1.5 Flash
- 75.9
Llama 3.3 70B Instruct
- 75.8
Gemini 1.5 Flash
- 75.4
Qwen2-72B
- 75.4 google/medgemma-27b-text-it
- 75.1 meta-llama/Meta-Llama-3.1-70B-Instruct
- 75.1 amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct
- 74.8 Gemini 1.5 Flash Preview (0514)
- 74.8 nisten/franqwenstein-35b
- 74.8 meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI)
- 74.5 arcee-ai/Virtuoso-Small
- 74.1 prithivMLmods/Megatron-Opus-14B-Exp
- 74.0 sometimesanotion/Qwen2.5-14B-Vimarckoso-v3
- 74.0 mistralai/Mistral-Small-24B-Base-2501
- 73.8 google/gemma-3-27b-it (GoogleAI API)
- 73.7 Replete-AI/Replete-LLM-V2.5-Qwen-14b
- 73.6 rombodawg/Rombos-LLM-V2.6-Qwen-14b
- 73.6 hotmailuser/QwenSlerp2-14B
- 73.6 sometimesanotion/Lamarck-14B-v0.6
- 73.6 sometimesanotion/Lamarck-14B-v0.7
- 73.4 meta-llama/Meta-Llama-3-70B-Instruct
- 73.4 v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno
- 73.4 allknowingroger/Qwen2.5-slerp-14B
- 73.4 mistralai/Mistral-Small-24B-Instruct-2501
- 73.4 Sabiázinho-3 (2025-02-06)
- 73.3 Qwen/Qwen2.5-14B-Instruct
- 73.3 Lambent/qwen2.5-reinstruct-alternate-lumen-14B
- 73.3 v000000/Qwen2.5-14B-Gutenberg-1e-Delta
- 73.3 CultriX/Qwen2.5-14B-Wernicke
- 73.3 allknowingroger/QwenSlerp6-14B
- 73.2 tanliboy/lambda-qwen2.5-14b-dpo-test
- 73.2 Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
- 72.5 CultriX/SeQwence-14Bv1
- 72.3 janhq/Jan-v1-4B
- 72.2 meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API)
- 72.0 arcee-ai/SuperNova-Medius
- 72.0 CultriX/Qwen2.5-14B-Wernicke-SFT
- 72.0
Qwen2.5-14B-Instruct-1M
- 71.8 Sabiá-2 Medium
- 71.8 Qwen/Qwen1.5-110B-Chat
- 71.6 AALF/gemma-2-27b-it-SimPO-37K-100steps
- 71.2
Llama 3.1-70B
- 71.1 byroneverson/gemma-2-27b-it-abliterated
- 71.1
Llama 3.2 90B
- 70.8 Qwen-Turbo (2024-11-01)
- 70.5 google/gemma-2-27b-it
- 70.4
Llama 3-70B
- 70.4 THUDM/GLM-Z1-9B-0414
- 70.2
Phi-4
- 70.1 botbot-ai/CabraLlama3-70b
- 70.1 tiiuae/Falcon-H1-7B-Instruct
- 69.5 abacusai/Smaug-Llama-3-70B-Instruct
- 69.5 DeepSeek-V2 Chat (API)
- 69.3 google/medgemma-27b-it
- 68.8 unsloth/llama-3-70b-Instruct-bnb-4bit
- 68.7 tiiuae/Falcon-H1-7B-Base
- 68.4 Qwen/Qwen-72B
- 68.4 GPT 4o Mini (2024-07-18)
- 68.3 abacusai/Smaug-72B-v0.1
- 68.2 unsloth/Llama-3.3-70B-Instruct-bnb-4bit
- 68.2
Gemma 3 12B PT
- 68.0 Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp
- 68.0
Gemma 2 27B
- 68.0 huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
- 67.9
Qwen1.5-110B
- 67.9 01-ai/Yi-1.5-34B-32K
- 67.9 cognitivecomputations/dolphin-2.9.1-llama-3-70b
- 67.9 Qwen2.5-Coder-14B
- 67.7 qwen3-4b-instruct-2507
- 67.6
Qwen1.5-72B
- 67.6 Weyaxi/Bagel-Hermes-34B-Slerp
- 67.5 botbot-ai/Cabra-72b
- 67.3 unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
- 67.3
Qwen2.5-Coder-32B-Instruct
- 67.2 mistral-community/Mixtral-8x22B-v0.1-4bit
- 67.2 Azure99/blossom-v5.1-34b
- 67.2 VAGOsolutions/SauerkrautLM-Qwen-32b
- 66.9 jondurbin/bagel-dpo-34b-v0.2
- 66.9 altomek/YiSM-34B-0rn
- 66.8 jondurbin/bagel-dpo-34b-v0.5
- 66.8 upstage/solar-pro-preview-instruct
- 66.6 Claude-3 Haiku (20240307)
- 66.6
Yi-1.5-34B
- 66.6 mistralai/Mixtral-8x22B-Instruct-v0.1
- 66.6 Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
- 66.6
Gemma 3 12B
- 66.5
Yi-34B
- 66.5 SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit
- 66.5 01-ai/Yi-1.5-34B-Chat
- 66.5 Cran-May/T.E-8.1
- 66.5 Qwen2.5-Coder-14B-Instruct
- 66.5 Qwen/Qwen2.5-7B-Instruct-1M
- 66.3 adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1
- 66.2 CohereForAI/c4ai-command-r-plus-4bit
- 66.2 mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit
- 66.2 CombinHorizon/YiSM-blossom5.1-34B-SLERP
- 66.2 VAGOsolutions/SauerkrautLM-Phi-3-medium
- 66.1 CausalLM/34b-beta
- 65.9
Keye-VL-1.5-8B
- 65.8 NousResearch/Nous-Hermes-2-Yi-34B
- 65.8 abacusai/Smaug-34B-v0.1
- 65.8
WizardLM-2 8x22B
- 65.8 ConvexAI/Luminex-34B-v0.2
- 65.8
Nemotron-4-340B-Instruct
- 65.8 wenbopan/Faro-Yi-34B-DPO
- 65.8 Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO
- 65.7 Qwen/Qwen1.5-32B-Chat
- 65.7 recoilme/recoilme-gemma-2-9B-v0.4
- 65.5 anthracite-org/magnum-v3-9b-customgemma2
- 65.4 fblgit/UNA-SimpleSmaug-34b-v1beta
- 65.4 princeton-nlp/gemma-2-9b-it-SimPO
- 65.4 c4ai-command-r-08-2024
- 65.4
Aya Expanse 32B
- 65.4
OLMo 2 32B Instruct
- 65.4 baidu/ERNIE-4.5-21B-A3B-PT
- 65.2 Qwen/Qwen2-57B-A14B
- 65.2 Qwen/Qwen2-57B-A14B-Instruct
- 65.2 anthracite-org/magnum-v3-9b-chatml
- 65.0 GLM-4-9B-Chat
- 64.8 01-ai/Yi-34B-200K
- 64.8 152334H/miqu-1-70b-sf
- 64.8 migtissera/Tess-M-v1.3
- 64.8 ConvexAI/Luminex-34B-v0.1
- 64.8 wenbopan/Faro-Yi-34B
- 64.8 BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference
- 64.7 anthracite-org/magnum-v3-27b-kto
- 64.7 huihui-ai/Qwen2.5-7B-Instruct-abliterated
- 64.7 Gemini 1.5 Flash 8B (001)
- 64.5 GLM-4-9B
- 64.5 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated
- 64.5 Qwen/Qwen2.5-7B-Instruct
- 64.5 tiiuae/Falcon3-10B-Base
- 64.3
Mixtral 8x7B
- 64.3 recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp
- 64.3 TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule
- 64.3
Qwen3-1.7B
- 64.1 botbot-ai/CabraMixtral-8x7b
- 64.0
Gemma 2 9B
- 64.0 recoilme/recoilme-gemma-2-9B-v0.2
- 64.0 arcee-ai/Virtuoso-Lite
- 63.7 Replete-AI/Replete-LLM-V2.5-Qwen-7b
- 63.7 sethuiyer/Qwen2.5-7B-Anvita
- 63.6 cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
- 63.6 google/gemma-2-9b-it
- 63.6 TheDrummer/Gemmasutra-9B-v1
- 63.6 huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2
- 63.4
Phi-3.5-MoE
- 63.4 OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k
- 63.3 01-ai/Yi-34B-Chat
- 63.3 lucianosb/boto-9B
- 63.3 rhymes-ai/Aria-Base-64K
- 63.1 THUDM/GLM-4-9B-0414
- 63.0
Tulu 2 DPO 70B
- 63.0 NousResearch/Nous-Capybara-34B
- 63.0 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2
- 63.0 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
- 62.9
Falcon3-10B-Instruct
- 62.7 speakleash/Bielik-11B-v2.2-Instruct
- 62.6 speakleash/Bielik-11B-v2.1-Instruct
- 62.5 GPT-3.5 Turbo
- 62.5
phi-3-medium 14B
- 62.5 microsoft/Phi-3-small-128k-instruct
- 62.5 cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b
- 62.3 PrunaAI/dbrx-base-bnb-4bit
- 62.3 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2
- 62.3 recoilme/recoilme-gemma-2-9B-v0.3
- 62.3 speakleash/Bielik-11B-v2.3-Instruct
- 62.2 chujiezheng/Smaug-34B-v0.1-ExPO
- 62.2 jpacifico/Chocolatine-14B-Instruct-4k-DPO
- 62.2 MarinaraSpaghetti/NemoReRemix-12B
- 62.0
Command R (03-2024)
- 62.0 PrunaAI/dbrx-instruct-bnb-4bit
- 62.0 OrionStarAI/OrionStar-Yi-34B-Chat
- 62.0 Weyaxi/Einstein-v7-Qwen2-7B
- 61.9 GLM-4-9B-Chat-1M
- 61.9 tiiuae/Falcon-H1-3B-Instruct
- 61.8
Mistral-Nemo-Base-2407
- 61.8 NLPark/AnFeng_v3.1-Avocet
- 61.8 MaziyarPanahi/calme-2.4-qwen2-7b
- 61.8 allknowingroger/Ph3della5-14B
- 61.6 macadeliccc/Samantha-Qwen-2-7B
- 61.5
phi-3-small 7.4B
- 61.5
Phi-3-medium-128k-instruct
- 61.5 mistralai/Mistral-Nemo-Instruct-2407
- 61.5 speakleash/Bielik-11B-v2.0-Instruct
- 61.3
Llama 2-70B
- 61.3 OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k
- 61.3
InternLM2.5-20B-Chat
- 61.3
Falcon3-7B-Instruct
- 61.2 informatiker/Qwen2-7B-Instruct-abliterated
- 61.2 MaziyarPanahi/calme-2.2-qwen2-7b
- 61.2 natong19/Mistral-Nemo-Instruct-2407-abliterated
- 61.1
Qwen2-7B
- 61.1
Qwen2-7B-Instruct
- 60.9 migtissera/Tess-v2.5-Phi-3-medium-128k-14B
- 60.9 arcee-ai/Arcee-Spark
- 60.8
Qwen1.5-14B-Chat
- 60.8 nicolasdec/CabraQwen14b
- 60.8 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
- 60.8 lucianosb/boto-9B-it
- 60.8 axolotl-ai-co/romulus-mistral-nemo-12b-simpo
- 60.8 v000000/L3.1-Niitorm-8B-DPO-t0.0001
- 60.8
Qwen3-4B-Thinking-2507
- 60.6 BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
- 60.6 Aria
- 60.6 byroneverson/Mistral-Small-Instruct-2409-abliterated
- 60.5 jaspionjader/f-9-8b
- 60.4 natong19/Qwen2-7B-Instruct-abliterated
- 60.4 meta-llama/Llama-3.2-11B-Vision
- 60.2 argilla/notux-8x7b-v1
- 60.2 CohereForAI/aya-23-35B
- 60.2 mlabonne/NeuralDaredevil-8B-abliterated
- 60.2 SeaLLMs/SeaLLMs-v3-7B-Chat
- 60.2 grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
- 60.2 Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base
- 60.2 Sao10K/L3.1-8B-Niitama-v1.1
- 60.1 vicgalle/CarbonBeagle-11B-truthy
- 60.1 mlabonne/Daredevil-8B-abliterated
- 60.1 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25
- 60.1 nbeerbower/mistral-nemo-wissenschaft-12B
- 60.1 arcee-ai/Llama-3.1-SuperNova-Lite
- 60.1 tiiuae/Falcon3-7B-Base
- 59.9
Llama 3.1-8B
- 59.8 mistralai/Mixtral-8x7B-Instruct-v0.1
- 59.8 WizardLMTeam/WizardLM-70B-V1.0
- 59.8 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated
- 59.8 JJhooww/Qwen2-7B_reload_v1
- 59.8 THUDM/LongWriter-glm4-9b
- 59.8 meta-llama/Llama-3.1-8B-Instruct
- 59.7 ai21labs/Jamba-v0.1
- 59.5 cognitivecomputations/dolphin-2.9.2-qwen2-7b
- 59.4 Kukedlc/NeuralLLaMa-3-8b-DT-v0.1
- 59.4 bunnycore/HyperLlama-3.1-8B
- 59.3 failspy/Phi-3-medium-4k-instruct-abliterated-v3
- 59.3 MaziyarPanahi/Llama-3-8B-Instruct-v0.8
- 59.3
Llama 3.2 11B
- 59.3 princeton-nlp/gemma-2-9b-it-DPO
- 59.3 RDson/WomboCombo-R1-Coder-14B-Preview
- 59.1 rhaymison/Mistral-8x7b-portuguese-luana
- 59.1 mlabonne/ChimeraLlama-3-8B-v3
- 59.0 upstage/SOLAR-10.7B-v1.0
- 59.0 vicgalle/ConfigurableBeagle-11B
- 59.0 recogna-nlp/Bode-3.1-8B-Instruct-full
- 59.0 deepcogito/cogito-v1-preview-llama-8B
- 59.0 tiiuae/Falcon-H1-3B-Base
- 58.8 lightblue/suzume-llama-3-8B-multilingual
- 58.8 uygarkurt/llama-3-merged-linear
- 58.8 DeepMount00/Llama-3-8b-Ita
- 58.8 meta-llama/Meta-Llama-3.1-8B-Instruct
- 58.8 BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
- 58.8 BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B
- 58.8 BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B
- 58.8 v000000/SwallowMaid-8B-L3-SPPO-abliterated
- 58.7
Gemini 1.0 Pro
- 58.7 OrionStarAI/Orion-14B-Base
- 58.7 recogna-nlp/internlm-chatbode-20b
- 58.7 internlm/internlm2_5-7b-chat-1m
- 58.7 vicgalle/Configurable-Llama-3.1-8B-Instruct
- 58.7 freewheelin/free-llama3-dpo-v0.2
- 58.7 Eurdem/Defne-llama3.1-8B
- 58.7 unsloth/Meta-Llama-3.1-70B-bnb-4bit
- 58.5 internlm/internlm2-20b
- 58.5 PrunaAI/Jamba-v0.1-bnb-4bit
- 58.5 VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
- 58.5 shadowml/Mixolar-4x7b
- 58.5 OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
- 58.5 speakleash/Bielik-11B-v2
- 58.4 invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp
- 58.4 VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct
- 58.4 MaziyarPanahi/Llama-3-8B-Instruct-v0.10
- 58.4 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule
- 58.3
SOLAR-10.7B-Instruct-v1.0
- 58.3 unsloth/llama-3-70b-bnb-4bit
- 58.3 Danielbrdz/Barcenas-Llama3-8b-ORPO
- 58.3 MaziyarPanahi/Llama-3-8B-Instruct-v0.9
- 58.3 princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2
- 58.3 princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2
- 58.3 princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2
- 58.3 princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2
- 58.1 kekmodel/StopCarbon-10.7B-v5
- 58.1 DeepMount00/Llama-3.1-8b-Ita
- 58.1 princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2
- 58.1 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2
- 58.0 jeonsworld/CarbonVillain-en-10.7B-v4
- 58.0 rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct
- 58.0 saltlux/luxia-21.4b-alignment-v1.0
- 58.0 failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
- 58.0 saltlux/luxia-21.4b-alignment-v1.2
- 58.0 RLHFlow/LLaMA3-iterative-DPO-final
- 58.0 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
- 58.0 dnhkng/RYS-Llama-3.1-8B-Instruct
- 57.9 internlm/internlm2-chat-20b
- 57.9 openchat/openchat-3.5-0106-gemma
- 57.9 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3
- 57.9 vicgalle/ConfigurableSOLAR-10.7B
- 57.9
Qwen2.5-Coder (7B)
- 57.7 01-ai/Yi-1.5-9B
- 57.7 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75
- 57.7 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2
- 57.7 Dampfinchen/Llama-3.1-8B-Ultra-Instruct
- 57.7 princeton-nlp/Llama-3-Instruct-8B-CPO
- 57.6 ibivibiv/llama-3-nectar-dpo-8B
- 57.6 princeton-nlp/Llama-3-Instruct-8B-KTO
- 57.6 anthracite-org/magnum-v2.5-12b-kto
- 57.6 Sao10K/L3-8B-Niitama-v1
- 57.4 VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
- 57.4 migtissera/Trinity-2-Codestral-22B
- 57.4 princeton-nlp/Llama-3-Instruct-8B-RDPO
- 57.3
Llama 3-8B
- 57.3 internlm/internlm2-chat-20b-sft
- 57.3 mlabonne/Llama-3-8B-Instruct-abliterated-dpomix
- 57.3 princeton-nlp/Llama-3-Instruct-8B-SimPO
- 57.3 grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge
- 57.3 recogna-nlp/Bode-3.1-8B-Instruct-lora
- 57.3 EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection
- 57.3 princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2
- 57.3 princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2
- 57.3 princeton-nlp/Llama-3-Instruct-8B-RRHF
- 57.3 Granite-3.1-8B-Instruct
- 57.3 MagusCorp/grpo_lora_enem_llama3_7b
- 57.2 recogna-nlp/gembode-7b
- 57.2 unsloth/llama-3-8b-Instruct-bnb-4bit
- 57.2 vicgalle/Configurable-Llama-3-8B-v0.3
- 57.2 princeton-nlp/Llama-3-Instruct-8B-DPO
- 57.2 tiiuae/Falcon-H1-1.5B-Deep-Instruct
- 57.0 NousResearch/Hermes-2-Pro-Llama-3-8B
- 57.0 01-ai/Yi-1.5-9B-32K
- 57.0 NousResearch/Hermes-2-Theta-Llama-3-8B
- 57.0 arthrod/cicerollamatry8
- 57.0 maywell/Qwen2-7B-Multilingual-RP
- 56.9 botbot-ai/CabraLlama3-8b
- 56.9 jondurbin/bagel-8b-v1.0
- 56.9 vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
- 56.9 BAAI/Infinity-Instruct-3M-0625-Llama3-8B
- 56.9 EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta
- 56.9 MaziyarPanahi/calme-2.7-qwen2-7b
- 56.9 Qwen/Qwen2.5-3B-Instruct
- 56.9
Phi-4-reasoning
- 56.8 qnguyen3/Master-Yi-9B
- 56.8 OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k
- 56.8 tobiaspires/command-r-p11-fn
- 56.8 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4
- 56.8 EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta
- 56.8 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta
- 56.8 grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge
- 56.6 01-ai/Yi-1.5-9B-Chat-16K
- 56.6 chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO
- 56.6 microsoft/Phi-3.5-mini-instruct
- 56.5
Gemma 7B
- 56.5 EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200
- 56.5 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule
- 56.3 rishiraj/CatPPT
- 56.3 VAGOsolutions/SauerkrautLM-Gemma-7b
- 56.3 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2
- 56.3 NousResearch/Hermes-3-Llama-3.1-8B
- 56.3 leafspark/Llama-3.1-8B-MultiReflection-Instruct
- 56.3 Qwen/Qwen2.5-Coder-7B-Instruct
- 56.2 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1
- 56.2 vicgalle/Configurable-Hermes-3-Llama-3.1-8B
- 56.2 MaziyarPanahi/calme-2.3-qwen2-7b
- 56.2 mistralai/Ministral-8B-Instruct-2410
- 56.2 cognitivecomputations/Dolphin3.0-R1-Mistral-24B
- 56.0 NousResearch/Nous-Hermes-2-SOLAR-10.7B
- 56.0 nicolasdec/CabraQwen7b
- 56.0 tiiuae/Falcon-H1-1.5B-Deep-Base
- 55.9 rishiraj/CatPPT-base
- 55.9 cognitivecomputations/dolphin-2.9.1-yi-1.5-9b
- 55.9 internlm/internlm2_5-7b-chat
- 55.9 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3
- 55.9 arcee-ai/Arcee-Scribe
- 55.9 princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2
- 55.9 EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos
- 55.9
Phi-4-Reasoning-plus
- 55.8 vicgalle/CarbonBeagle-11B
- 55.8 microsoft/MediPhi
- 55.6
Starling-LM-7B-alpha
- 55.6 SeaLLMs/SeaLLM-7B-v2.5
- 55.6 princeton-nlp/Llama-3-8B-ProLong-512k-Instruct
- 55.6 princeton-nlp/Llama-3-8B-ProLong-64k-Base
- 55.5
Qwen-14B
- 55.5 Sabiá-2 Small
- 55.5 lemon-mint/gemma-ko-7b-instruct-v0.62
- 55.5 wenbopan/Faro-Yi-9B
- 55.5 OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k
- 55.5 princeton-nlp/Llama-3-Instruct-8B-IPO
- 55.5 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF
- 55.4
LLaMA-65B
- 55.4 Nous-Hermes-2-Mixtral-8x7B-DPO
- 55.2 wenbopan/Faro-Yi-9B-DPO
- 55.2 Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1
- 55.2 terrycraddock/Reflection-Llama-3.1-8B
- 55.2 migtissera/Trinity-2-Codestral-22B-v0.2
- 55.2 MaziyarPanahi/calme-2.1-qwen2-7b
- 55.1 vicgalle/Configurable-Yi-1.5-9B-Chat
- 55.1 meraGPT/mera-mix-4x7B
- 55.1 BAAI/Infinity-Instruct-3M-0625-Mistral-7B
- 54.9 Yi-9B
- 54.9 FuseAI/FuseChat-7B-VaRM
- 54.9 unsloth/llama-3-8b-bnb-4bit
- 54.9 princeton-nlp/Llama-3-8B-ProLong-64k-Instruct
- 54.8 internlm/internlm2-base-20b
- 54.8
Yi-1.5-9B-Chat
- 54.8 ibivibiv/multimaster-7b-v6
- 54.8 MaziyarPanahi/Topxtral-4x7B-v0.1
- 54.8 Kukedlc/NeuralSynthesis-7B-v0.1
- 54.8 jsfs11/MixtureofMerges-MoE-4x7b-v5
- 54.8 mistralai/Codestral-22B-v0.1
- 54.8 cognitivecomputations/laserxtral
- 54.8 freewheelin/free-solar-evo-v0.1
- 54.7 FuseAI/OpenChat-3.5-7B-Solar
- 54.7 kevin009/llamaRAGdrama
- 54.7 cognitivecomputations/WestLake-7B-v2-laser
- 54.7 freewheelin/free-solar-evo-v0.13
- 54.7 princeton-nlp/Llama-3-Instruct-8B-ORPO
- 54.5 Kukedlc/NeuralSynthesis-7b-v0.4-slerp
- 54.5 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5
- 54.5 liminerity/M7-7b
- 54.5 freewheelin/free-solar-evo-v0.11
- 54.5 Magpie-Align/MagpieLM-8B-SFT-v0.1
- 54.5 rombodawg/rombos_Replete-Coder-Instruct-8b-Merged
- 54.4 paulml/OGNO-7B
- 54.4 MaziyarPanahi/Mistral-7B-Instruct-Aya-101
- 54.4 J-LAB/BRisa-7B-Instruct-v0.2
- 54.4 Kquant03/CognitiveFusion2-4x7B-BF16
- 54.4 NotAiLOL/Yi-1.5-dolphin-9B
- 54.4 01-ai/Yi-9B-200K
- 54.4 allknowingroger/MultiverseEx26-7B-slerp
- 54.4 EpistemeAI/Fireball-3.1-8B-ORPO
- 54.4
Aya Expanse 8B
- 54.2 bardsai/jaskier-7b-dpo-v5.6
- 54.2 teknium/OpenHermes-2-Mistral-7B
- 54.2 automerger/YamshadowExperiment28-7B
- 54.2 Kukedlc/NeuralSynthesis-7B-v0.3
- 54.2 TIGER-Lab/AceCodeRM-7B
- 54.1
Qwen1.5-32B
- 54.1 NousResearch/Nous-Hermes-2-Mistral-7B-DPO
- 54.1 stabilityai/stablelm-2-12b
- 54.1 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1
- 54.1
Phi-3-mini-128k-instruct
- 54.1 zhengr/MixTAO-7Bx2-MoE-v8.1
- 54.1 jsfs11/MixtureofMerges-MoE-4x7b-v4
- 54.1 J-LAB/FluxiIA-Small
- 54.0 JJhooww/Mistral-7B-v0.2-Base_ptbr
- 54.0
phi-3-mini 3.8B
- 54.0 princeton-nlp/Llama-3-Base-8B-SFT-ORPO
- 54.0 princeton-nlp/Llama-3-Base-8B-SFT-RDPO
- 54.0 EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic
- 53.8
Starling-LM-7B-beta
- 53.8 Walmart-the-bag/Misted-v2-7B
- 53.8 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2
- 53.8 internlm/internlm2-wqx-20b
- 53.8 princeton-nlp/Llama-3-Base-8B-SFT-RRHF
- 53.8 kurakurai/Luth-1.7B-Instruct
- 53.8 utter-project/EuroLLM-9B-Instruct
- 53.7 Walmart-the-bag/WordWoven-2x7B
- 53.7 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3
- 53.7 adalbertojunior/Llama-3-8B-Dolphin-Portuguese
- 53.7 abacusai/Slerp-CM-mist-dpo
- 53.7 ValiantLabs/Llama3.1-8B-Cobalt
- 53.7 princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF
- 53.7 HuggingFaceTB/SmolLM3-3B-Base
- 53.5 01-ai/Yi-9B-200k
- 53.5 eduagarcia/mistral-orpo-mix-21k
- 53.5 EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto
- 53.4 kaist-ai/mistral-orpo-capybara-7k
- 53.4 yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
- 53.4 CultriX/NeuralMona_MoE-4x7B
- 53.4 Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R
- 53.4 RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2
- 53.4 Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3
- 53.4 mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
- 53.4 princeton-nlp/Mistral-7B-Instruct-SimPO
- 53.4 princeton-nlp/Llama-3-Base-8B-SFT-DPO
- 53.3 BAAI/Infinity-Instruct-3M-0613-Mistral-7B
- 53.3 J-LAB/Nemo_RolePlay_PTBR_new
- 53.3 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2
- 53.3 byroneverson/Yi-1.5-9B-Chat-16K-abliterated
- 53.1
Mistral 7B v0.2
- 53.1 eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1
- 53.1 mistralai/Mistral-7B-Instruct-v0.3
- 53.1 MaziyarPanahi/Mistral-7B-Instruct-v0.3
- 53.1 yunconglong/MoE_13B_DPO
- 53.1 cognitivecomputations/openchat-3.5-0106-laser
- 53.1 Magpie-Align/Llama-3-8B-Magpie-Align-v0.3
- 53.0 leliuga/Phi-3-mini-4k-instruct-bnb-4bit
- 53.0 princeton-nlp/Llama-3-Base-8B-SFT-CPO
- 53.0 utter-project/EuroLLM-9B
- 52.9 teknium/OpenHermes-2.5-Mistral-7B
- 52.9 unsloth/Phi-3-mini-4k-instruct-bnb-4bit
- 52.9
DeepSeek-R1-Distill-Qwen-7B
- 52.9 tiiuae/Falcon-H1-1.5B-Instruct
- 52.7 openchat/openchat-3.5-0106
- 52.7 eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1
- 52.7 Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5
- 52.7 Magpie-Align/MagpieLM-8B-Chat-v0.1
- 52.7 princeton-nlp/Llama-3-Base-8B-SFT-IPO
- 52.7 princeton-nlp/Mistral-7B-Instruct-KTO
- 52.6 internlm-20b
- 52.6 mlabonne/Monarch-7B
- 52.6 JJhooww/Mistral_Relora_Step2k
- 52.6 princeton-nlp/Llama-3-Base-8B-SFT-SimPO
- 52.6 Qwen/Qwen2.5-1.5B-Instruct
- 52.6 utter-project/EuroLLM-22B-Instruct-Preview
- 52.4 internlm/internlm2-7b
- 52.4 argilla/CapybaraHermes-2.5-Mistral-7B
- 52.4 unsloth/gemma-7b-bnb-4bit
- 52.4 eduagarcia/mistral-orpo-capybara-3k
- 52.4 recogna-nlp/internlm-chatbode2-7b-beta
- 52.3
Mistral 7B v0.3
- 52.3
Qwen1.5-7B-Chat
- 52.3 yunconglong/DARE_TIES_13B
- 52.3 uukuguy/speechless-zephyr-code-functionary-7b
- 52.3 princeton-nlp/Llama-3-Base-8B-SFT
- 52.3 meta-llama/Llama-3.2-3B-Instruct
- 52.3
Gemma 3 4B
- 52.2
Mistral-7B-Instruct-v0.2
- 52.2 alvarobartt/Mistral-7B-v0.1-ORPO
- 52.2 tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
- 52.2 princeton-nlp/Llama-3-Base-8B-SFT-KTO
- 52.0 Qwen/Qwen1.5-MoE-A2.7B-Chat
- 52.0 mlabonne/Beyonder-4x7B-v3
- 52.0 uukuguy/zephyr-7b-alpha-dare-0.85
- 52.0 01-ai/Yi-1.5-34B-Chat-16K
- 52.0 dzakwan/dzakwan-MoE-4x7b-Beta
- 52.0
Qwen2.5-7B
- 52.0 kaist-ai/janus-dpo-7b
- 51.9 huggyllama/llama-30b
- 51.9 eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1
- 51.9 princeton-nlp/Mistral-7B-Instruct-RRHF
- 51.9 BornSaint/Dare_Angel_8B
- 51.7 rhaymison/Llama3-portuguese-luana-8b-instruct
- 51.7 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4
- 51.7 SeaLLMs/SeaLLM-7B-v2
- 51.7 abacusai/bigstral-12b-32k
- 51.7 abacusai/bigyi-15b
- 51.7 byroneverson/Yi-1.5-9B-Chat-abliterated
- 51.6 internlm/internlm2-chat-7b-sft
- 51.6 eduagarcia/mistral-orpo-mix-7k
- 51.6 rombodawg/Everyone-Coder-4x7b-Base
- 51.5 recogna-nlp/internlm-chatbode-7b
- 51.5 vicgalle/Configurable-Mistral-7B
- 51.5 vicgalle/ConfigurableHermes-7B
- 51.5 princeton-nlp/Mistral-7B-Instruct-DPO
- 51.5
Qwen3-14B-Base
- 51.3
Yi 6B
- 51.3 Skywork/Skywork-13B-base
- 51.3 bartowski/internlm2-chat-7b-llama
- 51.3 uukuguy/speechless-code-mistral-7b-v1.0
- 51.2 unsloth/mistral-7b-v0.3-bnb-4bit
- 51.2 openchat/openchat-3.6-8b-20240522
- 51.2 shadowml/BeagSake-7B
- 51.2 rombodawg/rombos_Replete-Coder-Llama3-8B
- 51.0
Zephyr 7B Alpha
- 51.0 MagusCorp/legislinho
- 51.0 GritLM/GritLM-7B-KTO
- 51.0 beowolx/CodeNinja-1.0-OpenChat-7B
- 51.0 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
- 51.0 princeton-nlp/Mistral-7B-Instruct-CPO
- 50.8 internlm/internlm2-chat-7b
- 50.8 gradientai/Llama-3-8B-Instruct-262k
- 50.6 AetherResearch/Cerebrum-1.0-7b
- 50.6 rhaymison/phi-3-portuguese-tom-cat-4k-instruct
- 50.6 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
- 50.6 mlabonne/FineLlama-3.1-8B
- 50.6 princeton-nlp/Mistral-7B-Instruct-RDPO
- 50.5 argilla/notus-7b-v1
- 50.5
Llama 3.2 3B
- 50.5 princeton-nlp/Mistral-7B-Instruct-ORPO
- 50.5 Qwen/Qwen3-1.7B-Base
- 50.4 Intel/neural-chat-7b-v3-3
- 50.2
Mistral 7B v0.1
- 50.2 THUDM/chatglm3-6b-base
- 50.2 lmsys/vicuna-33b-v1.3
- 50.2 kaist-ai/janus-7b
- 50.2
Qwen3-30B-A3B-Base
- 50.1
Yi-6B-Chat
- 50.1 recogna-nlp/internlmbode-7b
- 50.1 mlabonne/NeuralMonarch-7B
- 50.1 UCLA-AGI/Mistral7B-PairRM-SPPO
- 50.1 princeton-nlp/Mistral-7B-Instruct-SLiC-HF
- 49.9 unsloth/mistral-7b-bnb-4bit
- 49.9 01-ai/Yi-1.5-6B
- 49.9 eldogbbhed/Peagle-9b
- 49.9 amazingvince/Not-WizardLM-2-7B
- 49.9 google/medgemma-4b-it
- 49.8 CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it
- 49.6
Falcon-40B
- 49.6 cognitivecomputations/dolphin-2.9-llama3-8b
- 49.6 alvarobartt/mistral-7b-orpo-alignment-handbook
- 49.6 cosmicvalor/mistral-orthogonalized
- 49.6 J-AI/Mistral_7b_ptbr_icatalogo
- 49.6 princeton-nlp/Mistral-7B-Instruct-IPO
- 49.6 deepcogito/cogito-v1-preview-llama-3B
- 49.5 chujiezheng/Mistral7B-PairRM-SPPO-ExPO
- 49.4 stabilityai/stablelm-2-12b-chat
- 49.4 lucianosb/boto-7B-v1.1
- 49.4 cognitivecomputations/dolphin-2.9.3-mistral-7B-32k
- 49.4 failspy/Codestral-22B-v0.1-abliterated-v3
- 49.4 kaist-ai/janus-orpo-7b
- 49.4 BSC-LT/salamandra-7b-instruct
- 49.4 microsoft/Phi-4-mini-instruct
- 49.2 rhaymison/Mistral-portuguese-luana-7b-chat
- 49.2 Walmart-the-bag/Quintellect-10.7B
- 49.2 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4
- 49.2 lucianosb/boto-7B-v1.2
- 49.2 GritLM/GritLM-7B
- 49.2 ValiantLabs/Llama3.1-8B-ShiningValiant2
- 49.1 mlabonne/AlphaMonarch-7B
- 49.0 alvarobartt/mistral-7b-orpo-capybara-reproduction
- 49.0
MAmmoTH2-7B-Plus
- 49.0 Xwin-LM/Xwin-LM-13B-V0.2
- 48.8
Qwen-7B
- 48.8 TencentARC/Mistral_Pro_8B_v0.1
- 48.8 lucianosb/boto-7B
- 48.8 Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0
- 48.8 princeton-nlp/Mistral-7B-Base-SFT-IPO
- 48.8 princeton-nlp/Mistral-7B-Base-SFT-KTO
- 48.7 cnmoro/Mistral-7B-Portuguese
- 48.7 princeton-nlp/Mistral-7B-Base-SFT-SimPO
- 48.7 recogna-nlp/internlm-chatbode2-7b-alpha
- 48.7 ghost-x/ghost-8b-beta-1608
- 48.7 allenai/OLMo-2-1124-7B
- 48.5 rhaymison/Mistral-portuguese-luana-7b-mental-health
- 48.5 alvarobartt/mistral-orpo-mix
- 48.5 princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF
- 48.5 HuggingFaceTB/SmolLM3-3B
- 48.4 cognitivecomputations/WizardLM-30B-Uncensored
- 48.4 Xwin-LM/Xwin-LM-13B-V0.1
- 48.4 CohereForAI/aya-23-8B
- 48.4 artificialguybr/OpenHermesV2-PTBR
- 48.4 princeton-nlp/Mistral-7B-Base-SFT-RDPO
- 48.3 Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0
- 48.3 amazon/MegaBeam-Mistral-7B-300k
- 48.3 allenai/OLMo-2-1124-7B-Instruct
- 48.1 allenai/tulu-2-dpo-13b
- 48.1 rhaymison/Qwen-portuguese-luana-7b
- 48.1 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half
- 48.1 eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1
- 48.1 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6
- 48.1
Gemma 2 2B IT
- 48.1 princeton-nlp/Mistral-7B-Base-SFT-CPO
- 48.1 tiiuae/Falcon-H1-1.5B-Base
- 48.0
Zephyr 7B Beta
- 48.0 Intel/neural-chat-7b-v3-1
- 48.0 JJhooww/MistralReloadBR_v2_ptbr
- 48.0 rhaymison/Mistral-portuguese-luana-7b
- 48.0 hkust-nlp/deita-7b-v1.0-sft
- 47.8 CohereForAI/aya-101
- 47.8 royallab/ZephRP-m7b
- 47.8 ValiantLabs/Llama3.1-8B-Fireplace2
- 47.7 maritaca-ai/sabia-7b
- 47.7 internlm/internlm2-base-7b
- 47.7
Gemma 1.1 7B IT
- 47.7 deepseek-ai/DeepSeek-V2-Lite-Chat
- 47.6 meta-llama/Llama-2-70b-chat-hf
- 47.6 Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged
- 47.6 kaitchup/Qwen1.5-7B-bnb-4bit
- 47.6 alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt
- 47.4 HuggingFaceH4/zephyr-7b-gemma-v0.1
- 47.4 Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO
- 47.3
Gemma 3n E2B
- 47.1 recogna-nlp/mistralbode_7b_qlora_ultraalpaca
- 47.1 heloisy/zephyr-7b-cosmosqa-ptbr_text
- 47.0 nicolasdec/Cabramistral7b
- 47.0 chargoddard/internlm2-base-7b-llama
- 47.0 tiiuae/falcon-11B
- 47.0 aws-prototyping/MegaBeam-Mistral-7B-512k
- 46.9 OpenLLM-France/Claire-Mistral-7B-0.1
- 46.9 nicolasdec/CabraMistral7b
- 46.9 maywell/Synatra-7B-v0.3-RP
- 46.9 matheusrdgsf/cesar-ptbr
- 46.9 TheBloke/zephyr-7B-beta-GPTQ
- 46.7 01-ai/Yi-6B-200K
- 46.6
Qwen1.5-4B-Chat
- 46.5
Falcon3-3B-Instruct
- 46.3
Yi-1.5-6B-Chat
- 46.2 Qwen/Qwen-7B-Chat
- 46.2 allenai/tulu-2-13b
- 46.2
Qwen2.5-3B
- 46.0 rhaymison/Mistral-portuguese-luana-7b-Mathematics
- 45.9 hkust-nlp/deita-7b-v1.0
- 45.8 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3
- 45.8 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3
- 45.6
Qwen1.5-14B
- 45.6 Weni/ZeroShot-Multilanguage-Zephyr-7B
- 45.6 meta-llama/Llama-2-13b-chat-hf
- 45.6 rhaymison/portuguese-tom-cat-13b
- 45.6 rfanucchi/Llama3-pt_br_cabrita
- 45.6 botbot-ai/CabraMistral-v3-7b-32k
- 45.6
DeepSeek-R1-Distill-Llama-70B
- 45.6 Motif-Technologies/Motif-2.6B
- 45.5 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2
- 45.5 nvidia/Llama-3.1-Nemotron-Nano-8B-v1
- 45.3
Qwen3-4B-Base
- 45.1 princeton-nlp/Mistral-7B-Base-SFT-DPO
- 44.9 recogna-nlp/zephyr_7b_beta_ultraalpaca
- 44.5 meta-llama/Llama-2-13b-hf
- 44.4 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft
- 44.2 lmsys/vicuna-13b-v1.5
- 44.2 allenai/tulu-2-7b
- 44.2 Motif-Technologies/Motif-2.6b-v1.1-LC
- 44.1 allenai/tulu-2-dpo-7b
- 44.1 SakanaAI/DiscoPOP-zephyr-7b-gemma
- 44.1 AIDC-AI/Marco-LLM-ES
- 43.8 BAAI/Aquila2-34B
- 43.7 OliveiraJLT/Sagui-7B-Instruct-v0.1
- 43.5 THUDM/chatglm3-6b-32k
- 43.4
Qwen3-0.6B
- 43.3 GuiCas/Phituguese_FP16
- 43.1 abacusai/Liberated-Qwen1.5-14B
- 42.8 google/medgemma-4b-pt
- 42.7 xverse/XVERSE-13B
- 42.6 rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct
- 42.6 01-ai/Yi-Coder-9B-Chat
- 42.3 LFM2-1.2B
- 42.3 kurakurai/Luth-0.6B-Instruct
- 42.0 Deci/DeciLM-7B
- 41.9 J-LAB/Brisa_v0.2_sft
- 41.7 google/gemma-2-2b
- 41.7 dfurman/Llama-3-8B-Orpo-v0.1
- 41.7 kurakurai/Luth-LFM2-1.2B
- 41.6
Mistral-7B-Instruct-v0.1
- 41.6 LiquidAI/LFM2-700M
- 41.5 Qwen/Qwen1.5-MoE-A2.7B
- 41.3 lmsys/vicuna-7b-v1.5
- 41.3 rfanucchi/Llama3-pt_br_cabrit_orca_qkvo
- 41.3 princeton-nlp/Mistral-7B-Base-SFT-RRHF
- 41.2 tiiuae/Falcon3-3B-Base
- 40.9 nicolasdec/cabra13b
- 40.8 recogna-nlp/phibode-3-mini-4k-ultraalpaca
- 40.8 TIGER-Lab/Qwen2.5-Math-7B-CFT
- 40.6 Xwin-LM/Xwin-LM-7B-V0.1
- 40.6 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full
- 40.5 X-D-Lab/XrayQwen
- 40.3 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct
- 40.1 baichuan-inc/Baichuan2-7B-Base
- 40.1 kurakurai/Luth-LFM2-700M
- 39.8 recogna-nlp/mistral-bode
- 39.8 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2
- 39.5 01-ai/Yi-Coder-9B
- 39.1 h2oai/h2o-danube3.1-4b-chat
- 38.9 migtissera/Tess-3-Mistral-Nemo-12B
- 38.8 xverse/XVERSE-65B-2
- 38.7
MPT-30B
- 38.5 AdaptLLM/finance-LLM-13B
- 38.4 deepseek-ai/deepseek-llm-7b-base
- 38.3 recogna-nlp/bode-13b-alpaca-pt-br
- 38.3 h2oai/h2o-danube3-4b-chat
- 38.3 J-LAB/FluxiIA-Small_Brisa
- 38.0 AdaptLLM/law-LLM-13B
- 38.0 deepseek-ai/deepseek-moe-16b-chat
- 37.8 xverse/XVERSE-65B
- 37.7 ghost-x/ghost-8b-beta
- 37.7 gpt-oss-20b
- 37.5
Qwen1.5-7B
- 37.5 AdaptLLM/medicine-LLM-13B
- 37.4 Xwin-LM/Xwin-LM-7B-V0.2
- 37.3 haoranxu/ALMA-13B-Pretrain
- 37.0 rfanucchi/Llama3-pt_br_orca
- 36.9 xverse/XVERSE-7B
- 36.7 THUDM/agentlm-7b
- 36.6 Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized
- 36.6 recogna-nlp/gembode-7b-it
- 36.4 h2oai/h2o-danube3-4b-base
- 36.4 tanliboy/lambda-qwen2.5-32b-dpo-test
- 36.3 NousResearch/Nous-Hermes-13b
- 36.2 Qwen/Qwen1.5-4B
- 36.0 eduagarcia/gemma-7b-it_no_chat_template
- 36.0 stabilityai/stablelm-zephyr-3b
- 36.0
Qwen3-8B-Base
- 35.6 ChatGLM3-6B
- 35.5 THUDM/chatglm3-6b-128k
- 35.5 Qwen/Qwen2.5-0.5B-Instruct
- 34.6 cnmoro/Qwen2.5-0.5B-Portuguese-v1
- 34.5
Qwen2-0.5B-Instruct
- 33.7 THUDM/LongAlign-7B-64k
- 33.5 internlm-7b
- 33.4 nicolasdec/Cabra
- 33.2 stabilityai/stablelm-2-1_6b-chat
- 33.2 cognitivecomputations/dolphin-2.9.3-llama-3-8b
- 33.0
Gemma 3 1B
- 32.8
LLaMA-13B
- 32.7 rhaymison/Llama-portuguese-13b-Luana-v0.2
- 32.7 cognitivecomputations/dolphin-2.9.1-mixtral-1x22b
- 32.7 BAAI/OPI-Llama-3.1-8B-Instruct
- 32.4 stabilityai/stablelm-2-zephyr-1_6b
- 32.3 internlm/internlm2-chat-1_8b
- 32.3 internlm/internlm2_5-1_8b
- 32.1 internlm/internlm2-chat-1_8b-sft
- 31.7 internlm/internlm2-1_8b
- 31.7 cognitivecomputations/WizardLM-13B-Uncensored
- 31.6 AdaptLLM/law-LLM
- 31.6 internlm/internlm2_5-1_8b-chat
- 31.6
Falcon3-1B-Instruct
- 31.4 haoranxu/ALMA-13B-R
- 31.4 google/recurrentgemma-2b-it
- 31.4 Oburaco/llama2-qlora-finetunined-ptbr
- 31.4 TinyPixel/Llama-2-7B-bf16-sharded
- 31.4 rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora
- 31.4 unsloth/Llama-3.2-1B-Instruct
- 31.4 cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning
- 31.3 meta-llama/Llama-2-7b-hf
- 31.3 AdaptLLM/medicine-LLM
- 31.0 kurakurai/Luth-LFM2-350M
- 30.7 recogna-nlp/internlm2-chat-1_8b-ultracabrita
- 30.6 Unbabel/TowerBase-7B-v0.1
- 30.6 tensoropera/Fox-1-1.6B-Instruct-v0.1
- 30.6 meta-llama/Llama-3.2-1B-Instruct
- 30.3 deepseek-ai/deepseek-moe-16b-base
- 30.3 google/gemma-7b-it
- 30.3
MAmmoTH2-8B-Plus
- 30.3 tiiuae/Falcon-H1-0.5B-Instruct
- 30.2 GeneZC/MiniMA-2-3B
- 29.9 chatglm2-6b
- 29.9 stabilityai/stablelm-3b-4e1t
- 29.8 dominguesm/canarim-7b
- 29.8 stabilityai/stablelm-base-alpha-7b-v2
- 29.8 Qwen/Qwen1.5-1.8B-Chat
- 29.6 NTQAI/Nxcode-CQ-7B-orpo
- 29.6 deepseek-ai/DeepSeek-R1-Distill-Llama-8B
- 29.5 LiquidAI/LFM2-350M
- 29.2 lrds-code/boana-7b-instruct
- 29.2
DeepSeek-R1-Distill-Qwen-32B
- 29.1 AdaptLLM/finance-LLM
- 29.1 semantixai/LloroV2
- 29.1 meta-llama/Llama-2-7b-chat-hf
- 29.1 rhaymison/gemma-portuguese-tom-cat-2b-it
- 28.9 recogna-nlp/bode-7b-alpaca-pt-br
- 28.9 langtech-languagemodeling/IberianLLM-7B-Instruct
- 28.8 Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT
- 28.8 Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT
- 28.8 GeneZC/MiniLoong-3B
- 28.4
Gemma 2B
- 28.4 h2oai/h2o-danube2-1.8b-base
- 28.4 nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1
- 28.2 baichuan-inc/Baichuan2-13B-Base
- 28.1 AI-Sweden-Models/gpt-sw3-40b
- 28.1 mosaicml/mpt-7b-8k
- 28.1 h2oai/h2o-danube2-1.8b-chat
- 28.0 BAAI/Aquila-7B
- 27.7 pfnet/plamo-13b
- 27.4 unsloth/gemma-2b-bnb-4bit
- 27.4 cognitivecomputations/dolphin-2.9.4-llama3.1-8b
- 27.1 BSC-LT/salamandra-7b
- 27.1 baidu/ERNIE-4.5-0.3B-Base-PT
- 27.0
Phi-2
- 26.8 nbeerbower/gemma2-gutenberg-27B
- 26.8 TucanoBR/Tucano-630m
- 26.8 cnmoro/Qwen2.5-0.5B-Portuguese-v2
- 26.6 DAMO-NLP-MT/polylm-1.7b
- 26.6 Oburaco/ptbr-falcon-7b
- 26.3 Baichuan2-13B-Chat
- 26.3 Qwen-1_8B
- 26.1 dominguesm/Canarim-7B-Instruct
- 26.1 google/recurrentgemma-2b
- 26.0 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora
- 26.0 tiiuae/Falcon3-1B-Base
- 26.0 BSC-LT/salamandra-2b
- 25.9 OpenLLM-France/Claire-7B-0.1
- 25.9 google/gemma-2b-it
- 25.9 recogna-nlp/gembode-2b-ultraalpaca
- 25.7 AI-Sweden-Models/gpt-sw3-6.7b
- 25.7 nicholasKluge/TeenyTinyLlama-460m
- 25.7 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca
- 25.6
OPT-66B
- 25.6 stabilityai/stablelm-2-1_6b
- 25.6 TucanoBR/Tucano-1b1
- 25.6 gpt-oss-120b
- 25.4 nicholasKluge/TeenyTinyLlama-460m-Chat
- 25.4 Qwen/Qwen1.5-0.5B-Chat
- 25.4 allenai/OLMo-2-0425-1B
- 25.3 cerebras/btlm-3b-8k-base
- 25.3 recogna-nlp/GemBode-2b-it
- 25.3 recogna-nlp/Phi-Bode
- 25.3
SmolLM-360M
- 25.3 GeneZC/MiniMA-3B
- 25.3 TheDrummer/Big-Tiger-Gemma-27B-v1
- 25.2 croissantllm/CroissantLLMBase
- 25.2 Qwen/Qwen1.5-1.8B
- 25.2 recogna-nlp/phi-bode-2-ultraalpaca
- 25.2 MulaBR/Mula-4x160-v0.1
- 25.2 anthracite-org/magnum-v4-9b
- 25.2 TucanoBR/Tucano-160m
- 25.0 RedPajama-INCITE-7B-Base
- 25.0 openlm-research/open_llama_7b_v2
- 25.0 TucanoBR/Tucano-2b4
- 24.9 microsoft/phi-1
- 24.9
Gemma 1.1 2B IT
- 24.9 rhaymison/gemma-portuguese-luana-2b
- 24.9 h2oai/h2o-danube2-1.8b-sft
- 24.9
OLMo 2 1B Instruct
- 24.8 openlm-research/open_llama_13b
- 24.8 TheBloke/wizardLM-7B-HF
- 24.6 togethercomputer/RedPajama-INCITE-Base-3B-v1
- 24.6 haoranxu/ALMA-7B-R
- 24.5 Bruno/Caramelo_7B
- 24.5 Weni/WeniGPT-Mistral-7B-instructBase-4bit
- 24.5 tensoropera/Fox-1-1.6B
- 24.3 Ramikan-BR/Qwen2-0.5B-v5
- 24.3 tiiuae/Falcon-H1-0.5B-Base
- 24.2
Cerebras-GPT-13B
- 24.2 facebook/galactica-30b
- 24.2 recogna-nlp/gembode-2b-base-ultraalpaca
- 24.2 yahma/llama-7b-hf
- 24.1 fernandosola/bluearara-7B-instruct
- 24.1 Ramikan-BR/Qwen2-0.5B-v9
- 24.1 TinyLlama/TinyLlama_v1.1
- 24.1 Emu3-Chat
- 23.9
LLaMA-7B
- 23.9 matsuo-lab/weblab-10b
- 23.9 Oburaco/ptbr-falcon-7b-v3
- 23.9 vilsonrodrigues/falcon-7b-instruct-sharded
- 23.6 GPT-J-6B
- 23.6 bigscience/bloom-7b1
- 23.6 EleutherAI/pythia-410m
- 23.6 allenai/OLMo-7B-Twin-2T
- 23.5
Phi-1.5
- 23.5 AI-Sweden-Models/gpt-sw3-6.7b-v2
- 23.5 Weni/WeniGPT-Mistral-7B-instructBase
- 23.5 M4-ai/tau-1.8B
- 23.5 cognitivecomputations/WizardLM-7B-Uncensored
- 23.5 RogerioPiazzon/alpaca-lora-ptbr-7b
- 23.4 projecte-aina/FLOR-760M
- 23.4 facebook/xglm-4.5B
- 23.4
Llama 3.2 1B
- 23.2 NucleusAI/nucleus-22B-token-500B
- 23.2 ericzzz/falcon-rw-1b-instruct-openorca
- 23.2 lucianosb/boto-27B
- 23.1 22h/cabrita_7b_pt_850000
- 23.1 nicholasKluge/TeenyTinyLlama-160m
- 22.9 openlm-research/open_llama_3b_v2
- 22.9 fernandosola/bluearara-7B
- 22.9 Oburaco/juridic-falcon-7b
- 22.8 GPT-NeoX-20B
- 22.8 TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
- 22.8 TechxGenus/Jamba-v0.1-9B
- 22.8
SmolLM-1.7B
- 22.8 TucanoBR/Tucano-2b4-Instruct
- 22.8 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview
- 22.7
MPT-7B
- 22.7 stabilityai/stablelm-base-alpha-3b-v2
- 22.7 cerebras/Cerebras-GPT-590M
- 22.7 EleutherAI/pythia-12b
- 22.7 h2oai/h2o-danube-1.8b-base
- 22.5 AI-Sweden-Models/gpt-sw3-20b
- 22.5 EleutherAI/pythia-2.8b-deduped
- 22.5 unicamp-dl/ptt5-base-portuguese-vocab
- 22.5 unicamp-dl/ptt5-small-portuguese-vocab
- 22.5 state-spaces/mamba-790m-hf
- 22.5
Qwen2-0.5B
- 22.5 baidu/ERNIE-4.5-0.3B-PT
- 22.4 EleutherAI/pythia-2.8b
- 22.4 nicolasdec/CabraMistral7b-0.4
- 22.4 proxectonos/FLOR-1.3B-GL
- 22.4 utter-project/EuroLLM-1.7B
- 22.3 openlm-research/open_llama_3b
- 22.3
Gemma 3 1B PT
- 22.1 EleutherAI/pythia-6.9b-deduped
- 22.1 cerebras/Cerebras-GPT-6.7B
- 22.1 Bruno/Caramelinho
- 22.1 GeneZC/MiniMA-2-1B
- 22.0
Falcon-7B
- 22.0 open_llama_7b
- 22.0 Ramikan-BR/TiamaPY-v31
- 21.8 facebook/opt-30b
- 21.8 Ramikan-BR/TiamaPY-v30
- 21.8 fernandosola/bluearara-7B-instruct-v02
- 21.7 GPT-Neo-2.7B
- 21.7 LiteAI/Hare-1.1B-base
- 21.6 projecte-aina/FLOR-6.3B
- 21.6 facebook/galactica-6.7b
- 21.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0
- 21.6 recogna-nlp/gembode-2b-ultraalpaca-qlora
- 21.6 utter-project/EuroLLM-1.7B-Instruct
- 21.4 bigscience/bloom-1b7
- 21.4 openai-community/gpt2-xl
- 21.4 pierreguillou/gpt2-small-portuguese
- 21.3 openai-community/gpt2-large
- 21.3 facebook/galactica-1.3b
- 21.3 JosephusCheung/LL7M
- 21.3 M4-ai/tau-0.5B-instruct-DPOP
- 21.3 MulaBR/Mula-8x160-v0.1
- 21.3 h2oai/h2o-danube-1.8b-sft
- 21.3 rhaymison/portuguese-phi1_5-tom-cat
- 21.1 22h/open-cabrita3b
- 21.1 wandgibaut/periquito-3B
- 21.0 allenai/OLMo-7B
- 21.0 PORTULAN/gervasio-7b-portuguese-ptbr-decoder
- 20.9 facebook/opt-2.7b
- 20.9 EleutherAI/pythia-70m
- 20.7 dynamofl/dynamo-8B-v0.1
- 20.7 HuggingFaceTB/cosmo-1b
- 20.7 pedrogengo/gemma-ptbr
- 20.7 recogna-nlp/phibode_1_5_ultraalpaca
- 20.7 BAAI/Emu3-Stage1
- 20.6 bigscience/bloom-3b
- 20.6 EleutherAI/pythia-1b-deduped
- 20.6 openai-community/gpt2-medium
- 20.6 nisten/Biggie-SmoLlm-0.15B-Base
- 20.3 EleutherAI/pythia-6.9b
- 20.3 state-spaces/mamba-1.4b-hf
- 20.3 state-spaces/mamba-370m-hf
- 20.3 recogna-nlp/gembode-2b-base-ultraalpaca-qlora
- 20.2 baichuan-inc/Baichuan-7B
- 20.2 EleutherAI/pythia-410m-deduped
- 20.2 facebook/xglm-7.5B
- 20.2 nicholasKluge/baseline
- 20.0 LiteAI/Hare-1.1B-Chat
- 20.0
Qwen2.5-Coder-32B
- 20.0 proxectonos/Llama-3.1-Carballo
- 19.9 facebook/xglm-1.7B
- 19.9 state-spaces/mamba-2.8b-hf
- 19.9 adalbertojunior/Mistral-7b-Portuguese-V0.1
- 19.9 Delta-Vector/Odin-9B
- 19.8 facebook/xglm-2.9B
- 19.8 facebook/xglm-564M
- 19.6 cerebras/Cerebras-GPT-2.7B
- 19.5 stabilityai/stablelm-base-alpha-3b
- 19.5 BAAI/Emu3-Gen
- 19.3 gpt2
- 19.3 h2oai/h2o-danube-1.8b-chat
- 19.3 proxectonos/Cerebras-1.3B-GL
- 19.2
OPT-1.3B
- 19.2 EleutherAI/pythia-1b
- 19.2 Nos-PT/Carvalho_pt-gl-1.3B
- 19.2
SmolLM-135M
- 19.1 facebook/opt-6.7b
- 19.1 projecte-aina/aguila-7b
- 19.1 EleutherAI/pythia-160m
- 18.9 bigscience/bloom-560m
- 18.9 stabilityai/stablelm-base-alpha-7b
- 18.9 allenai/OLMo-1B
- 18.9 Qwen/Qwen1.5-0.5B
- 18.9 PORTULAN/gervasio-7b-portuguese-ptpt-decoder
- 18.9 M4-ai/tau-0.5B
- 18.9 h2oai/h2o-danube3-500m-base
- 18.9 premai-io/prem-1B-chat
- 18.9 Nos-PT/Llama-Carvalho-PT
- 18.9 Nos-PT/Llama-Carvalho-PT-GL
- 18.8 projecte-aina/FLOR-1.3B
- 18.8 state-spaces/mamba-130m-hf
- 18.6 Ramikan-BR/tinyllama-coder-py-4bit-v10
- 18.6 h2oai/h2o-danube3-500m-chat
- 18.5 EleutherAI/gpt-neo-125m
- 18.5 HuggingFaceTB/SmolLM-1.7B-Instruct
- 18.5
Gemma 3 270M
- 18.4 EleutherAI/gpt-neo-1.3B
- 18.4 EleutherAI/pythia-70m-deduped
- 18.4 facebook/opt-125m
- 18.4 josu/gpt-neo-pt-1.3B
- 18.4 cerebras/Cerebras-GPT-256M
- 18.2 facebook/opt-350m
- 18.1 cerebras/Cerebras-GPT-111M
- 17.9 EleutherAI/pythia-14m
- 17.9 EleutherAI/pythia-160m-deduped
- 17.7 josu/gpt-neo-pt-br
- 17.1 nicholasKluge/Aira-2-portuguese-124M
- 16.7 HuggingFaceTB/SmolLM-360M-Instruct
- 16.4 artificialguybr/llama3-8b-alpacadata-ptbr
- 16.3 HuggingFaceTB/SmolLM-135M-Instruct
- 15.4 FluxiIA/Tucaninho_dpo
- 15.3 FluxiIA/Tucaninho
- 14.9 facebook/galactica-125m
- 14.5 BAAI/Aquila2-7B
- 14.5 deepseek-ai/DeepSeek-V2-Lite
- 13.9
DeepSeek-R1-Distill-Qwen-1.5B
- 13.5 T5-Large
- 13.1 T5-Small
- 12.9 pucpr/gpt2-bio-pt
- 11.3 internlm/internlm2_5-7b
- 10.7 Ramikan-BR/tinyllama-coder-py-v11
- 10.6 dominguesm/mambarim-110m
- 10.6 Qwen/Qwen3-0.6B-Base
- 10.4 ai-forever/mGPT-13B
- 10.3 google/mt5-base
- 10.2 T5-Base
- 9.60 NLPark/AnFeng_v3_Avocet
- 8.07 lrds-code/samba-1.1B
- 7.51 EleutherAI/polyglot-ko-12.8b
- 6.68
Qwen2.5-0.5B
- 6.12 adalbertojunior/NeuralDaredevil-Dolphin-Portuguese
- 3.89 HeyLucasLeao/gpt-neo-small-portuguese
- 3.48 JJhooww/Mistral_Reload_v4_Functions
- 3.20 NOVA-vision-language/GlorIA-1.3B
- 2.78 Ramikan-BR/tinyllama-coder-py-v12
- 1.11 Qwen/Qwen-1_8B-Chat
- 0.83 ssmits/Falcon2-5.5B-multilingual
- 0.83 ssmits/Falcon2-5.5B-Portuguese
- 0.70 monilouise/opt125M_portuguese
- 0.70 Qwen/Qwen-72B-Chat
- 0.70 MTSAIR/multi_verse_model
- 0.70 internlm/internlm2_5-20b
- 0.42 MaziyarPanahi/Calme-4x7B-MoE-v0.2
- 0.28 nicholasKluge/Aira-2-portuguese-1B7
- 0.28 MaziyarPanahi/Calme-4x7B-MoE-v0.1
- 0.14 eduagarcia/gemma-7b-it_singleturn_chat_template
- 0.14 google/mt5-small
- 0.14 meta-llama/Meta-Llama-3-8B-Instruct
- 0.14 abacusai/Llama-3-Smaug-8B
- 0.14
Qwen2.5-1.5B
- 0.14 gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES
- 0.14 RLHFlow/ArmoRM-Llama3-8B-v0.1
- 0.0 nicholasKluge/Aira-2-portuguese-560M
- 0.0 openai-community/openai-gpt
- 0.0 ai-forever/mGPT
- 0.0 DAMO-NLP-MT/polylm-13b
- 0.0 rhaymison/gemma-portuguese-2b-it
- 0.0 Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO
- 0.0 abhishek/autotrain-llama3-orpo-v2
- 0.0 WizardLMTeam/WizardLM-13B-V1.0
- 0.0 recogna-nlp/phibode_1_5_ultraalpaca_qlora
- 0.0 cognitivess/bella-1-8b
- 0.0 GeneZC/MiniChat-1.5-3B
- 0.0 GeneZC/MiniChat-2-3B
- 0.0 GeneZC/MiniChat-3B
- 0.0 monsterapi/Llama-3_1-8B-Instruct-orca-ORPO
- 0.0 kaist-ai/janus-rm-7b
- 0.0 J-LAB/Qwen2.5_Thinik_base_v1.0
- 0.0 J-LAB/Thinik
- 1
Gemini 2.5 Pro Mar 2025, Three-shot, text-only, reasoning, 2025-04-03 95%
- 2 GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
- 3 Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
- 4
Gemini 2.5 Flash Jun 2025, Three-shot, text-only, 2025-09-01 86.5%
- 5
Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
- 6 GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
- 7 Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
- 8
DeepSeek-V3 Mar 2025, Three-shot, text-only, 2025-04-03 84.1%
- 9
Gemini 2.5 Flash-Lite Jun 2025, Three-shot, text-only, reasoning: low, 2025-09-01 84%
- 10
Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
- 11
Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
- 12 Kimi K2 Jul 2025, Three-shot, text-only, 2025-09-01 82.8%
- 13
DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
- 14 Sabiá-3.1 (2025-05-08) Three-shot, text-only, 2025-09-01 81.8%
- 15
Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
- 16
Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
- 17
Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
- 18
Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
- 19
Gemini 2.0 Flash Feb 2025, Three-shot, text-only, 2025-04-03 80.4%
- 20 meta-llama/Llama-3.1-405B-Instruct (Vertex AI) Three-shot, text-only, 2024-08-20 80.1%
- 21 GPT-4o Aug 2024, Three-shot, text-only, 2025-04-09 79.7%
- 22 Sabiá-3 (2024-07-15) Three-shot, text-only, 2024-08-20 79%
- 23
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
- 24 GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
- 25
Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
- 26 Sabiá-3 (2024-12-11) Three-shot, text-only, 2025-09-01 78.7%
- 27 huihui-ai/Qwen2.5-32B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-10-04 78.6%
- 28 rombodawg/Rombos-LLM-V2.5-Qwen-32b Three-shot, text-only, bfloat16, 2024-10-10 78.6%
- 29 Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B Three-shot, text-only, bfloat16, 2025-01-21 78.6%
- 30 Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B Three-shot, text-only, bfloat16, 2025-01-21 78.6%
- 31 maldv/Qwentile2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-12-21 78.4%
- 32 Qwen/Qwen2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-09-18 78.3%
- 33 AXCXEPT/EZO-Qwen2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-10-04 78.3%
- 34 Sakalti/Oxyge1-33B Three-shot, text-only, bfloat16, 2024-12-21 78.3%
- 35
Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
- 36 fblgit/TheBeagle-v2beta-32B-MGS Three-shot, text-only, bfloat16, 2024-12-12 78%
- 37
Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
- 38 tiiuae/Falcon-H1-34B-Base Three-shot, text-only, bfloat16, 2025-07-08 77.8%
- 39 huihui-ai/QwQ-32B-Coder-Fusion-9010 Three-shot, text-only, bfloat16, 2024-12-12 77.6%
- 40 Gemini 1.5 Pro Preview (0409) Three-shot, text-only, 2024-04-15 77.2%
- 41
Qwen3-30B-A3B-Instruct Jul 2025, Three-shot, text-only, bfloat16, 2025-08-30 76.9%
- 42
Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
- 43
QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
- 44 huihui-ai/QwQ-32B-Preview-abliterated Three-shot, text-only, bfloat16, 2024-12-12 76.5%
- 45
DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
- 46 OpenBuddy/openbuddy-qwq-32b-v24.1-200k Three-shot, text-only, bfloat16, 2025-01-22 76.5%
- 47
Gemini 1.5 Flash Sep 2024, Three-shot, text-only, 2025-04-03 76.1%
- 48
Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
- 49
Gemini 1.5 Flash May 2024, Three-shot, text-only, 2024-08-09 75.8%
- 50
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
- 51 google/medgemma-27b-text-it Three-shot, text-only, bfloat16, 2025-07-15 75.4%
- 52 meta-llama/Meta-Llama-3.1-70B-Instruct Three-shot, text-only, bfloat16, 2024-07-23 75.1%
- 53 amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct Three-shot, text-only, float16, 2025-06-16 75.1%
- 54 Gemini 1.5 Flash Preview (0514) Three-shot, text-only, 2024-05-18 74.8%
- 55 nisten/franqwenstein-35b Three-shot, text-only, bfloat16, 2024-10-10 74.8%
- 56 meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI) Three-shot, text-only, 2025-04-03 74.8%
- 57 arcee-ai/Virtuoso-Small Three-shot, text-only, bfloat16, 2024-12-21 74.5%
- 58 prithivMLmods/Megatron-Opus-14B-Exp Three-shot, text-only, bfloat16, 2025-02-03 74.1%
- 59 sometimesanotion/Qwen2.5-14B-Vimarckoso-v3 Three-shot, text-only, bfloat16, 2025-01-21 74%
- 60 mistralai/Mistral-Small-24B-Base-2501 Three-shot, text-only, bfloat16, 2025-01-31 74%
- 61 google/gemma-3-27b-it (GoogleAI API) Three-shot, text-only, 2025-04-08 73.8%
- 62 Replete-AI/Replete-LLM-V2.5-Qwen-14b Three-shot, text-only, bfloat16, 2024-10-01 73.7%
- 63 rombodawg/Rombos-LLM-V2.6-Qwen-14b Three-shot, text-only, bfloat16, 2024-10-14 73.6%
- 64 hotmailuser/QwenSlerp2-14B Three-shot, text-only, bfloat16, 2025-01-21 73.6%
- 65 sometimesanotion/Lamarck-14B-v0.6 Three-shot, text-only, bfloat16, 2025-01-21 73.6%
- 66 sometimesanotion/Lamarck-14B-v0.7 Three-shot, text-only, bfloat16, 2025-02-02 73.6%
- 67 meta-llama/Meta-Llama-3-70B-Instruct Three-shot, text-only, bfloat16, 2024-04-18 73.4%
- 68 v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Three-shot, text-only, bfloat16, 2024-09-28 73.4%
- 69 allknowingroger/Qwen2.5-slerp-14B Three-shot, text-only, bfloat16, 2024-11-01 73.4%
- 70 mistralai/Mistral-Small-24B-Instruct-2501 Three-shot, text-only, bfloat16, 2025-01-31 73.4%
- 71 Sabiázinho-3 (2025-02-06) Three-shot, text-only, 2025-09-01 73.4%
- 72 Qwen/Qwen2.5-14B-Instruct Three-shot, text-only, bfloat16, 2024-09-18 73.3%
- 73 Lambent/qwen2.5-reinstruct-alternate-lumen-14B Three-shot, text-only, bfloat16, 2024-09-28 73.3%
- 74 v000000/Qwen2.5-14B-Gutenberg-1e-Delta Three-shot, text-only, bfloat16, 2024-09-28 73.3%
- 75 CultriX/Qwen2.5-14B-Wernicke Three-shot, text-only, bfloat16, 2024-11-17 73.3%
- 76 allknowingroger/QwenSlerp6-14B Three-shot, text-only, bfloat16, 2024-12-21 73.3%
- 77 tanliboy/lambda-qwen2.5-14b-dpo-test Three-shot, text-only, bfloat16, 2024-09-28 73.2%
- 78 Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 Three-shot, text-only, bfloat16, 2024-11-01 73.2%
- 79 CultriX/SeQwence-14Bv1 Three-shot, text-only, bfloat16, 2024-12-21 72.5%
- 80 janhq/Jan-v1-4B Three-shot, text-only, bfloat16, 2025-08-30 72.3%
- 81 meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API) Three-shot, text-only, 2025-04-05 72.2%
- 82 arcee-ai/SuperNova-Medius Three-shot, text-only, bfloat16, 2024-10-20 72%
- 83 CultriX/Qwen2.5-14B-Wernicke-SFT Three-shot, text-only, bfloat16, 2024-11-17 72%
- 84
Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
- 85 Sabiá-2 Medium Three-shot, text-only, 2024-04-13 71.8%
- 86 Qwen/Qwen1.5-110B-Chat Three-shot, text-only, 4bit, 2024-05-23 71.8%
- 87 AALF/gemma-2-27b-it-SimPO-37K-100steps Three-shot, text-only, bfloat16, 2024-09-21 71.6%
- 88
Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
- 89 byroneverson/gemma-2-27b-it-abliterated Three-shot, text-only, bfloat16, 2024-09-05 71.1%
- 90
Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
- 91 Qwen-Turbo (2024-11-01) Three-shot, text-only, 2025-04-03 70.8%
- 92 google/gemma-2-27b-it Three-shot, text-only, bfloat16, 2024-07-02 70.5%
- 93
Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
- 94 THUDM/GLM-Z1-9B-0414 Three-shot, text-only, bfloat16, 2025-05-01 70.4%
- 95
Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
- 96 botbot-ai/CabraLlama3-70b Three-shot, text-only, bfloat16, 2024-06-21 70.1%
- 97 tiiuae/Falcon-H1-7B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 70.1%
- 98 abacusai/Smaug-Llama-3-70B-Instruct Three-shot, text-only, bfloat16, 2024-05-17 69.5%
- 99 DeepSeek-V2 Chat (API) Three-shot, text-only, 2024-05-18 69.5%
- 100 google/medgemma-27b-it Three-shot, text-only, bfloat16, 2025-07-15 69.3%
- 101 unsloth/llama-3-70b-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 68.8%
- 102 tiiuae/Falcon-H1-7B-Base Three-shot, text-only, bfloat16, 2025-07-08 68.7%
- 103 Qwen/Qwen-72B Three-shot, text-only, bfloat16, 2024-02-05 68.4%
- 104 GPT 4o Mini (2024-07-18) Three-shot, text-only, 2024-07-25 68.4%
- 105 abacusai/Smaug-72B-v0.1 Three-shot, text-only, bfloat16, 2024-02-28 68.3%
- 106 unsloth/Llama-3.3-70B-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-12-10 68.2%
- 107
Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
- 108 Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp Three-shot, text-only, bfloat16, 2024-06-16 68%
- 109
Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
- 110 huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-12-12 68%
- 111
Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
- 112 01-ai/Yi-1.5-34B-32K Three-shot, text-only, bfloat16, 2024-05-20 67.9%
- 113 cognitivecomputations/dolphin-2.9.1-llama-3-70b Three-shot, text-only, bfloat16, 2024-05-24 67.9%
- 114 Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
- 115 qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
- 116
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
- 117 Weyaxi/Bagel-Hermes-34B-Slerp Three-shot, text-only, rev: 459676b, bfloat16, 2024-05-26 67.6%
- 118 botbot-ai/Cabra-72b Three-shot, text-only, bfloat16, 2024-04-06 67.5%
- 119 unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-08-13 67.3%
- 120
Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
- 121 mistral-community/Mixtral-8x22B-v0.1-4bit Three-shot, text-only, 4bit, 2024-04-12 67.2%
- 122 Azure99/blossom-v5.1-34b Three-shot, text-only, bfloat16, 2024-06-05 67.2%
- 123 VAGOsolutions/SauerkrautLM-Qwen-32b Three-shot, text-only, bfloat16, 2024-06-05 67.2%
- 124 jondurbin/bagel-dpo-34b-v0.2 Three-shot, text-only, bfloat16, 2024-05-16 66.9%
- 125 altomek/YiSM-34B-0rn Three-shot, text-only, float16, 2024-06-06 66.9%
- 126 jondurbin/bagel-dpo-34b-v0.5 Three-shot, text-only, bfloat16, 2024-05-16 66.8%
- 127 upstage/solar-pro-preview-instruct Three-shot, text-only, bfloat16, 2024-09-18 66.8%
- 128 Claude-3 Haiku (20240307) Three-shot, text-only, 2024-04-13 66.6%
- 129
Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
- 130 mistralai/Mixtral-8x22B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-20 66.6%
- 131 Orion-zhen/Qwen2.5-7B-Instruct-Uncensored Three-shot, text-only, bfloat16, 2024-10-19 66.6%
- 132
Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
- 133
Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
- 134 SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit Three-shot, text-only, 4bit, 2024-04-17 66.5%
- 135 01-ai/Yi-1.5-34B-Chat Three-shot, text-only, bfloat16, 2024-05-15 66.5%
- 136 Cran-May/T.E-8.1 Three-shot, text-only, bfloat16, 2024-09-30 66.5%
- 137 Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
- 138 Qwen/Qwen2.5-7B-Instruct-1M Three-shot, text-only, float16, 2025-09-01 66.5%
- 139 adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1 Three-shot, text-only, bfloat16, 2024-04-30 66.3%
- 140 CohereForAI/c4ai-command-r-plus-4bit Three-shot, text-only, 4bit, 2024-04-05 66.2%
- 141 mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit Three-shot, text-only, 4bit, 2024-04-20 66.2%
- 142 CombinHorizon/YiSM-blossom5.1-34B-SLERP Three-shot, text-only, bfloat16, 2024-08-27 66.2%
- 143 VAGOsolutions/SauerkrautLM-Phi-3-medium Three-shot, text-only, bfloat16, 2024-09-19 66.2%
- 144 CausalLM/34b-beta Three-shot, text-only, bfloat16, 2024-05-30 66.1%
- 145
Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
- 146 NousResearch/Nous-Hermes-2-Yi-34B Three-shot, text-only, bfloat16, 2024-02-27 65.8%
- 147 abacusai/Smaug-34B-v0.1 Three-shot, text-only, bfloat16, 2024-02-28 65.8%
- 148
WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
- 149 ConvexAI/Luminex-34B-v0.2 Three-shot, text-only, float16, 2024-05-30 65.8%
- 150
Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
- 151 wenbopan/Faro-Yi-34B-DPO Three-shot, text-only, bfloat16, 2024-06-14 65.8%
- 152 Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO Three-shot, text-only, float16, 2024-07-31 65.8%
- 153 Qwen/Qwen1.5-32B-Chat Three-shot, text-only, bfloat16, 2024-04-08 65.7%
- 154 recoilme/recoilme-gemma-2-9B-v0.4 Three-shot, text-only, rev: 2691f2c, bfloat16, 2024-09-29 65.7%
- 155 anthracite-org/magnum-v3-9b-customgemma2 Three-shot, text-only, bfloat16, 2024-09-18 65.5%
- 156 fblgit/UNA-SimpleSmaug-34b-v1beta Three-shot, text-only, bfloat16, 2024-05-15 65.4%
- 157 princeton-nlp/gemma-2-9b-it-SimPO Three-shot, text-only, bfloat16, 2024-08-10 65.4%
- 158 c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
- 159
Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
- 160
OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
- 161 baidu/ERNIE-4.5-21B-A3B-PT Three-shot, text-only, bfloat16, 2025-08-31 65.4%
- 162 Qwen/Qwen2-57B-A14B Three-shot, text-only, bfloat16, 2024-06-08 65.2%
- 163 Qwen/Qwen2-57B-A14B-Instruct Three-shot, text-only, float16, 2024-06-08 65.2%
- 164 anthracite-org/magnum-v3-9b-chatml Three-shot, text-only, bfloat16, 2024-09-18 65.2%
- 165 GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
- 166 01-ai/Yi-34B-200K Three-shot, text-only, bfloat16, 2024-02-05 64.8%
- 167 152334H/miqu-1-70b-sf Three-shot, text-only, float16, 2024-04-26 64.8%
- 168 migtissera/Tess-M-v1.3 Three-shot, text-only, float16, 2024-05-16 64.8%
- 169 ConvexAI/Luminex-34B-v0.1 Three-shot, text-only, float16, 2024-06-08 64.8%
- 170 wenbopan/Faro-Yi-34B Three-shot, text-only, bfloat16, 2024-06-14 64.8%
- 171 BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference Three-shot, text-only, bfloat16, 2024-09-02 64.8%
- 172 anthracite-org/magnum-v3-27b-kto Three-shot, text-only, bfloat16, 2024-09-15 64.7%
- 173 huihui-ai/Qwen2.5-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-21 64.7%
- 174 Gemini 1.5 Flash 8B (001) Three-shot, text-only, 2025-04-03 64.7%
- 175 GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
- 176 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-21 64.5%
- 177 Qwen/Qwen2.5-7B-Instruct Three-shot, text-only, rev: bb46c15, bfloat16, 2024-10-15 64.5%
- 178 tiiuae/Falcon3-10B-Base Three-shot, text-only, bfloat16, 2025-01-15 64.5%
- 179
Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
- 180 recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp Three-shot, text-only, bfloat16, 2024-09-16 64.3%
- 181 TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule Three-shot, text-only, bfloat16, 2025-03-07 64.3%
- 182
Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
- 183 botbot-ai/CabraMixtral-8x7b Three-shot, text-only, bfloat16, 2024-04-28 64.1%
- 184
Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
- 185 recoilme/recoilme-gemma-2-9B-v0.2 Three-shot, text-only, bfloat16, 2024-09-21 64%
- 186 arcee-ai/Virtuoso-Lite Three-shot, text-only, bfloat16, 2025-02-05 64%
- 187 Replete-AI/Replete-LLM-V2.5-Qwen-7b Three-shot, text-only, bfloat16, 2024-10-01 63.7%
- 188 sethuiyer/Qwen2.5-7B-Anvita Three-shot, text-only, bfloat16, 2024-11-01 63.7%
- 189 cognitivecomputations/dolphin-2.9.1-yi-1.5-34b Three-shot, text-only, bfloat16, 2024-05-25 63.6%
- 190 google/gemma-2-9b-it Three-shot, text-only, bfloat16, 2024-07-02 63.6%
- 191 TheDrummer/Gemmasutra-9B-v1 Three-shot, text-only, bfloat16, 2024-09-19 63.6%
- 192 huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2 Three-shot, text-only, bfloat16, 2024-10-01 63.6%
- 193
Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
- 194 OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k Three-shot, text-only, bfloat16, 2024-09-29 63.4%
- 195 01-ai/Yi-34B-Chat Three-shot, text-only, bfloat16, 2024-02-27 63.3%
- 196 lucianosb/boto-9B Three-shot, text-only, bfloat16, 2024-07-10 63.3%
- 197 rhymes-ai/Aria-Base-64K Three-shot, text-only, bfloat16, 2024-12-05 63.3%
- 198 THUDM/GLM-4-9B-0414 Three-shot, text-only, bfloat16, 2025-05-01 63.1%
- 199
Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
- 200 NousResearch/Nous-Capybara-34B Three-shot, text-only, bfloat16, 2024-04-26 63%
- 201 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 63%
- 202 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 63%
- 203
Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
- 204 speakleash/Bielik-11B-v2.2-Instruct Three-shot, text-only, bfloat16, 2024-10-17 62.7%
- 205 speakleash/Bielik-11B-v2.1-Instruct Three-shot, text-only, bfloat16, 2024-10-17 62.6%
- 206 GPT-3.5 Turbo Jan 2024, Three-shot, text-only, 2024-03-08 62.5%
- 207
phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
- 208 microsoft/Phi-3-small-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 62.5%
- 209 cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b Three-shot, text-only, bfloat16, 2024-07-25 62.5%
- 210 PrunaAI/dbrx-base-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 62.3%
- 211 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2 Three-shot, text-only, bfloat16, 2024-09-21 62.3%
- 212 recoilme/recoilme-gemma-2-9B-v0.3 Three-shot, text-only, rev: 772cab4, bfloat16, 2024-09-29 62.3%
- 213 speakleash/Bielik-11B-v2.3-Instruct Three-shot, text-only, float16, 2024-10-17 62.3%
- 214 chujiezheng/Smaug-34B-v0.1-ExPO Three-shot, text-only, bfloat16, 2024-05-30 62.2%
- 215 jpacifico/Chocolatine-14B-Instruct-4k-DPO Three-shot, text-only, float16, 2024-08-27 62.2%
- 216 MarinaraSpaghetti/NemoReRemix-12B Three-shot, text-only, bfloat16, 2024-09-17 62.2%
- 217
Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
- 218 PrunaAI/dbrx-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 62%
- 219 OrionStarAI/OrionStar-Yi-34B-Chat Three-shot, text-only, float16, 2024-06-09 62%
- 220 Weyaxi/Einstein-v7-Qwen2-7B Three-shot, text-only, bfloat16, 2024-07-16 62%
- 221 GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
- 222 tiiuae/Falcon-H1-3B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 61.9%
- 223
Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
- 224 NLPark/AnFeng_v3.1-Avocet Three-shot, text-only, float16, 2024-08-04 61.8%
- 225 MaziyarPanahi/calme-2.4-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 61.8%
- 226 allknowingroger/Ph3della5-14B Three-shot, text-only, float16, 2024-10-10 61.8%
- 227 macadeliccc/Samantha-Qwen-2-7B Three-shot, text-only, rev: 5905897, float16, 2024-07-17 61.6%
- 228
phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
- 229
Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
- 230 mistralai/Mistral-Nemo-Instruct-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.5%
- 231 speakleash/Bielik-11B-v2.0-Instruct Three-shot, text-only, bfloat16, 2024-10-17 61.5%
- 232
Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
- 233 OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k Three-shot, text-only, bfloat16, 2024-05-30 61.3%
- 234
InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
- 235
Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
- 236 informatiker/Qwen2-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-15 61.2%
- 237 MaziyarPanahi/calme-2.2-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 61.2%
- 238 natong19/Mistral-Nemo-Instruct-2407-abliterated Three-shot, text-only, bfloat16, 2024-09-21 61.2%
- 239
Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
- 240
Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
- 241 migtissera/Tess-v2.5-Phi-3-medium-128k-14B Three-shot, text-only, bfloat16, 2024-06-17 60.9%
- 242 arcee-ai/Arcee-Spark Three-shot, text-only, bfloat16, 2024-08-10 60.9%
- 243
Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
- 244 nicolasdec/CabraQwen14b Three-shot, text-only, bfloat16, 2024-04-02 60.8%
- 245 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium Three-shot, text-only, bfloat16, 2024-06-17 60.8%
- 246 lucianosb/boto-9B-it Three-shot, text-only, bfloat16, 2024-07-12 60.8%
- 247 axolotl-ai-co/romulus-mistral-nemo-12b-simpo Three-shot, text-only, rev: 19e2c43, bfloat16, 2024-09-21 60.8%
- 248 v000000/L3.1-Niitorm-8B-DPO-t0.0001 Three-shot, text-only, float16, 2024-09-30 60.8%
- 249
Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
- 250 BAAI/Infinity-Instruct-3M-0625-Qwen2-7B Three-shot, text-only, bfloat16, 2024-07-16 60.6%
- 251 Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
- 252 byroneverson/Mistral-Small-Instruct-2409-abliterated Three-shot, text-only, bfloat16, 2024-10-13 60.6%
- 253 jaspionjader/f-9-8b Three-shot, text-only, bfloat16, 2025-01-02 60.5%
- 254 natong19/Qwen2-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-06-19 60.4%
- 255 meta-llama/Llama-3.2-11B-Vision Three-shot, text-only, bfloat16, 2024-12-05 60.4%
- 256 argilla/notux-8x7b-v1 Three-shot, text-only, bfloat16, 2024-02-27 60.2%
- 257 CohereForAI/aya-23-35B Three-shot, text-only, float16, 2024-05-23 60.2%
- 258 mlabonne/NeuralDaredevil-8B-abliterated Three-shot, text-only, float16, 2024-05-28 60.2%
- 259 SeaLLMs/SeaLLMs-v3-7B-Chat Three-shot, text-only, bfloat16, 2024-07-28 60.2%
- 260 grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter Three-shot, text-only, bfloat16, 2024-09-17 60.2%
- 261 Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base Three-shot, text-only, bfloat16, 2024-10-04 60.2%
- 262 Sao10K/L3.1-8B-Niitama-v1.1 Three-shot, text-only, float16, 2024-11-08 60.2%
- 263 vicgalle/CarbonBeagle-11B-truthy Three-shot, text-only, float16, 2024-05-17 60.1%
- 264 mlabonne/Daredevil-8B-abliterated Three-shot, text-only, bfloat16, 2024-05-27 60.1%
- 265 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25 Three-shot, text-only, bfloat16, 2024-06-06 60.1%
- 266 nbeerbower/mistral-nemo-wissenschaft-12B Three-shot, text-only, bfloat16, 2024-08-30 60.1%
- 267 arcee-ai/Llama-3.1-SuperNova-Lite Three-shot, text-only, bfloat16, 2024-09-17 60.1%
- 268 tiiuae/Falcon3-7B-Base Three-shot, text-only, bfloat16, 2025-01-15 60.1%
- 269
Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
- 270 mistralai/Mixtral-8x7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-02-18 59.8%
- 271 WizardLMTeam/WizardLM-70B-V1.0 Three-shot, text-only, float16, 2024-05-22 59.8%
- 272 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated Three-shot, text-only, bfloat16, 2024-06-17 59.8%
- 273 JJhooww/Qwen2-7B_reload_v1 Three-shot, text-only, float16, 2024-06-17 59.8%
- 274 THUDM/LongWriter-glm4-9b Three-shot, text-only, bfloat16, 2024-09-18 59.8%
- 275 meta-llama/Llama-3.1-8B-Instruct Three-shot, text-only, float16, 2024-10-23 59.8%
- 276 ai21labs/Jamba-v0.1 Three-shot, text-only, bfloat16, 2024-04-07 59.7%
- 277 cognitivecomputations/dolphin-2.9.2-qwen2-7b Three-shot, text-only, bfloat16, 2024-06-10 59.5%
- 278 Kukedlc/NeuralLLaMa-3-8b-DT-v0.1 Three-shot, text-only, float16, 2024-05-17 59.4%
- 279 bunnycore/HyperLlama-3.1-8B Three-shot, text-only, bfloat16, 2024-09-05 59.4%
- 280 failspy/Phi-3-medium-4k-instruct-abliterated-v3 Three-shot, text-only, bfloat16, 2024-05-25 59.3%
- 281 MaziyarPanahi/Llama-3-8B-Instruct-v0.8 Three-shot, text-only, bfloat16, 2024-05-29 59.3%
- 282
Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
- 283 princeton-nlp/gemma-2-9b-it-DPO Three-shot, text-only, rev: 422941a, bfloat16, 2024-10-07 59.3%
- 284 RDson/WomboCombo-R1-Coder-14B-Preview Three-shot, text-only, bfloat16, 2025-02-06 59.3%
- 285 rhaymison/Mistral-8x7b-portuguese-luana Three-shot, text-only, float16, 2024-04-22 59.1%
- 286 mlabonne/ChimeraLlama-3-8B-v3 Three-shot, text-only, float16, 2024-08-06 59.1%
- 287 upstage/SOLAR-10.7B-v1.0 Three-shot, text-only, float16, 2024-02-05 59%
- 288 vicgalle/ConfigurableBeagle-11B Three-shot, text-only, rev: bbc16db, float16, 2024-06-14 59%
- 289 recogna-nlp/Bode-3.1-8B-Instruct-full Three-shot, text-only, rev: oldalpaca, float16, 2024-08-31 59%
- 290 deepcogito/cogito-v1-preview-llama-8B Three-shot, text-only, bfloat16, 2025-04-09 59%
- 291 tiiuae/Falcon-H1-3B-Base Three-shot, text-only, bfloat16, 2025-07-08 59%
- 292 lightblue/suzume-llama-3-8B-multilingual Three-shot, text-only, bfloat16, 2024-05-13 58.8%
- 293 uygarkurt/llama-3-merged-linear Three-shot, text-only, float16, 2024-05-13 58.8%
- 294 DeepMount00/Llama-3-8b-Ita Three-shot, text-only, bfloat16, 2024-05-17 58.8%
- 295 meta-llama/Meta-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-07-23 58.8%
- 296 BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B Three-shot, text-only, rev: a42c86c, bfloat16, 2024-08-01 58.8%
- 297 BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B Three-shot, text-only, bfloat16, 2024-08-05 58.8%
- 298 BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B Three-shot, text-only, bfloat16, 2024-08-22 58.8%
- 299 v000000/SwallowMaid-8B-L3-SPPO-abliterated Three-shot, text-only, bfloat16, 2024-09-21 58.8%
- 300
Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
- 301 OrionStarAI/Orion-14B-Base Three-shot, text-only, bfloat16, 2024-02-05 58.7%
- 302 recogna-nlp/internlm-chatbode-20b Three-shot, text-only, float16, 2024-05-07 58.7%
- 303 internlm/internlm2_5-7b-chat-1m Three-shot, text-only, bfloat16, 2024-07-05 58.7%
- 304 vicgalle/Configurable-Llama-3.1-8B-Instruct Three-shot, text-only, float16, 2024-08-03 58.7%
- 305 freewheelin/free-llama3-dpo-v0.2 Three-shot, text-only, bfloat16, 2024-08-07 58.7%
- 306 Eurdem/Defne-llama3.1-8B Three-shot, text-only, bfloat16, 2024-08-13 58.7%
- 307 unsloth/Meta-Llama-3.1-70B-bnb-4bit Three-shot, text-only, 4bit, 2024-08-13 58.7%
- 308 internlm/internlm2-20b Three-shot, text-only, bfloat16, 2024-04-21 58.5%
- 309 PrunaAI/Jamba-v0.1-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 58.5%
- 310 VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct Three-shot, text-only, bfloat16, 2024-05-17 58.5%
- 311 shadowml/Mixolar-4x7b Three-shot, text-only, float16, 2024-06-17 58.5%
- 312 OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k Three-shot, text-only, bfloat16, 2024-10-10 58.5%
- 313 speakleash/Bielik-11B-v2 Three-shot, text-only, bfloat16, 2024-10-16 58.5%
- 314 invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp Three-shot, text-only, float16, 2024-05-16 58.4%
- 315 VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct Three-shot, text-only, bfloat16, 2024-07-29 58.4%
- 316 MaziyarPanahi/Llama-3-8B-Instruct-v0.10 Three-shot, text-only, bfloat16, 2024-08-13 58.4%
- 317 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule Three-shot, text-only, bfloat16, 2025-03-07 58.4%
- 318
SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
- 319 unsloth/llama-3-70b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 58.3%
- 320 Danielbrdz/Barcenas-Llama3-8b-ORPO Three-shot, text-only, float16, 2024-05-13 58.3%
- 321 MaziyarPanahi/Llama-3-8B-Instruct-v0.9 Three-shot, text-only, bfloat16, 2024-08-13 58.3%
- 322 princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2 Three-shot, text-only, rev: 5ed8372, bfloat16, 2024-09-28 58.3%
- 323 princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2 Three-shot, text-only, rev: d06275e, bfloat16, 2024-09-28 58.3%
- 324 princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2 Three-shot, text-only, rev: 3ea5c54, bfloat16, 2024-09-28 58.3%
- 325 princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2 Three-shot, text-only, rev: 4e5bc97, bfloat16, 2024-10-07 58.3%
- 326 kekmodel/StopCarbon-10.7B-v5 Three-shot, text-only, float16, 2024-05-16 58.1%
- 327 DeepMount00/Llama-3.1-8b-Ita Three-shot, text-only, bfloat16, 2024-09-18 58.1%
- 328 princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2 Three-shot, text-only, rev: 81191fb, bfloat16, 2024-10-07 58.1%
- 329 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2 Three-shot, text-only, rev: 1821cc4, bfloat16, 2024-10-07 58.1%
- 330 jeonsworld/CarbonVillain-en-10.7B-v4 Three-shot, text-only, bfloat16, 2024-04-26 58%
- 331 rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct Three-shot, text-only, float16, 2024-04-30 58%
- 332 saltlux/luxia-21.4b-alignment-v1.0 Three-shot, text-only, float16, 2024-05-15 58%
- 333 failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 Three-shot, text-only, bfloat16, 2024-05-27 58%
- 334 saltlux/luxia-21.4b-alignment-v1.2 Three-shot, text-only, bfloat16, 2024-05-30 58%
- 335 RLHFlow/LLaMA3-iterative-DPO-final Three-shot, text-only, bfloat16, 2024-06-05 58%
- 336 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 58%
- 337 dnhkng/RYS-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-08-22 58%
- 338 internlm/internlm2-chat-20b Three-shot, text-only, bfloat16, 2024-04-18 57.9%
- 339 openchat/openchat-3.5-0106-gemma Three-shot, text-only, bfloat16, 2024-05-17 57.9%
- 340 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3 Three-shot, text-only, bfloat16, 2024-05-20 57.9%
- 341 vicgalle/ConfigurableSOLAR-10.7B Three-shot, text-only, rev: c5c844a, float16, 2024-08-25 57.9%
- 342
Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
- 343 01-ai/Yi-1.5-9B Three-shot, text-only, bfloat16, 2024-05-15 57.7%
- 344 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75 Three-shot, text-only, bfloat16, 2024-06-06 57.7%
- 345 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 57.7%
- 346 Dampfinchen/Llama-3.1-8B-Ultra-Instruct Three-shot, text-only, bfloat16, 2024-09-16 57.7%
- 347 princeton-nlp/Llama-3-Instruct-8B-CPO Three-shot, text-only, rev: d4645ae, bfloat16, 2024-09-28 57.7%
- 348 ibivibiv/llama-3-nectar-dpo-8B Three-shot, text-only, bfloat16, 2024-06-22 57.6%
- 349 princeton-nlp/Llama-3-Instruct-8B-KTO Three-shot, text-only, rev: e697908, bfloat16, 2024-09-28 57.6%
- 350 anthracite-org/magnum-v2.5-12b-kto Three-shot, text-only, rev: aee0374, float16, 2024-09-29 57.6%
- 351 Sao10K/L3-8B-Niitama-v1 Three-shot, text-only, float16, 2024-12-18 57.6%
- 352 VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct Three-shot, text-only, bfloat16, 2024-08-10 57.4%
- 353 migtissera/Trinity-2-Codestral-22B Three-shot, text-only, bfloat16, 2024-09-16 57.4%
- 354 princeton-nlp/Llama-3-Instruct-8B-RDPO Three-shot, text-only, rev: 9497ca2, bfloat16, 2024-09-28 57.4%
- 355
Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
- 356 internlm/internlm2-chat-20b-sft Three-shot, text-only, bfloat16, 2024-04-21 57.3%
- 357 mlabonne/Llama-3-8B-Instruct-abliterated-dpomix Three-shot, text-only, float16, 2024-05-27 57.3%
- 358 princeton-nlp/Llama-3-Instruct-8B-SimPO Three-shot, text-only, bfloat16, 2024-05-29 57.3%
- 359 grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge Three-shot, text-only, bfloat16, 2024-08-08 57.3%
- 360 recogna-nlp/Bode-3.1-8B-Instruct-lora Three-shot, text-only, float16, 2024-08-30 57.3%
- 361 EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection Three-shot, text-only, rev: 22257d3, float16, 2024-09-17 57.3%
- 362 princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2 Three-shot, text-only, rev: 477d33e, bfloat16, 2024-09-28 57.3%
- 363 princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2 Three-shot, text-only, rev: 24601cd, bfloat16, 2024-10-07 57.3%
- 364 princeton-nlp/Llama-3-Instruct-8B-RRHF Three-shot, text-only, rev: 73561d9, bfloat16, 2024-10-07 57.3%
- 365 Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
- 366 MagusCorp/grpo_lora_enem_llama3_7b Three-shot, text-only, float16, 2025-02-11 57.3%
- 367 recogna-nlp/gembode-7b Three-shot, text-only, float16, 2024-04-23 57.2%
- 368 unsloth/llama-3-8b-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 57.2%
- 369 vicgalle/Configurable-Llama-3-8B-v0.3 Three-shot, text-only, float16, 2024-06-17 57.2%
- 370 princeton-nlp/Llama-3-Instruct-8B-DPO Three-shot, text-only, rev: 0afbf4c, bfloat16, 2024-09-28 57.2%
- 371 tiiuae/Falcon-H1-1.5B-Deep-Instruct Three-shot, text-only, bfloat16, 2025-07-08 57.2%
- 372 NousResearch/Hermes-2-Pro-Llama-3-8B Three-shot, text-only, float16, 2024-05-06 57%
- 373 01-ai/Yi-1.5-9B-32K Three-shot, text-only, bfloat16, 2024-05-20 57%
- 374 NousResearch/Hermes-2-Theta-Llama-3-8B Three-shot, text-only, bfloat16, 2024-05-27 57%
- 375 arthrod/cicerollamatry8 Three-shot, text-only, float16, 2024-05-29 57%
- 376 maywell/Qwen2-7B-Multilingual-RP Three-shot, text-only, bfloat16, 2024-07-24 57%
- 377 botbot-ai/CabraLlama3-8b Three-shot, text-only, bfloat16, 2024-04-22 56.9%
- 378 jondurbin/bagel-8b-v1.0 Three-shot, text-only, bfloat16, 2024-05-18 56.9%
- 379 vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B Three-shot, text-only, float16, 2024-06-12 56.9%
- 380 BAAI/Infinity-Instruct-3M-0625-Llama3-8B Three-shot, text-only, bfloat16, 2024-07-18 56.9%
- 381 EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta Three-shot, text-only, rev: ef37828, float16, 2024-09-15 56.9%
- 382 MaziyarPanahi/calme-2.7-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 56.9%
- 383 Qwen/Qwen2.5-3B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 56.9%
- 384
Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
- 385 qnguyen3/Master-Yi-9B Three-shot, text-only, bfloat16, 2024-05-29 56.8%
- 386 OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k Three-shot, text-only, bfloat16, 2024-05-30 56.8%
- 387 tobiaspires/command-r-p11-fn Three-shot, text-only, bfloat16, 2024-06-05 56.8%
- 388 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4 Three-shot, text-only, bfloat16, 2024-07-12 56.8%
- 389 EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta Three-shot, text-only, rev: 010aaa1, float16, 2024-09-13 56.8%
- 390 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta Three-shot, text-only, float16, 2024-09-17 56.8%
- 391 grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge Three-shot, text-only, bfloat16, 2024-09-17 56.8%
- 392 01-ai/Yi-1.5-9B-Chat-16K Three-shot, text-only, bfloat16, 2024-05-20 56.6%
- 393 chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO Three-shot, text-only, bfloat16, 2024-05-29 56.6%
- 394 microsoft/Phi-3.5-mini-instruct Three-shot, text-only, bfloat16, 2024-12-03 56.6%
- 395
Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
- 396 EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200 Three-shot, text-only, float16, 2024-09-17 56.5%
- 397 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule Three-shot, text-only, bfloat16, 2025-03-07 56.5%
- 398 rishiraj/CatPPT Three-shot, text-only, bfloat16, 2024-02-25 56.3%
- 399 VAGOsolutions/SauerkrautLM-Gemma-7b Three-shot, text-only, bfloat16, 2024-05-17 56.3%
- 400 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2 Three-shot, text-only, bfloat16, 2024-07-12 56.3%
- 401 NousResearch/Hermes-3-Llama-3.1-8B Three-shot, text-only, bfloat16, 2024-08-30 56.3%
- 402 leafspark/Llama-3.1-8B-MultiReflection-Instruct Three-shot, text-only, float16, 2024-09-16 56.3%
- 403 Qwen/Qwen2.5-Coder-7B-Instruct Three-shot, text-only, bfloat16, 2024-10-13 56.3%
- 404 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-07-09 56.2%
- 405 vicgalle/Configurable-Hermes-3-Llama-3.1-8B Three-shot, text-only, float16, 2024-09-17 56.2%
- 406 MaziyarPanahi/calme-2.3-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 56.2%
- 407 mistralai/Ministral-8B-Instruct-2410 Three-shot, text-only, bfloat16, 2024-12-03 56.2%
- 408 cognitivecomputations/Dolphin3.0-R1-Mistral-24B Three-shot, text-only, bfloat16, 2025-02-11 56.2%
- 409 NousResearch/Nous-Hermes-2-SOLAR-10.7B Three-shot, text-only, bfloat16, 2024-02-27 56%
- 410 nicolasdec/CabraQwen7b Three-shot, text-only, bfloat16, 2024-04-02 56%
- 411 tiiuae/Falcon-H1-1.5B-Deep-Base Three-shot, text-only, bfloat16, 2025-07-08 56%
- 412 rishiraj/CatPPT-base Three-shot, text-only, float16, 2024-02-25 55.9%
- 413 cognitivecomputations/dolphin-2.9.1-yi-1.5-9b Three-shot, text-only, bfloat16, 2024-05-25 55.9%
- 414 internlm/internlm2_5-7b-chat Three-shot, text-only, bfloat16, 2024-07-05 55.9%
- 415 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3 Three-shot, text-only, bfloat16, 2024-07-12 55.9%
- 416 arcee-ai/Arcee-Scribe Three-shot, text-only, bfloat16, 2024-08-10 55.9%
- 417 princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2 Three-shot, text-only, bfloat16, 2024-08-10 55.9%
- 418 EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos Three-shot, text-only, float16, 2024-09-09 55.9%
- 419
Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
- 420 vicgalle/CarbonBeagle-11B Three-shot, text-only, float16, 2024-06-17 55.8%
- 421 microsoft/MediPhi Three-shot, text-only, bfloat16, 2025-08-30 55.8%
- 422
Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
- 423 SeaLLMs/SeaLLM-7B-v2.5 Three-shot, text-only, bfloat16, 2024-05-13 55.6%
- 424 princeton-nlp/Llama-3-8B-ProLong-512k-Instruct Three-shot, text-only, bfloat16, 2024-09-17 55.6%
- 425 princeton-nlp/Llama-3-8B-ProLong-64k-Base Three-shot, text-only, bfloat16, 2024-09-17 55.6%
- 426
Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
- 427 Sabiá-2 Small Three-shot, text-only, 2024-04-12 55.5%
- 428 lemon-mint/gemma-ko-7b-instruct-v0.62 Three-shot, text-only, bfloat16, 2024-05-17 55.5%
- 429 wenbopan/Faro-Yi-9B Three-shot, text-only, bfloat16, 2024-05-29 55.5%
- 430 OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k Three-shot, text-only, bfloat16, 2024-09-29 55.5%
- 431 princeton-nlp/Llama-3-Instruct-8B-IPO Three-shot, text-only, rev: fbe883f, bfloat16, 2024-10-07 55.5%
- 432 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF Three-shot, text-only, rev: 7e9001f, bfloat16, 2024-10-07 55.5%
- 433
LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
- 434 Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
- 435 wenbopan/Faro-Yi-9B-DPO Three-shot, text-only, rev: 58a4349, float16, 2024-06-14 55.2%
- 436 Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 Three-shot, text-only, bfloat16, 2024-08-06 55.2%
- 437 terrycraddock/Reflection-Llama-3.1-8B Three-shot, text-only, float16, 2024-09-15 55.2%
- 438 migtissera/Trinity-2-Codestral-22B-v0.2 Three-shot, text-only, bfloat16, 2024-09-16 55.2%
- 439 MaziyarPanahi/calme-2.1-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 55.2%
- 440 vicgalle/Configurable-Yi-1.5-9B-Chat Three-shot, text-only, float16, 2024-05-29 55.1%
- 441 meraGPT/mera-mix-4x7B Three-shot, text-only, bfloat16, 2024-06-10 55.1%
- 442 BAAI/Infinity-Instruct-3M-0625-Mistral-7B Three-shot, text-only, bfloat16, 2024-07-18 55.1%
- 443 Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
- 444 FuseAI/FuseChat-7B-VaRM Three-shot, text-only, bfloat16, 2024-03-04 54.9%
- 445 unsloth/llama-3-8b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 54.9%
- 446 princeton-nlp/Llama-3-8B-ProLong-64k-Instruct Three-shot, text-only, bfloat16, 2024-09-17 54.9%
- 447 internlm/internlm2-base-20b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 54.8%
- 448
Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
- 449 ibivibiv/multimaster-7b-v6 Three-shot, text-only, bfloat16, 2024-06-08 54.8%
- 450 MaziyarPanahi/Topxtral-4x7B-v0.1 Three-shot, text-only, bfloat16, 2024-06-10 54.8%
- 451 Kukedlc/NeuralSynthesis-7B-v0.1 Three-shot, text-only, bfloat16, 2024-06-12 54.8%
- 452 jsfs11/MixtureofMerges-MoE-4x7b-v5 Three-shot, text-only, bfloat16, 2024-06-17 54.8%
- 453 mistralai/Codestral-22B-v0.1 Three-shot, text-only, bfloat16, 2024-07-02 54.8%
- 454 cognitivecomputations/laserxtral Three-shot, text-only, bfloat16, 2024-07-31 54.8%
- 455 freewheelin/free-solar-evo-v0.1 Three-shot, text-only, float16, 2024-08-07 54.8%
- 456 FuseAI/OpenChat-3.5-7B-Solar Three-shot, text-only, bfloat16, 2024-03-04 54.7%
- 457 kevin009/llamaRAGdrama Three-shot, text-only, float16, 2024-05-30 54.7%
- 458 cognitivecomputations/WestLake-7B-v2-laser Three-shot, text-only, bfloat16, 2024-07-31 54.7%
- 459 freewheelin/free-solar-evo-v0.13 Three-shot, text-only, float16, 2024-08-07 54.7%
- 460 princeton-nlp/Llama-3-Instruct-8B-ORPO Three-shot, text-only, rev: 4bb3ffc, bfloat16, 2024-09-28 54.7%
- 461 Kukedlc/NeuralSynthesis-7b-v0.4-slerp Three-shot, text-only, bfloat16, 2024-05-30 54.5%
- 462 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5 Three-shot, text-only, bfloat16, 2024-07-12 54.5%
- 463 liminerity/M7-7b Three-shot, text-only, bfloat16, 2024-07-13 54.5%
- 464 freewheelin/free-solar-evo-v0.11 Three-shot, text-only, float16, 2024-08-07 54.5%
- 465 Magpie-Align/MagpieLM-8B-SFT-v0.1 Three-shot, text-only, rev: b91f605, bfloat16, 2024-09-29 54.5%
- 466 rombodawg/rombos_Replete-Coder-Instruct-8b-Merged Three-shot, text-only, bfloat16, 2024-10-14 54.5%
- 467 paulml/OGNO-7B Three-shot, text-only, bfloat16, 2024-02-25 54.4%
- 468 MaziyarPanahi/Mistral-7B-Instruct-Aya-101 Three-shot, text-only, bfloat16, 2024-04-17 54.4%
- 469 J-LAB/BRisa-7B-Instruct-v0.2 Three-shot, text-only, float16, 2024-04-18 54.4%
- 470 Kquant03/CognitiveFusion2-4x7B-BF16 Three-shot, text-only, bfloat16, 2024-05-15 54.4%
- 471 NotAiLOL/Yi-1.5-dolphin-9B Three-shot, text-only, bfloat16, 2024-05-17 54.4%
- 472 01-ai/Yi-9B-200K Three-shot, text-only, rev: v20240318, bfloat16, 2024-05-20 54.4%
- 473 allknowingroger/MultiverseEx26-7B-slerp Three-shot, text-only, bfloat16, 2024-07-03 54.4%
- 474 EpistemeAI/Fireball-3.1-8B-ORPO Three-shot, text-only, bfloat16, 2024-08-26 54.4%
- 475
Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
- 476 bardsai/jaskier-7b-dpo-v5.6 Three-shot, text-only, bfloat16, 2024-02-25 54.2%
- 477 teknium/OpenHermes-2-Mistral-7B Three-shot, text-only, bfloat16, 2024-02-27 54.2%
- 478 automerger/YamshadowExperiment28-7B Three-shot, text-only, bfloat16, 2024-05-30 54.2%
- 479 Kukedlc/NeuralSynthesis-7B-v0.3 Three-shot, text-only, bfloat16, 2024-07-29 54.2%
- 480 TIGER-Lab/AceCodeRM-7B Three-shot, text-only, bfloat16, 2025-03-07 54.2%
- 481
Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
- 482 NousResearch/Nous-Hermes-2-Mistral-7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 54.1%
- 483 stabilityai/stablelm-2-12b Three-shot, text-only, bfloat16, 2024-04-08 54.1%
- 484 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1 Three-shot, text-only, bfloat16, 2024-04-20 54.1%
- 485
Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
- 486 zhengr/MixTAO-7Bx2-MoE-v8.1 Three-shot, text-only, bfloat16, 2024-05-13 54.1%
- 487 jsfs11/MixtureofMerges-MoE-4x7b-v4 Three-shot, text-only, bfloat16, 2024-05-15 54.1%
- 488 J-LAB/FluxiIA-Small Three-shot, text-only, float16, 2024-11-19 54.1%
- 489 JJhooww/Mistral-7B-v0.2-Base_ptbr Three-shot, text-only, float16, 2024-04-13 54%
- 490
phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
- 491 princeton-nlp/Llama-3-Base-8B-SFT-ORPO Three-shot, text-only, rev: 54d5840, bfloat16, 2024-09-28 54%
- 492 princeton-nlp/Llama-3-Base-8B-SFT-RDPO Three-shot, text-only, rev: b41a964, bfloat16, 2024-09-28 54%
- 493 EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic Three-shot, text-only, float16, 2024-12-13 54%
- 494
Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
- 495 Walmart-the-bag/Misted-v2-7B Three-shot, text-only, float16, 2024-04-18 53.8%
- 496 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2 Three-shot, text-only, bfloat16, 2024-04-30 53.8%
- 497 internlm/internlm2-wqx-20b Three-shot, text-only, bfloat16, 2024-06-05 53.8%
- 498 princeton-nlp/Llama-3-Base-8B-SFT-RRHF Three-shot, text-only, rev: aea8c04, bfloat16, 2024-10-07 53.8%
- 499 kurakurai/Luth-1.7B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 53.8%
- 500 utter-project/EuroLLM-9B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 53.8%
- 501 Walmart-the-bag/WordWoven-2x7B Three-shot, text-only, float16, 2024-04-18 53.7%
- 502 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3 Three-shot, text-only, bfloat16, 2024-04-23 53.7%
- 503 adalbertojunior/Llama-3-8B-Dolphin-Portuguese Three-shot, text-only, bfloat16, 2024-04-27 53.7%
- 504 abacusai/Slerp-CM-mist-dpo Three-shot, text-only, float16, 2024-09-05 53.7%
- 505 ValiantLabs/Llama3.1-8B-Cobalt Three-shot, text-only, bfloat16, 2024-10-04 53.7%
- 506 princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF Three-shot, text-only, rev: 325092c, bfloat16, 2024-10-07 53.7%
- 507 HuggingFaceTB/SmolLM3-3B-Base Three-shot, text-only, bfloat16, 2025-07-08 53.7%
- 508 01-ai/Yi-9B-200k Three-shot, text-only, bfloat16, 2024-04-13 53.5%
- 509 eduagarcia/mistral-orpo-mix-21k Three-shot, text-only, bfloat16, 2024-05-06 53.5%
- 510 EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto Three-shot, text-only, float16, 2024-11-04 53.5%
- 511 kaist-ai/mistral-orpo-capybara-7k Three-shot, text-only, bfloat16, 2024-04-28 53.4%
- 512 yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B Three-shot, text-only, bfloat16, 2024-05-13 53.4%
- 513 CultriX/NeuralMona_MoE-4x7B Three-shot, text-only, bfloat16, 2024-05-15 53.4%
- 514 Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R Three-shot, text-only, float16, 2024-05-15 53.4%
- 515 RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2 Three-shot, text-only, bfloat16, 2024-07-03 53.4%
- 516 Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3 Three-shot, text-only, bfloat16, 2024-08-06 53.4%
- 517 mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-10 53.4%
- 518 princeton-nlp/Mistral-7B-Instruct-SimPO Three-shot, text-only, rev: 03191ee, bfloat16, 2024-09-21 53.4%
- 519 princeton-nlp/Llama-3-Base-8B-SFT-DPO Three-shot, text-only, rev: 3f5ec47, bfloat16, 2024-09-28 53.4%
- 520 BAAI/Infinity-Instruct-3M-0613-Mistral-7B Three-shot, text-only, float16, 2024-06-22 53.3%
- 521 J-LAB/Nemo_RolePlay_PTBR_new Three-shot, text-only, float16, 2024-09-10 53.3%
- 522 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2 Three-shot, text-only, float16, 2024-09-14 53.3%
- 523 byroneverson/Yi-1.5-9B-Chat-16K-abliterated Three-shot, text-only, bfloat16, 2024-09-17 53.3%
- 524
Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
- 525 eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 53.1%
- 526 mistralai/Mistral-7B-Instruct-v0.3 Three-shot, text-only, bfloat16, 2024-05-22 53.1%
- 527 MaziyarPanahi/Mistral-7B-Instruct-v0.3 Three-shot, text-only, bfloat16, 2024-05-26 53.1%
- 528 yunconglong/MoE_13B_DPO Three-shot, text-only, bfloat16, 2024-07-03 53.1%
- 529 cognitivecomputations/openchat-3.5-0106-laser Three-shot, text-only, bfloat16, 2024-07-31 53.1%
- 530 Magpie-Align/Llama-3-8B-Magpie-Align-v0.3 Three-shot, text-only, bfloat16, 2024-08-06 53.1%
- 531 leliuga/Phi-3-mini-4k-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 53%
- 532 princeton-nlp/Llama-3-Base-8B-SFT-CPO Three-shot, text-only, rev: 536ce7e, bfloat16, 2024-09-28 53%
- 533 utter-project/EuroLLM-9B Three-shot, text-only, bfloat16, 2025-08-30 53%
- 534 teknium/OpenHermes-2.5-Mistral-7B Three-shot, text-only, bfloat16, 2024-02-27 52.9%
- 535 unsloth/Phi-3-mini-4k-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-23 52.9%
- 536
DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
- 537 tiiuae/Falcon-H1-1.5B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 52.9%
- 538 openchat/openchat-3.5-0106 Three-shot, text-only, bfloat16, 2024-02-05 52.7%
- 539 eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 52.7%
- 540 Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5 Three-shot, text-only, float16, 2024-07-27 52.7%
- 541 Magpie-Align/MagpieLM-8B-Chat-v0.1 Three-shot, text-only, rev: 0b30eab, bfloat16, 2024-09-29 52.7%
- 542 princeton-nlp/Llama-3-Base-8B-SFT-IPO Three-shot, text-only, rev: 85055cc, bfloat16, 2024-10-07 52.7%
- 543 princeton-nlp/Mistral-7B-Instruct-KTO Three-shot, text-only, rev: 834422e, bfloat16, 2024-10-07 52.7%
- 544 internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
- 545 mlabonne/Monarch-7B Three-shot, text-only, bfloat16, 2024-02-25 52.6%
- 546 JJhooww/Mistral_Relora_Step2k Three-shot, text-only, float16, 2024-03-08 52.6%
- 547 princeton-nlp/Llama-3-Base-8B-SFT-SimPO Three-shot, text-only, rev: 0a6e518, bfloat16, 2024-09-21 52.6%
- 548 Qwen/Qwen2.5-1.5B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 52.6%
- 549 utter-project/EuroLLM-22B-Instruct-Preview Three-shot, text-only, bfloat16, 2025-08-30 52.6%
- 550 internlm/internlm2-7b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 52.4%
- 551 argilla/CapybaraHermes-2.5-Mistral-7B Three-shot, text-only, float16, 2024-02-27 52.4%
- 552 unsloth/gemma-7b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 52.4%
- 553 eduagarcia/mistral-orpo-capybara-3k Three-shot, text-only, bfloat16, 2024-05-01 52.4%
- 554 recogna-nlp/internlm-chatbode2-7b-beta Three-shot, text-only, float16, 2024-06-14 52.4%
- 555
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
- 556
Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
- 557 yunconglong/DARE_TIES_13B Three-shot, text-only, bfloat16, 2024-05-15 52.3%
- 558 uukuguy/speechless-zephyr-code-functionary-7b Three-shot, text-only, bfloat16, 2024-07-27 52.3%
- 559 princeton-nlp/Llama-3-Base-8B-SFT Three-shot, text-only, rev: b622b7d, bfloat16, 2024-10-07 52.3%
- 560 meta-llama/Llama-3.2-3B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 52.3%
- 561
Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
- 562
Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
- 563 alvarobartt/Mistral-7B-v0.1-ORPO Three-shot, text-only, bfloat16, 2024-04-28 52.2%
- 564 tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-09-12 52.2%
- 565 princeton-nlp/Llama-3-Base-8B-SFT-KTO Three-shot, text-only, rev: 49a8c2e, bfloat16, 2024-09-28 52.2%
- 566 Qwen/Qwen1.5-MoE-A2.7B-Chat Three-shot, text-only, bfloat16, 2024-04-12 52%
- 567 mlabonne/Beyonder-4x7B-v3 Three-shot, text-only, float16, 2024-05-15 52%
- 568 uukuguy/zephyr-7b-alpha-dare-0.85 Three-shot, text-only, float16, 2024-05-15 52%
- 569 01-ai/Yi-1.5-34B-Chat-16K Three-shot, text-only, bfloat16, 2024-05-20 52%
- 570 dzakwan/dzakwan-MoE-4x7b-Beta Three-shot, text-only, float16, 2024-06-10 52%
- 571
Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
- 572 kaist-ai/janus-dpo-7b Three-shot, text-only, bfloat16, 2024-10-09 52%
- 573 huggyllama/llama-30b Three-shot, text-only, float16, 2024-02-05 51.9%
- 574 eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 51.9%
- 575 princeton-nlp/Mistral-7B-Instruct-RRHF Three-shot, text-only, rev: 493d3ce, bfloat16, 2024-10-07 51.9%
- 576 BornSaint/Dare_Angel_8B Three-shot, text-only, float16, 2025-05-22 51.9%
- 577 rhaymison/Llama3-portuguese-luana-8b-instruct Three-shot, text-only, float16, 2024-04-25 51.7%
- 578 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4 Three-shot, text-only, float16, 2024-06-15 51.7%
- 579 SeaLLMs/SeaLLM-7B-v2 Three-shot, text-only, bfloat16, 2024-08-06 51.7%
- 580 abacusai/bigstral-12b-32k Three-shot, text-only, float16, 2024-09-04 51.7%
- 581 abacusai/bigyi-15b Three-shot, text-only, float16, 2024-09-04 51.7%
- 582 byroneverson/Yi-1.5-9B-Chat-abliterated Three-shot, text-only, bfloat16, 2024-09-17 51.7%
- 583 internlm/internlm2-chat-7b-sft Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 51.6%
- 584 eduagarcia/mistral-orpo-mix-7k Three-shot, text-only, bfloat16, 2024-04-28 51.6%
- 585 rombodawg/Everyone-Coder-4x7b-Base Three-shot, text-only, float16, 2024-07-27 51.6%
- 586 recogna-nlp/internlm-chatbode-7b Three-shot, text-only, float16, 2024-05-07 51.5%
- 587 vicgalle/Configurable-Mistral-7B Three-shot, text-only, float16, 2024-06-12 51.5%
- 588 vicgalle/ConfigurableHermes-7B Three-shot, text-only, float16, 2024-06-17 51.5%
- 589 princeton-nlp/Mistral-7B-Instruct-DPO Three-shot, text-only, rev: 5e96cff, bfloat16, 2024-10-07 51.5%
- 590
Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
- 591
Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
- 592 Skywork/Skywork-13B-base Three-shot, text-only, bfloat16, 2024-02-05 51.3%
- 593 bartowski/internlm2-chat-7b-llama Three-shot, text-only, rev: refs/pr/2, float16, 2024-04-25 51.3%
- 594 uukuguy/speechless-code-mistral-7b-v1.0 Three-shot, text-only, float16, 2024-06-16 51.3%
- 595 unsloth/mistral-7b-v0.3-bnb-4bit Three-shot, text-only, 4bit, 2024-05-22 51.2%
- 596 openchat/openchat-3.6-8b-20240522 Three-shot, text-only, bfloat16, 2024-05-25 51.2%
- 597 shadowml/BeagSake-7B Three-shot, text-only, bfloat16, 2024-06-14 51.2%
- 598 rombodawg/rombos_Replete-Coder-Llama3-8B Three-shot, text-only, bfloat16, 2024-10-14 51.2%
- 599
Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
- 600 MagusCorp/legislinho Three-shot, text-only, float16, 2024-04-09 51%
- 601 GritLM/GritLM-7B-KTO Three-shot, text-only, bfloat16, 2024-06-14 51%
- 602 beowolx/CodeNinja-1.0-OpenChat-7B Three-shot, text-only, bfloat16, 2024-07-27 51%
- 603 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 51%
- 604 princeton-nlp/Mistral-7B-Instruct-CPO Three-shot, text-only, rev: 32492f8, bfloat16, 2024-10-07 51%
- 605 internlm/internlm2-chat-7b Three-shot, text-only, rev: v1.0.0, float16, 2024-02-19 50.8%
- 606 gradientai/Llama-3-8B-Instruct-262k Three-shot, text-only, bfloat16, 2024-06-13 50.8%
- 607 AetherResearch/Cerebrum-1.0-7b Three-shot, text-only, float16, 2024-03-14 50.6%
- 608 rhaymison/phi-3-portuguese-tom-cat-4k-instruct Three-shot, text-only, float16, 2024-04-29 50.6%
- 609 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 50.6%
- 610 mlabonne/FineLlama-3.1-8B Three-shot, text-only, bfloat16, 2024-08-30 50.6%
- 611 princeton-nlp/Mistral-7B-Instruct-RDPO Three-shot, text-only, rev: 23ec6ab, bfloat16, 2024-10-07 50.6%
- 612 argilla/notus-7b-v1 Three-shot, text-only, bfloat16, 2024-02-27 50.5%
- 613
Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
- 614 princeton-nlp/Mistral-7B-Instruct-ORPO Three-shot, text-only, rev: 69c0481, bfloat16, 2024-10-07 50.5%
- 615 Qwen/Qwen3-1.7B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.5%
- 616 Intel/neural-chat-7b-v3-3 Three-shot, text-only, float16, 2024-02-21 50.4%
- 617
Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
- 618 THUDM/chatglm3-6b-base Three-shot, text-only, float16, 2024-02-05 50.2%
- 619 lmsys/vicuna-33b-v1.3 Three-shot, text-only, float16, 2024-03-05 50.2%
- 620 kaist-ai/janus-7b Three-shot, text-only, bfloat16, 2024-10-09 50.2%
- 621
Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
- 622
Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
- 623 recogna-nlp/internlmbode-7b Three-shot, text-only, float16, 2024-04-05 50.1%
- 624 mlabonne/NeuralMonarch-7B Three-shot, text-only, float16, 2024-05-15 50.1%
- 625 UCLA-AGI/Mistral7B-PairRM-SPPO Three-shot, text-only, bfloat16, 2024-09-21 50.1%
- 626 princeton-nlp/Mistral-7B-Instruct-SLiC-HF Three-shot, text-only, rev: 3d08c8b, bfloat16, 2024-10-07 50.1%
- 627 unsloth/mistral-7b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-23 49.9%
- 628 01-ai/Yi-1.5-6B Three-shot, text-only, bfloat16, 2024-05-16 49.9%
- 629 eldogbbhed/Peagle-9b Three-shot, text-only, float16, 2024-05-17 49.9%
- 630 amazingvince/Not-WizardLM-2-7B Three-shot, text-only, bfloat16, 2024-05-22 49.9%
- 631 google/medgemma-4b-it Three-shot, text-only, bfloat16, 2025-07-15 49.9%
- 632 CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it Three-shot, text-only, bfloat16, 2025-07-08 49.8%
- 633
Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
- 634 cognitivecomputations/dolphin-2.9-llama3-8b Three-shot, text-only, float16, 2024-04-21 49.6%
- 635 alvarobartt/mistral-7b-orpo-alignment-handbook Three-shot, text-only, bfloat16, 2024-04-28 49.6%
- 636 cosmicvalor/mistral-orthogonalized Three-shot, text-only, float16, 2024-05-25 49.6%
- 637 J-AI/Mistral_7b_ptbr_icatalogo Three-shot, text-only, float16, 2024-05-27 49.6%
- 638 princeton-nlp/Mistral-7B-Instruct-IPO Three-shot, text-only, rev: 32ad99c, bfloat16, 2024-10-07 49.6%
- 639 deepcogito/cogito-v1-preview-llama-3B Three-shot, text-only, bfloat16, 2025-04-09 49.6%
- 640 chujiezheng/Mistral7B-PairRM-SPPO-ExPO Three-shot, text-only, bfloat16, 2024-09-21 49.5%
- 641 stabilityai/stablelm-2-12b-chat Three-shot, text-only, bfloat16, 2024-04-09 49.4%
- 642 lucianosb/boto-7B-v1.1 Three-shot, text-only, float16, 2024-04-22 49.4%
- 643 cognitivecomputations/dolphin-2.9.3-mistral-7B-32k Three-shot, text-only, bfloat16, 2024-06-30 49.4%
- 644 failspy/Codestral-22B-v0.1-abliterated-v3 Three-shot, text-only, bfloat16, 2024-07-02 49.4%
- 645 kaist-ai/janus-orpo-7b Three-shot, text-only, bfloat16, 2024-10-09 49.4%
- 646 BSC-LT/salamandra-7b-instruct Three-shot, text-only, bfloat16, 2025-04-04 49.4%
- 647 microsoft/Phi-4-mini-instruct Three-shot, text-only, bfloat16, 2025-05-01 49.4%
- 648 rhaymison/Mistral-portuguese-luana-7b-chat Three-shot, text-only, bfloat16, 2024-04-09 49.2%
- 649 Walmart-the-bag/Quintellect-10.7B Three-shot, text-only, float16, 2024-04-21 49.2%
- 650 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4 Three-shot, text-only, bfloat16, 2024-04-24 49.2%
- 651 lucianosb/boto-7B-v1.2 Three-shot, text-only, bfloat16, 2024-05-24 49.2%
- 652 GritLM/GritLM-7B Three-shot, text-only, bfloat16, 2024-06-05 49.2%
- 653 ValiantLabs/Llama3.1-8B-ShiningValiant2 Three-shot, text-only, bfloat16, 2024-08-10 49.2%
- 654 mlabonne/AlphaMonarch-7B Three-shot, text-only, float16, 2024-05-15 49.1%
- 655 alvarobartt/mistral-7b-orpo-capybara-reproduction Three-shot, text-only, bfloat16, 2024-04-28 49%
- 656
MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
- 657 Xwin-LM/Xwin-LM-13B-V0.2 Three-shot, text-only, float16, 2024-05-22 49%
- 658
Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
- 659 TencentARC/Mistral_Pro_8B_v0.1 Three-shot, text-only, bfloat16, 2024-02-24 48.8%
- 660 lucianosb/boto-7B Three-shot, text-only, float16, 2024-04-10 48.8%
- 661 Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0 Three-shot, text-only, bfloat16, 2024-07-13 48.8%
- 662 princeton-nlp/Mistral-7B-Base-SFT-IPO Three-shot, text-only, rev: eea7817, bfloat16, 2024-10-07 48.8%
- 663 princeton-nlp/Mistral-7B-Base-SFT-KTO Three-shot, text-only, rev: 02148bb, bfloat16, 2024-10-07 48.8%
- 664 cnmoro/Mistral-7B-Portuguese Three-shot, text-only, float16, 2024-03-04 48.7%
- 665 princeton-nlp/Mistral-7B-Base-SFT-SimPO Three-shot, text-only, bfloat16, 2024-05-29 48.7%
- 666 recogna-nlp/internlm-chatbode2-7b-alpha Three-shot, text-only, float16, 2024-06-12 48.7%
- 667 ghost-x/ghost-8b-beta-1608 Three-shot, text-only, bfloat16, 2024-08-18 48.7%
- 668 allenai/OLMo-2-1124-7B Three-shot, text-only, bfloat16, 2025-05-01 48.7%
- 669 rhaymison/Mistral-portuguese-luana-7b-mental-health Three-shot, text-only, bfloat16, 2024-04-18 48.5%
- 670 alvarobartt/mistral-orpo-mix Three-shot, text-only, bfloat16, 2024-04-28 48.5%
- 671 princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF Three-shot, text-only, rev: 65d2cc4, bfloat16, 2024-10-07 48.5%
- 672 HuggingFaceTB/SmolLM3-3B Three-shot, text-only, bfloat16, 2025-07-08 48.5%
- 673 cognitivecomputations/WizardLM-30B-Uncensored Three-shot, text-only, float16, 2024-05-22 48.4%
- 674 Xwin-LM/Xwin-LM-13B-V0.1 Three-shot, text-only, float16, 2024-05-22 48.4%
- 675 CohereForAI/aya-23-8B Three-shot, text-only, float16, 2024-05-23 48.4%
- 676 artificialguybr/OpenHermesV2-PTBR Three-shot, text-only, float16, 2024-05-27 48.4%
- 677 princeton-nlp/Mistral-7B-Base-SFT-RDPO Three-shot, text-only, rev: 2a63a6d, bfloat16, 2024-10-07 48.4%
- 678 Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0 Three-shot, text-only, float16, 2024-04-09 48.3%
- 679 amazon/MegaBeam-Mistral-7B-300k Three-shot, text-only, bfloat16, 2024-10-07 48.3%
- 680 allenai/OLMo-2-1124-7B-Instruct Three-shot, text-only, bfloat16, 2025-05-01 48.3%
- 681 allenai/tulu-2-dpo-13b Three-shot, text-only, bfloat16, 2024-03-05 48.1%
- 682 rhaymison/Qwen-portuguese-luana-7b Three-shot, text-only, bfloat16, 2024-04-18 48.1%
- 683 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half Three-shot, text-only, rev: b82150a, bfloat16, 2024-06-14 48.1%
- 684 eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-07-09 48.1%
- 685 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6 Three-shot, text-only, bfloat16, 2024-07-12 48.1%
- 686
Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
- 687 princeton-nlp/Mistral-7B-Base-SFT-CPO Three-shot, text-only, rev: 7f67394, bfloat16, 2024-10-07 48.1%
- 688 tiiuae/Falcon-H1-1.5B-Base Three-shot, text-only, bfloat16, 2025-07-08 48.1%
- 689
Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
- 690 Intel/neural-chat-7b-v3-1 Three-shot, text-only, float16, 2024-02-21 48%
- 691 JJhooww/MistralReloadBR_v2_ptbr Three-shot, text-only, bfloat16, 2024-03-08 48%
- 692 rhaymison/Mistral-portuguese-luana-7b Three-shot, text-only, bfloat16, 2024-04-08 48%
- 693 hkust-nlp/deita-7b-v1.0-sft Three-shot, text-only, bfloat16, 2024-04-25 48%
- 694 CohereForAI/aya-101 Three-shot, text-only, float16, 2024-02-17 47.8%
- 695 royallab/ZephRP-m7b Three-shot, text-only, bfloat16, 2024-05-16 47.8%
- 696 ValiantLabs/Llama3.1-8B-Fireplace2 Three-shot, text-only, bfloat16, 2024-08-10 47.8%
- 697 maritaca-ai/sabia-7b Three-shot, text-only, float16, 2024-02-05 47.7%
- 698 internlm/internlm2-base-7b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 47.7%
- 699
Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
- 700 deepseek-ai/DeepSeek-V2-Lite-Chat Three-shot, text-only, bfloat16, 2024-05-17 47.7%
- 701 meta-llama/Llama-2-70b-chat-hf Three-shot, text-only, float16, 2024-02-18 47.6%
- 702 Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged Three-shot, text-only, float16, 2024-04-09 47.6%
- 703 kaitchup/Qwen1.5-7B-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 47.6%
- 704 alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt Three-shot, text-only, bfloat16, 2024-04-28 47.6%
- 705 HuggingFaceH4/zephyr-7b-gemma-v0.1 Three-shot, text-only, bfloat16, 2024-03-02 47.4%
- 706 Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO Three-shot, text-only, float16, 2024-04-09 47.4%
- 707
Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
- 708 recogna-nlp/mistralbode_7b_qlora_ultraalpaca Three-shot, text-only, float16, 2024-04-23 47.1%
- 709 heloisy/zephyr-7b-cosmosqa-ptbr_text Three-shot, text-only, bfloat16, 2024-05-27 47.1%
- 710 nicolasdec/Cabramistral7b Three-shot, text-only, float16, 2024-03-18 47%
- 711 chargoddard/internlm2-base-7b-llama Three-shot, text-only, rev: refs/pr/2, bfloat16, 2024-04-25 47%
- 712 tiiuae/falcon-11B Three-shot, text-only, bfloat16, 2024-05-13 47%
- 713 aws-prototyping/MegaBeam-Mistral-7B-512k Three-shot, text-only, bfloat16, 2024-10-07 47%
- 714 OpenLLM-France/Claire-Mistral-7B-0.1 Three-shot, text-only, bfloat16, 2024-02-05 46.9%
- 715 nicolasdec/CabraMistral7b Three-shot, text-only, bfloat16, 2024-04-18 46.9%
- 716 maywell/Synatra-7B-v0.3-RP Three-shot, text-only, float16, 2024-05-13 46.9%
- 717 matheusrdgsf/cesar-ptbr Three-shot, text-only, GPTQ, 2024-05-27 46.9%
- 718 TheBloke/zephyr-7B-beta-GPTQ Three-shot, text-only, GPTQ, 2024-05-27 46.9%
- 719 01-ai/Yi-6B-200K Three-shot, text-only, bfloat16, 2024-02-05 46.7%
- 720
Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
- 721
Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
- 722
Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
- 723 Qwen/Qwen-7B-Chat Three-shot, text-only, float16, 2024-04-18 46.2%
- 724 allenai/tulu-2-13b Three-shot, text-only, bfloat16, 2024-05-22 46.2%
- 725
Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
- 726 rhaymison/Mistral-portuguese-luana-7b-Mathematics Three-shot, text-only, bfloat16, 2024-04-18 46%
- 727 hkust-nlp/deita-7b-v1.0 Three-shot, text-only, bfloat16, 2024-04-25 45.9%
- 728 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3 Three-shot, text-only, bfloat16, 2024-05-27 45.8%
- 729 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3 Three-shot, text-only, float16, 2024-05-28 45.8%
- 730
Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
- 731 Weni/ZeroShot-Multilanguage-Zephyr-7B Three-shot, text-only, float16, 2024-04-09 45.6%
- 732 meta-llama/Llama-2-13b-chat-hf Three-shot, text-only, bfloat16, 2024-04-19 45.6%
- 733 rhaymison/portuguese-tom-cat-13b Three-shot, text-only, bfloat16, 2024-05-20 45.6%
- 734 rfanucchi/Llama3-pt_br_cabrita Three-shot, text-only, bfloat16, 2024-05-21 45.6%
- 735 botbot-ai/CabraMistral-v3-7b-32k Three-shot, text-only, bfloat16, 2024-06-10 45.6%
- 736
DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
- 737 Motif-Technologies/Motif-2.6B Three-shot, text-only, bfloat16, 2025-08-30 45.6%
- 738 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2 Three-shot, text-only, bfloat16, 2024-05-27 45.5%
- 739 nvidia/Llama-3.1-Nemotron-Nano-8B-v1 Three-shot, text-only, bfloat16, 2025-08-30 45.5%
- 740
Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
- 741 princeton-nlp/Mistral-7B-Base-SFT-DPO Three-shot, text-only, rev: 17134fd, bfloat16, 2024-10-07 45.1%
- 742 recogna-nlp/zephyr_7b_beta_ultraalpaca Three-shot, text-only, float16, 2024-04-23 44.9%
- 743 meta-llama/Llama-2-13b-hf Three-shot, text-only, float16, 2024-02-05 44.5%
- 744 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft Three-shot, text-only, bfloat16, 2024-04-22 44.4%
- 745 lmsys/vicuna-13b-v1.5 Three-shot, text-only, float16, 2024-02-27 44.2%
- 746 allenai/tulu-2-7b Three-shot, text-only, bfloat16, 2024-05-22 44.2%
- 747 Motif-Technologies/Motif-2.6b-v1.1-LC Three-shot, text-only, bfloat16, 2025-08-30 44.2%
- 748 allenai/tulu-2-dpo-7b Three-shot, text-only, bfloat16, 2024-03-05 44.1%
- 749 SakanaAI/DiscoPOP-zephyr-7b-gemma Three-shot, text-only, bfloat16, 2024-06-17 44.1%
- 750 AIDC-AI/Marco-LLM-ES Three-shot, text-only, bfloat16, 2025-02-27 44.1%
- 751 BAAI/Aquila2-34B Three-shot, text-only, bfloat16, 2024-02-05 43.8%
- 752 OliveiraJLT/Sagui-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-07-18 43.7%
- 753 THUDM/chatglm3-6b-32k Three-shot, text-only, float16, 2024-04-05 43.5%
- 754
Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
- 755 GuiCas/Phituguese_FP16 Three-shot, text-only, float16, 2024-06-04 43.3%
- 756 abacusai/Liberated-Qwen1.5-14B Three-shot, text-only, float16, 2024-06-12 43.1%
- 757 google/medgemma-4b-pt Three-shot, text-only, bfloat16, 2025-07-15 42.8%
- 758 xverse/XVERSE-13B Three-shot, text-only, bfloat16, 2024-02-05 42.7%
- 759 rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct Three-shot, text-only, float16, 2024-05-23 42.6%
- 760 01-ai/Yi-Coder-9B-Chat Three-shot, text-only, bfloat16, 2024-09-21 42.6%
- 761 LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
- 762 kurakurai/Luth-0.6B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 42.3%
- 763 Deci/DeciLM-7B Three-shot, text-only, bfloat16, 2024-02-05 42%
- 764 J-LAB/Brisa_v0.2_sft Three-shot, text-only, float16, 2024-10-26 41.9%
- 765 google/gemma-2-2b Three-shot, text-only, bfloat16, 2024-08-09 41.7%
- 766 dfurman/Llama-3-8B-Orpo-v0.1 Three-shot, text-only, float16, 2024-08-22 41.7%
- 767 kurakurai/Luth-LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 41.7%
- 768
Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
- 769 LiquidAI/LFM2-700M Three-shot, text-only, bfloat16, 2025-08-30 41.6%
- 770 Qwen/Qwen1.5-MoE-A2.7B Three-shot, text-only, bfloat16, 2024-04-12 41.5%
- 771 lmsys/vicuna-7b-v1.5 Three-shot, text-only, float16, 2024-02-27 41.3%
- 772 rfanucchi/Llama3-pt_br_cabrit_orca_qkvo Three-shot, text-only, bfloat16, 2024-06-04 41.3%
- 773 princeton-nlp/Mistral-7B-Base-SFT-RRHF Three-shot, text-only, rev: 0d58610, bfloat16, 2024-10-07 41.3%
- 774 tiiuae/Falcon3-3B-Base Three-shot, text-only, bfloat16, 2025-01-29 41.2%
- 775 nicolasdec/cabra13b Three-shot, text-only, float16, 2024-02-05 40.9%
- 776 recogna-nlp/phibode-3-mini-4k-ultraalpaca Three-shot, text-only, float16, 2024-05-05 40.8%
- 777 TIGER-Lab/Qwen2.5-Math-7B-CFT Three-shot, text-only, bfloat16, 2025-03-07 40.8%
- 778 Xwin-LM/Xwin-LM-7B-V0.1 Three-shot, text-only, float16, 2024-05-22 40.6%
- 779 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full Three-shot, text-only, bfloat16, 2024-06-06 40.6%
- 780 X-D-Lab/XrayQwen Three-shot, text-only, rev: 3f477a4, float16, 2024-09-18 40.5%
- 781 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct Three-shot, text-only, bfloat16, 2024-08-09 40.3%
- 782 baichuan-inc/Baichuan2-7B-Base Three-shot, text-only, bfloat16, 2024-02-05 40.1%
- 783 kurakurai/Luth-LFM2-700M Three-shot, text-only, bfloat16, 2025-08-30 40.1%
- 784 recogna-nlp/mistral-bode Three-shot, text-only, float16, 2024-04-04 39.8%
- 785 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2 Three-shot, text-only, bfloat16, 2024-04-22 39.8%
- 786 01-ai/Yi-Coder-9B Three-shot, text-only, bfloat16, 2024-09-21 39.5%
- 787 h2oai/h2o-danube3.1-4b-chat Three-shot, text-only, bfloat16, 2024-12-05 39.1%
- 788 migtissera/Tess-3-Mistral-Nemo-12B Three-shot, text-only, bfloat16, 2024-08-30 38.9%
- 789 xverse/XVERSE-65B-2 Three-shot, text-only, bfloat16, 2024-02-05 38.8%
- 790
MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
- 791 AdaptLLM/finance-LLM-13B Three-shot, text-only, float16, 2024-02-11 38.5%
- 792 deepseek-ai/deepseek-llm-7b-base Three-shot, text-only, bfloat16, 2024-02-05 38.4%
- 793 recogna-nlp/bode-13b-alpaca-pt-br Three-shot, text-only, float16, 2024-02-05 38.3%
- 794 h2oai/h2o-danube3-4b-chat Three-shot, text-only, bfloat16, 2024-07-22 38.3%
- 795 J-LAB/FluxiIA-Small_Brisa Three-shot, text-only, float16, 2024-11-16 38.3%
- 796 AdaptLLM/law-LLM-13B Three-shot, text-only, float16, 2024-02-11 38%
- 797 deepseek-ai/deepseek-moe-16b-chat Three-shot, text-only, bfloat16, 2024-04-13 38%
- 798 xverse/XVERSE-65B Three-shot, text-only, bfloat16, 2024-02-05 37.8%
- 799 ghost-x/ghost-8b-beta Three-shot, text-only, bfloat16, 2024-07-23 37.7%
- 800 gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
- 801
Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
- 802 AdaptLLM/medicine-LLM-13B Three-shot, text-only, float16, 2024-02-11 37.5%
- 803 Xwin-LM/Xwin-LM-7B-V0.2 Three-shot, text-only, float16, 2024-05-22 37.4%
- 804 haoranxu/ALMA-13B-Pretrain Three-shot, text-only, bfloat16, 2024-05-15 37.3%
- 805 rfanucchi/Llama3-pt_br_orca Three-shot, text-only, bfloat16, 2024-05-16 37%
- 806 xverse/XVERSE-7B Three-shot, text-only, bfloat16, 2024-02-05 36.9%
- 807 THUDM/agentlm-7b Three-shot, text-only, float16, 2024-04-05 36.7%
- 808 Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized Three-shot, text-only, float16, 2024-04-09 36.6%
- 809 recogna-nlp/gembode-7b-it Three-shot, text-only, float16, 2024-04-23 36.6%
- 810 h2oai/h2o-danube3-4b-base Three-shot, text-only, bfloat16, 2024-07-22 36.4%
- 811 tanliboy/lambda-qwen2.5-32b-dpo-test Three-shot, text-only, bfloat16, 2024-09-30 36.4%
- 812 NousResearch/Nous-Hermes-13b Three-shot, text-only, bfloat16, 2024-02-27 36.3%
- 813 Qwen/Qwen1.5-4B Three-shot, text-only, bfloat16, 2024-02-17 36.2%
- 814 eduagarcia/gemma-7b-it_no_chat_template Three-shot, text-only, bfloat16, 2024-02-23 36%
- 815 stabilityai/stablelm-zephyr-3b Three-shot, text-only, bfloat16, 2024-02-27 36%
- 816
Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
- 817 ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
- 818 THUDM/chatglm3-6b-128k Three-shot, text-only, float16, 2024-04-05 35.5%
- 819 Qwen/Qwen2.5-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 35.5%
- 820 cnmoro/Qwen2.5-0.5B-Portuguese-v1 Three-shot, text-only, float16, 2025-02-25 34.6%
- 821
Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
- 822 THUDM/LongAlign-7B-64k Three-shot, text-only, float16, 2024-04-05 33.7%
- 823 internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
- 824 nicolasdec/Cabra Three-shot, text-only, float16, 2024-02-05 33.4%
- 825 stabilityai/stablelm-2-1_6b-chat Three-shot, text-only, float16, 2024-04-09 33.2%
- 826 cognitivecomputations/dolphin-2.9.3-llama-3-8b Three-shot, text-only, bfloat16, 2024-07-02 33.2%
- 827
Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
- 828
LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
- 829 rhaymison/Llama-portuguese-13b-Luana-v0.2 Three-shot, text-only, bfloat16, 2024-04-08 32.7%
- 830 cognitivecomputations/dolphin-2.9.1-mixtral-1x22b Three-shot, text-only, bfloat16, 2024-05-24 32.7%
- 831 BAAI/OPI-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-09-21 32.7%
- 832 stabilityai/stablelm-2-zephyr-1_6b Three-shot, text-only, float16, 2024-02-27 32.4%
- 833 internlm/internlm2-chat-1_8b Three-shot, text-only, bfloat16, 2024-04-18 32.3%
- 834 internlm/internlm2_5-1_8b Three-shot, text-only, bfloat16, 2024-08-09 32.3%
- 835 internlm/internlm2-chat-1_8b-sft Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 32.1%
- 836 internlm/internlm2-1_8b Three-shot, text-only, bfloat16, 2024-04-21 31.7%
- 837 cognitivecomputations/WizardLM-13B-Uncensored Three-shot, text-only, float16, 2024-05-22 31.7%
- 838 AdaptLLM/law-LLM Three-shot, text-only, float16, 2024-02-11 31.6%
- 839 internlm/internlm2_5-1_8b-chat Three-shot, text-only, bfloat16, 2024-08-09 31.6%
- 840
Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
- 841 haoranxu/ALMA-13B-R Three-shot, text-only, bfloat16, 2024-05-16 31.4%
- 842 google/recurrentgemma-2b-it Three-shot, text-only, bfloat16, 2024-05-17 31.4%
- 843 Oburaco/llama2-qlora-finetunined-ptbr Three-shot, text-only, bfloat16, 2024-05-27 31.4%
- 844 TinyPixel/Llama-2-7B-bf16-sharded Three-shot, text-only, bfloat16, 2024-05-27 31.4%
- 845 rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora Three-shot, text-only, 4bit, 2024-09-27 31.4%
- 846 unsloth/Llama-3.2-1B-Instruct Three-shot, text-only, float16, 2024-11-24 31.4%
- 847 cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning Three-shot, text-only, float16, 2025-03-08 31.4%
- 848 meta-llama/Llama-2-7b-hf Three-shot, text-only, float16, 2024-02-05 31.3%
- 849 AdaptLLM/medicine-LLM Three-shot, text-only, float16, 2024-02-11 31.3%
- 850 kurakurai/Luth-LFM2-350M Three-shot, text-only, bfloat16, 2025-08-30 31%
- 851 recogna-nlp/internlm2-chat-1_8b-ultracabrita Three-shot, text-only, float16, 2024-05-05 30.7%
- 852 Unbabel/TowerBase-7B-v0.1 Three-shot, text-only, bfloat16, 2024-02-05 30.6%
- 853 tensoropera/Fox-1-1.6B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-07-23 30.6%
- 854 meta-llama/Llama-3.2-1B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 30.6%
- 855 deepseek-ai/deepseek-moe-16b-base Three-shot, text-only, bfloat16, 2024-02-05 30.3%
- 856 google/gemma-7b-it Three-shot, text-only, rev: float16, float16, 2024-02-23 30.3%
- 857
MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
- 858 tiiuae/Falcon-H1-0.5B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 30.3%
- 859 GeneZC/MiniMA-2-3B Three-shot, text-only, float16, 2024-07-23 30.2%
- 860 chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
- 861 stabilityai/stablelm-3b-4e1t Three-shot, text-only, bfloat16, 2024-02-05 29.9%
- 862 dominguesm/canarim-7b Three-shot, text-only, float16, 2024-02-05 29.8%
- 863 stabilityai/stablelm-base-alpha-7b-v2 Three-shot, text-only, float16, 2024-02-05 29.8%
- 864 Qwen/Qwen1.5-1.8B-Chat Three-shot, text-only, bfloat16, 2024-02-22 29.8%
- 865 NTQAI/Nxcode-CQ-7B-orpo Three-shot, text-only, bfloat16, 2024-08-10 29.6%
- 866 deepseek-ai/DeepSeek-R1-Distill-Llama-8B Three-shot, text-only, bfloat16, 2025-01-29 29.6%
- 867 LiquidAI/LFM2-350M Three-shot, text-only, bfloat16, 2025-08-30 29.5%
- 868 lrds-code/boana-7b-instruct Three-shot, text-only, bfloat16, 2024-02-05 29.2%
- 869
DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
- 870 AdaptLLM/finance-LLM Three-shot, text-only, float16, 2024-02-11 29.1%
- 871 semantixai/LloroV2 Three-shot, text-only, bfloat16, 2024-03-13 29.1%
- 872 meta-llama/Llama-2-7b-chat-hf Three-shot, text-only, bfloat16, 2024-04-19 29.1%
- 873 rhaymison/gemma-portuguese-tom-cat-2b-it Three-shot, text-only, float16, 2024-04-29 29.1%
- 874 recogna-nlp/bode-7b-alpaca-pt-br Three-shot, text-only, float16, 2024-02-05 28.9%
- 875 langtech-languagemodeling/IberianLLM-7B-Instruct Three-shot, text-only, bfloat16, 2025-07-14 28.9%
- 876 Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT Three-shot, text-only, float16, 2024-04-09 28.8%
- 877 Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT Three-shot, text-only, float16, 2024-04-09 28.8%
- 878 GeneZC/MiniLoong-3B Three-shot, text-only, float16, 2024-07-23 28.8%
- 879
Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
- 880 h2oai/h2o-danube2-1.8b-base Three-shot, text-only, bfloat16, 2024-04-09 28.4%
- 881 nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 Three-shot, text-only, bfloat16, 2025-08-30 28.4%
- 882 baichuan-inc/Baichuan2-13B-Base Three-shot, text-only, bfloat16, 2024-02-05 28.2%
- 883 AI-Sweden-Models/gpt-sw3-40b Three-shot, text-only, float16, 2024-02-05 28.1%
- 884 mosaicml/mpt-7b-8k Three-shot, text-only, bfloat16, 2024-02-05 28.1%
- 885 h2oai/h2o-danube2-1.8b-chat Three-shot, text-only, bfloat16, 2024-04-09 28.1%
- 886 BAAI/Aquila-7B Three-shot, text-only, float16, 2024-02-05 28%
- 887 pfnet/plamo-13b Three-shot, text-only, bfloat16, 2024-04-18 27.7%
- 888 unsloth/gemma-2b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 27.4%
- 889 cognitivecomputations/dolphin-2.9.4-llama3.1-8b Three-shot, text-only, bfloat16, 2024-08-25 27.4%
- 890 BSC-LT/salamandra-7b Three-shot, text-only, bfloat16, 2025-04-04 27.1%
- 891 baidu/ERNIE-4.5-0.3B-Base-PT Three-shot, text-only, bfloat16, 2025-08-31 27.1%
- 892
Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
- 893 nbeerbower/gemma2-gutenberg-27B Three-shot, text-only, bfloat16, 2024-09-15 26.8%
- 894 TucanoBR/Tucano-630m Three-shot, text-only, float16, 2024-12-03 26.8%
- 895 cnmoro/Qwen2.5-0.5B-Portuguese-v2 Three-shot, text-only, float16, 2025-03-08 26.8%
- 896 DAMO-NLP-MT/polylm-1.7b Three-shot, text-only, float16, 2024-02-11 26.6%
- 897 Oburaco/ptbr-falcon-7b Three-shot, text-only, bfloat16, 2024-05-27 26.6%
- 898 Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
- 899 Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
- 900 dominguesm/Canarim-7B-Instruct Three-shot, text-only, float16, 2024-02-23 26.1%
- 901 google/recurrentgemma-2b Three-shot, text-only, float16, 2024-05-17 26.1%
- 902 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora Three-shot, text-only, float16, 2024-04-23 26%
- 903 tiiuae/Falcon3-1B-Base Three-shot, text-only, bfloat16, 2025-01-29 26%
- 904 BSC-LT/salamandra-2b Three-shot, text-only, bfloat16, 2025-04-04 26%
- 905 OpenLLM-France/Claire-7B-0.1 Three-shot, text-only, bfloat16, 2024-02-05 25.9%
- 906 google/gemma-2b-it Three-shot, text-only, bfloat16, 2024-02-21 25.9%
- 907 recogna-nlp/gembode-2b-ultraalpaca Three-shot, text-only, float16, 2024-04-09 25.9%
- 908 AI-Sweden-Models/gpt-sw3-6.7b Three-shot, text-only, float16, 2024-02-05 25.7%
- 909 nicholasKluge/TeenyTinyLlama-460m Three-shot, text-only, bfloat16, 2024-02-22 25.7%
- 910 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca Three-shot, text-only, float16, 2024-04-22 25.7%
- 911
OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
- 912 stabilityai/stablelm-2-1_6b Three-shot, text-only, float16, 2024-04-18 25.6%
- 913 TucanoBR/Tucano-1b1 Three-shot, text-only, float16, 2024-12-03 25.6%
- 914 gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
- 915 nicholasKluge/TeenyTinyLlama-460m-Chat Three-shot, text-only, bfloat16, 2024-02-22 25.4%
- 916 Qwen/Qwen1.5-0.5B-Chat Three-shot, text-only, bfloat16, 2024-02-22 25.4%
- 917 allenai/OLMo-2-0425-1B Three-shot, text-only, bfloat16, 2025-05-01 25.4%
- 918 cerebras/btlm-3b-8k-base Three-shot, text-only, bfloat16, 2024-02-11 25.3%
- 919 recogna-nlp/GemBode-2b-it Three-shot, text-only, float16, 2024-03-14 25.3%
- 920 recogna-nlp/Phi-Bode Three-shot, text-only, float16, 2024-03-14 25.3%
- 921
SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
- 922 GeneZC/MiniMA-3B Three-shot, text-only, bfloat16, 2024-07-23 25.3%
- 923 TheDrummer/Big-Tiger-Gemma-27B-v1 Three-shot, text-only, rev: 892ca94, bfloat16, 2024-09-29 25.3%
- 924 croissantllm/CroissantLLMBase Three-shot, text-only, float16, 2024-02-17 25.2%
- 925 Qwen/Qwen1.5-1.8B Three-shot, text-only, bfloat16, 2024-02-17 25.2%
- 926 recogna-nlp/phi-bode-2-ultraalpaca Three-shot, text-only, float16, 2024-04-09 25.2%
- 927 MulaBR/Mula-4x160-v0.1 Three-shot, text-only, float16, 2024-04-21 25.2%
- 928 anthracite-org/magnum-v4-9b Three-shot, text-only, bfloat16, 2024-10-24 25.2%
- 929 TucanoBR/Tucano-160m Three-shot, text-only, float16, 2024-12-03 25.2%
- 930 RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
- 931 openlm-research/open_llama_7b_v2 Three-shot, text-only, float16, 2024-02-11 25%
- 932 TucanoBR/Tucano-2b4 Three-shot, text-only, float16, 2024-12-03 25%
- 933 microsoft/phi-1 Three-shot, text-only, float16, 2024-02-05 24.9%
- 934
Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
- 935 rhaymison/gemma-portuguese-luana-2b Three-shot, text-only, bfloat16, 2024-04-18 24.9%
- 936 h2oai/h2o-danube2-1.8b-sft Three-shot, text-only, bfloat16, 2024-05-21 24.9%
- 937
OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
- 938 openlm-research/open_llama_13b Three-shot, text-only, float16, 2024-02-11 24.8%
- 939 TheBloke/wizardLM-7B-HF Three-shot, text-only, float16, 2024-05-22 24.8%
- 940 togethercomputer/RedPajama-INCITE-Base-3B-v1 Three-shot, text-only, float16, 2024-02-05 24.6%
- 941 haoranxu/ALMA-7B-R Three-shot, text-only, bfloat16, 2024-07-29 24.6%
- 942 Bruno/Caramelo_7B Three-shot, text-only, bfloat16, 2024-02-24 24.5%
- 943 Weni/WeniGPT-Mistral-7B-instructBase-4bit Three-shot, text-only, float16, 2024-04-09 24.5%
- 944 tensoropera/Fox-1-1.6B Three-shot, text-only, bfloat16, 2024-07-23 24.5%
- 945 Ramikan-BR/Qwen2-0.5B-v5 Three-shot, text-only, rev: ce92f05, float16, 2024-07-22 24.3%
- 946 tiiuae/Falcon-H1-0.5B-Base Three-shot, text-only, bfloat16, 2025-07-08 24.3%
- 947
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
- 948 facebook/galactica-30b Three-shot, text-only, float16, 2024-02-11 24.2%
- 949 recogna-nlp/gembode-2b-base-ultraalpaca Three-shot, text-only, float16, 2024-04-22 24.2%
- 950 yahma/llama-7b-hf Three-shot, text-only, float16, 2024-05-27 24.2%
- 951 fernandosola/bluearara-7B-instruct Three-shot, text-only, bfloat16, 2024-03-08 24.1%
- 952 Ramikan-BR/Qwen2-0.5B-v9 Three-shot, text-only, rev: 51d076f, float16, 2024-07-22 24.1%
- 953 TinyLlama/TinyLlama_v1.1 Three-shot, text-only, float16, 2024-07-25 24.1%
- 954 Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
- 955
LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
- 956 matsuo-lab/weblab-10b Three-shot, text-only, float16, 2024-02-05 23.9%
- 957 Oburaco/ptbr-falcon-7b-v3 Three-shot, text-only, bfloat16, 2024-05-27 23.9%
- 958 vilsonrodrigues/falcon-7b-instruct-sharded Three-shot, text-only, bfloat16, 2024-05-27 23.9%
- 959 GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
- 960 bigscience/bloom-7b1 Three-shot, text-only, float16, 2024-02-05 23.6%
- 961 EleutherAI/pythia-410m Three-shot, text-only, float16, 2024-02-11 23.6%
- 962 allenai/OLMo-7B-Twin-2T Three-shot, text-only, float16, 2024-02-17 23.6%
- 963
Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
- 964 AI-Sweden-Models/gpt-sw3-6.7b-v2 Three-shot, text-only, float16, 2024-02-05 23.5%
- 965 Weni/WeniGPT-Mistral-7B-instructBase Three-shot, text-only, float16, 2024-04-09 23.5%
- 966 M4-ai/tau-1.8B Three-shot, text-only, bfloat16, 2024-04-21 23.5%
- 967 cognitivecomputations/WizardLM-7B-Uncensored Three-shot, text-only, float16, 2024-05-22 23.5%
- 968 RogerioPiazzon/alpaca-lora-ptbr-7b Three-shot, text-only, float16, 2024-05-27 23.5%
- 969 projecte-aina/FLOR-760M Three-shot, text-only, float16, 2024-02-05 23.4%
- 970 facebook/xglm-4.5B Three-shot, text-only, float16, 2024-02-11 23.4%
- 971
Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
- 972 NucleusAI/nucleus-22B-token-500B Three-shot, text-only, float16, 2024-02-05 23.2%
- 973 ericzzz/falcon-rw-1b-instruct-openorca Three-shot, text-only, bfloat16, 2024-04-21 23.2%
- 974 lucianosb/boto-27B Three-shot, text-only, bfloat16, 2024-07-12 23.2%
- 975 22h/cabrita_7b_pt_850000 Three-shot, text-only, float16, 2024-02-11 23.1%
- 976 nicholasKluge/TeenyTinyLlama-160m Three-shot, text-only, bfloat16, 2024-02-22 23.1%
- 977 openlm-research/open_llama_3b_v2 Three-shot, text-only, float16, 2024-02-11 22.9%
- 978 fernandosola/bluearara-7B Three-shot, text-only, bfloat16, 2024-02-17 22.9%
- 979 Oburaco/juridic-falcon-7b Three-shot, text-only, bfloat16, 2024-05-27 22.9%
- 980 GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
- 981 TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T Three-shot, text-only, float16, 2024-02-05 22.8%
- 982 TechxGenus/Jamba-v0.1-9B Three-shot, text-only, bfloat16, 2024-05-29 22.8%
- 983
SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
- 984 TucanoBR/Tucano-2b4-Instruct Three-shot, text-only, float16, 2024-12-03 22.8%
- 985 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview Three-shot, text-only, bfloat16, 2025-08-30 22.8%
- 986
MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
- 987 stabilityai/stablelm-base-alpha-3b-v2 Three-shot, text-only, float16, 2024-02-05 22.7%
- 988 cerebras/Cerebras-GPT-590M Three-shot, text-only, float16, 2024-02-11 22.7%
- 989 EleutherAI/pythia-12b Three-shot, text-only, float16, 2024-02-11 22.7%
- 990 h2oai/h2o-danube-1.8b-base Three-shot, text-only, bfloat16, 2024-04-09 22.7%
- 991 AI-Sweden-Models/gpt-sw3-20b Three-shot, text-only, float16, 2024-02-05 22.5%
- 992 EleutherAI/pythia-2.8b-deduped Three-shot, text-only, float16, 2024-02-05 22.5%
- 993 unicamp-dl/ptt5-base-portuguese-vocab Three-shot, text-only, float16, 2024-02-11 22.5%
- 994 unicamp-dl/ptt5-small-portuguese-vocab Three-shot, text-only, float16, 2024-02-11 22.5%
- 995 state-spaces/mamba-790m-hf Three-shot, text-only, float16, 2024-04-07 22.5%
- 996
Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
- 997 baidu/ERNIE-4.5-0.3B-PT Three-shot, text-only, bfloat16, 2025-08-31 22.5%
- 998 EleutherAI/pythia-2.8b Three-shot, text-only, float16, 2024-02-11 22.4%
- 999 nicolasdec/CabraMistral7b-0.4 Three-shot, text-only, float16, 2024-02-22 22.4%
- 1000 proxectonos/FLOR-1.3B-GL Three-shot, text-only, float16, 2024-04-25 22.4%
- 1001 utter-project/EuroLLM-1.7B Three-shot, text-only, bfloat16, 2025-08-30 22.4%
- 1002 openlm-research/open_llama_3b Three-shot, text-only, float16, 2024-02-11 22.3%
- 1003
Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
- 1004 EleutherAI/pythia-6.9b-deduped Three-shot, text-only, float16, 2024-02-05 22.1%
- 1005 cerebras/Cerebras-GPT-6.7B Three-shot, text-only, float16, 2024-02-11 22.1%
- 1006 Bruno/Caramelinho Three-shot, text-only, bfloat16, 2024-02-24 22.1%
- 1007 GeneZC/MiniMA-2-1B Three-shot, text-only, float16, 2024-07-23 22.1%
- 1008
Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
- 1009 open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
- 1010 Ramikan-BR/TiamaPY-v31 Three-shot, text-only, rev: d4612a5, float16, 2024-06-20 22%
- 1011 facebook/opt-30b Three-shot, text-only, float16, 2024-02-05 21.8%
- 1012 Ramikan-BR/TiamaPY-v30 Three-shot, text-only, rev: 300C415, float16, 2024-06-19 21.8%
- 1013 fernandosola/bluearara-7B-instruct-v02 Three-shot, text-only, bfloat16, 2024-12-30 21.8%
- 1014 GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
- 1015 LiteAI/Hare-1.1B-base Three-shot, text-only, float16, 2024-07-23 21.7%
- 1016 projecte-aina/FLOR-6.3B Three-shot, text-only, float16, 2024-02-05 21.6%
- 1017 facebook/galactica-6.7b Three-shot, text-only, float16, 2024-02-11 21.6%
- 1018 TinyLlama/TinyLlama-1.1B-Chat-v1.0 Three-shot, text-only, bfloat16, 2024-02-22 21.6%
- 1019 recogna-nlp/gembode-2b-ultraalpaca-qlora Three-shot, text-only, float16, 2024-04-23 21.6%
- 1020 utter-project/EuroLLM-1.7B-Instruct Three-shot, text-only, float16, 2025-02-21 21.6%
- 1021 bigscience/bloom-1b7 Three-shot, text-only, float16, 2024-02-05 21.4%
- 1022 openai-community/gpt2-xl Three-shot, text-only, float16, 2024-02-05 21.4%
- 1023 pierreguillou/gpt2-small-portuguese Three-shot, text-only, float16, 2024-02-05 21.4%
- 1024 openai-community/gpt2-large Three-shot, text-only, float16, 2024-02-05 21.3%
- 1025 facebook/galactica-1.3b Three-shot, text-only, float16, 2024-02-11 21.3%
- 1026 JosephusCheung/LL7M Three-shot, text-only, float16, 2024-04-21 21.3%
- 1027 M4-ai/tau-0.5B-instruct-DPOP Three-shot, text-only, float16, 2024-04-21 21.3%
- 1028 MulaBR/Mula-8x160-v0.1 Three-shot, text-only, float16, 2024-05-08 21.3%
- 1029 h2oai/h2o-danube-1.8b-sft Three-shot, text-only, bfloat16, 2024-05-21 21.3%
- 1030 rhaymison/portuguese-phi1_5-tom-cat Three-shot, text-only, bfloat16, 2024-05-21 21.3%
- 1031 22h/open-cabrita3b Three-shot, text-only, float16, 2024-02-11 21.1%
- 1032 wandgibaut/periquito-3B Three-shot, text-only, float16, 2024-02-11 21.1%
- 1033 allenai/OLMo-7B Three-shot, text-only, float16, 2024-02-17 21%
- 1034 PORTULAN/gervasio-7b-portuguese-ptbr-decoder Three-shot, text-only, bfloat16, 2024-03-07 21%
- 1035 facebook/opt-2.7b Three-shot, text-only, float16, 2024-02-05 20.9%
- 1036 EleutherAI/pythia-70m Three-shot, text-only, float16, 2024-02-11 20.9%
- 1037 dynamofl/dynamo-8B-v0.1 Three-shot, text-only, bfloat16, 2024-02-05 20.7%
- 1038 HuggingFaceTB/cosmo-1b Three-shot, text-only, float16, 2024-02-24 20.7%
- 1039 pedrogengo/gemma-ptbr Three-shot, text-only, float16, 2024-03-28 20.7%
- 1040 recogna-nlp/phibode_1_5_ultraalpaca Three-shot, text-only, float16, 2024-05-12 20.7%
- 1041 BAAI/Emu3-Stage1 Three-shot, text-only, bfloat16, 2024-10-21 20.7%
- 1042 bigscience/bloom-3b Three-shot, text-only, float16, 2024-02-05 20.6%
- 1043 EleutherAI/pythia-1b-deduped Three-shot, text-only, float16, 2024-02-05 20.6%
- 1044 openai-community/gpt2-medium Three-shot, text-only, float16, 2024-02-05 20.6%
- 1045 nisten/Biggie-SmoLlm-0.15B-Base Three-shot, text-only, bfloat16, 2024-08-09 20.6%
- 1046 EleutherAI/pythia-6.9b Three-shot, text-only, float16, 2024-02-11 20.3%
- 1047 state-spaces/mamba-1.4b-hf Three-shot, text-only, float16, 2024-04-07 20.3%
- 1048 state-spaces/mamba-370m-hf Three-shot, text-only, float16, 2024-04-07 20.3%
- 1049 recogna-nlp/gembode-2b-base-ultraalpaca-qlora Three-shot, text-only, float16, 2024-04-23 20.3%
- 1050 baichuan-inc/Baichuan-7B Three-shot, text-only, float16, 2024-02-05 20.2%
- 1051 EleutherAI/pythia-410m-deduped Three-shot, text-only, float16, 2024-02-05 20.2%
- 1052 facebook/xglm-7.5B Three-shot, text-only, float16, 2024-02-11 20.2%
- 1053 nicholasKluge/baseline Three-shot, text-only, float16, 2024-05-06 20.2%
- 1054 LiteAI/Hare-1.1B-Chat Three-shot, text-only, bfloat16, 2024-07-23 20%
- 1055
Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
- 1056 proxectonos/Llama-3.1-Carballo Three-shot, text-only, float16, 2025-04-01 20%
- 1057 facebook/xglm-1.7B Three-shot, text-only, float16, 2024-02-11 19.9%
- 1058 state-spaces/mamba-2.8b-hf Three-shot, text-only, float16, 2024-04-07 19.9%
- 1059 adalbertojunior/Mistral-7b-Portuguese-V0.1 Three-shot, text-only, bfloat16, 2024-04-25 19.9%
- 1060 Delta-Vector/Odin-9B Three-shot, text-only, bfloat16, 2024-10-29 19.9%
- 1061 facebook/xglm-2.9B Three-shot, text-only, float16, 2024-02-11 19.8%
- 1062 facebook/xglm-564M Three-shot, text-only, float16, 2024-02-11 19.8%
- 1063 cerebras/Cerebras-GPT-2.7B Three-shot, text-only, float16, 2024-02-11 19.6%
- 1064 stabilityai/stablelm-base-alpha-3b Three-shot, text-only, float16, 2024-02-05 19.5%
- 1065 BAAI/Emu3-Gen Three-shot, text-only, bfloat16, 2024-10-21 19.5%
- 1066 gpt2 Three-shot, text-only, float16, 2024-02-05 19.3%
- 1067 h2oai/h2o-danube-1.8b-chat Three-shot, text-only, bfloat16, 2024-04-09 19.3%
- 1068 proxectonos/Cerebras-1.3B-GL Three-shot, text-only, bfloat16, 2024-04-24 19.3%
- 1069
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
- 1070 EleutherAI/pythia-1b Three-shot, text-only, float16, 2024-02-11 19.2%
- 1071 Nos-PT/Carvalho_pt-gl-1.3B Three-shot, text-only, float16, 2024-06-26 19.2%
- 1072
SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
- 1073 facebook/opt-6.7b Three-shot, text-only, float16, 2024-02-05 19.1%
- 1074 projecte-aina/aguila-7b Three-shot, text-only, float16, 2024-02-05 19.1%
- 1075 EleutherAI/pythia-160m Three-shot, text-only, float16, 2024-02-11 19.1%
- 1076 bigscience/bloom-560m Three-shot, text-only, float16, 2024-02-05 18.9%
- 1077 stabilityai/stablelm-base-alpha-7b Three-shot, text-only, float16, 2024-02-05 18.9%
- 1078 allenai/OLMo-1B Three-shot, text-only, float16, 2024-02-17 18.9%
- 1079 Qwen/Qwen1.5-0.5B Three-shot, text-only, bfloat16, 2024-02-17 18.9%
- 1080 PORTULAN/gervasio-7b-portuguese-ptpt-decoder Three-shot, text-only, bfloat16, 2024-03-07 18.9%
- 1081 M4-ai/tau-0.5B Three-shot, text-only, float16, 2024-04-21 18.9%
- 1082 h2oai/h2o-danube3-500m-base Three-shot, text-only, bfloat16, 2024-07-22 18.9%
- 1083 premai-io/prem-1B-chat Three-shot, text-only, bfloat16, 2024-07-23 18.9%
- 1084 Nos-PT/Llama-Carvalho-PT Three-shot, text-only, float16, 2025-04-01 18.9%
- 1085 Nos-PT/Llama-Carvalho-PT-GL Three-shot, text-only, float16, 2025-04-01 18.9%
- 1086 projecte-aina/FLOR-1.3B Three-shot, text-only, float16, 2024-02-05 18.8%
- 1087 state-spaces/mamba-130m-hf Three-shot, text-only, float16, 2024-04-07 18.8%
- 1088 Ramikan-BR/tinyllama-coder-py-4bit-v10 Three-shot, text-only, rev: da5637d, float16, 2024-05-28 18.6%
- 1089 h2oai/h2o-danube3-500m-chat Three-shot, text-only, bfloat16, 2024-07-22 18.6%
- 1090 EleutherAI/gpt-neo-125m Three-shot, text-only, float16, 2024-02-05 18.5%
- 1091 HuggingFaceTB/SmolLM-1.7B-Instruct Three-shot, text-only, bfloat16, 2024-07-22 18.5%
- 1092
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
- 1093 EleutherAI/gpt-neo-1.3B Three-shot, text-only, float16, 2024-02-05 18.4%
- 1094 EleutherAI/pythia-70m-deduped Three-shot, text-only, float16, 2024-02-05 18.4%
- 1095 facebook/opt-125m Three-shot, text-only, float16, 2024-02-05 18.4%
- 1096 josu/gpt-neo-pt-1.3B Three-shot, text-only, float16, 2024-02-05 18.4%
- 1097 cerebras/Cerebras-GPT-256M Three-shot, text-only, float16, 2024-02-11 18.4%
- 1098 facebook/opt-350m Three-shot, text-only, float16, 2024-02-05 18.2%
- 1099 cerebras/Cerebras-GPT-111M Three-shot, text-only, float16, 2024-02-11 18.1%
- 1100 EleutherAI/pythia-14m Three-shot, text-only, float16, 2024-02-05 17.9%
- 1101 EleutherAI/pythia-160m-deduped Three-shot, text-only, float16, 2024-02-05 17.9%
- 1102 josu/gpt-neo-pt-br Three-shot, text-only, float16, 2024-02-05 17.7%
- 1103 nicholasKluge/Aira-2-portuguese-124M Three-shot, text-only, float16, 2024-02-05 17.1%
- 1104 HuggingFaceTB/SmolLM-360M-Instruct Three-shot, text-only, bfloat16, 2024-07-22 16.7%
- 1105 artificialguybr/llama3-8b-alpacadata-ptbr Three-shot, text-only, bfloat16, 2024-05-27 16.4%
- 1106 HuggingFaceTB/SmolLM-135M-Instruct Three-shot, text-only, bfloat16, 2024-07-22 16.3%
- 1107 FluxiIA/Tucaninho_dpo Three-shot, text-only, float16, 2025-03-24 15.4%
- 1108 FluxiIA/Tucaninho Three-shot, text-only, float16, 2025-02-27 15.3%
- 1109 facebook/galactica-125m Three-shot, text-only, float16, 2024-02-11 14.9%
- 1110 BAAI/Aquila2-7B Three-shot, text-only, float16, 2024-02-05 14.5%
- 1111 deepseek-ai/DeepSeek-V2-Lite Three-shot, text-only, bfloat16, 2024-05-17 14.5%
- 1112
DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
- 1113 T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
- 1114 T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
- 1115 pucpr/gpt2-bio-pt Three-shot, text-only, float16, 2024-02-05 12.9%
- 1116 internlm/internlm2_5-7b Three-shot, text-only, bfloat16, 2024-07-05 11.3%
- 1117 Ramikan-BR/tinyllama-coder-py-v11 Three-shot, text-only, rev: f1b5e2e, float16, 2024-05-28 10.7%
- 1118 dominguesm/mambarim-110m Three-shot, text-only, float16, 2024-04-15 10.6%
- 1119 Qwen/Qwen3-0.6B-Base Three-shot, text-only, bfloat16, 2025-05-01 10.6%
- 1120 ai-forever/mGPT-13B Three-shot, text-only, float16, 2024-02-11 10.4%
- 1121 google/mt5-base Three-shot, text-only, float16, 2024-04-18 10.3%
- 1122 T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
- 1123 NLPark/AnFeng_v3_Avocet Three-shot, text-only, bfloat16, 2024-05-22 9.60%
- 1124 lrds-code/samba-1.1B Three-shot, text-only, bfloat16, 2024-02-05 8.07%
- 1125 EleutherAI/polyglot-ko-12.8b Three-shot, text-only, float16, 2024-02-05 7.51%
- 1126
Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
- 1127 adalbertojunior/NeuralDaredevil-Dolphin-Portuguese Three-shot, text-only, bfloat16, 2024-06-04 6.12%
- 1128 HeyLucasLeao/gpt-neo-small-portuguese Three-shot, text-only, float16, 2024-02-05 3.89%
- 1129 JJhooww/Mistral_Reload_v4_Functions Three-shot, text-only, float16, 2024-06-15 3.48%
- 1130 NOVA-vision-language/GlorIA-1.3B Three-shot, text-only, float16, 2024-03-07 3.20%
- 1131 Ramikan-BR/tinyllama-coder-py-v12 Three-shot, text-only, rev: abd0469, float16, 2024-05-28 2.78%
- 1132 Qwen/Qwen-1_8B-Chat Three-shot, text-only, bfloat16, 2024-02-22 1.11%
- 1133 ssmits/Falcon2-5.5B-multilingual Three-shot, text-only, bfloat16, 2024-05-27 0.83%
- 1134 ssmits/Falcon2-5.5B-Portuguese Three-shot, text-only, bfloat16, 2024-05-27 0.83%
- 1135 monilouise/opt125M_portuguese Three-shot, text-only, float16, 2024-02-05 0.70%
- 1136 Qwen/Qwen-72B-Chat Three-shot, text-only, bfloat16, 2024-02-24 0.70%
- 1137 MTSAIR/multi_verse_model Three-shot, text-only, bfloat16, 2024-05-25 0.70%
- 1138 internlm/internlm2_5-20b Three-shot, text-only, bfloat16, 2024-08-09 0.70%
- 1139 MaziyarPanahi/Calme-4x7B-MoE-v0.2 Three-shot, text-only, bfloat16, 2024-06-17 0.42%
- 1140 nicholasKluge/Aira-2-portuguese-1B7 Three-shot, text-only, float16, 2024-02-05 0.28%
- 1141 MaziyarPanahi/Calme-4x7B-MoE-v0.1 Three-shot, text-only, bfloat16, 2024-06-16 0.28%
- 1142 eduagarcia/gemma-7b-it_singleturn_chat_template Three-shot, text-only, bfloat16, 2024-02-23 0.14%
- 1143 google/mt5-small Three-shot, text-only, float16, 2024-04-18 0.14%
- 1144 meta-llama/Meta-Llama-3-8B-Instruct Three-shot, text-only, bfloat16, 2024-04-18 0.14%
- 1145 abacusai/Llama-3-Smaug-8B Three-shot, text-only, bfloat16, 2024-05-13 0.14%
- 1146
Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%
- 1147 gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES Three-shot, text-only, float16, 2024-09-19 0.14%
- 1148 RLHFlow/ArmoRM-Llama3-8B-v0.1 Three-shot, text-only, bfloat16, 2024-10-08 0.14%
- 1149 nicholasKluge/Aira-2-portuguese-560M Three-shot, text-only, float16, 2024-02-05 0%
- 1150 openai-community/openai-gpt Three-shot, text-only, float16, 2024-02-05 0%
- 1151 ai-forever/mGPT Three-shot, text-only, float16, 2024-02-11 0%
- 1152 DAMO-NLP-MT/polylm-13b Three-shot, text-only, float16, 2024-02-11 0%
- 1153 rhaymison/gemma-portuguese-2b-it Three-shot, text-only, bfloat16, 2024-04-08 0%
- 1154 Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO Three-shot, text-only, bfloat16, 2024-04-09 0%
- 1155 abhishek/autotrain-llama3-orpo-v2 Three-shot, text-only, bfloat16, 2024-04-25 0%
- 1156 WizardLMTeam/WizardLM-13B-V1.0 Three-shot, text-only, float16, 2024-05-22 0%
- 1157 recogna-nlp/phibode_1_5_ultraalpaca_qlora Three-shot, text-only, float16, 2024-05-31 0%
- 1158 cognitivess/bella-1-8b Three-shot, text-only, float16, 2024-06-24 0%
- 1159 GeneZC/MiniChat-1.5-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
- 1160 GeneZC/MiniChat-2-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
- 1161 GeneZC/MiniChat-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
- 1162 monsterapi/Llama-3_1-8B-Instruct-orca-ORPO Three-shot, text-only, bfloat16, 2024-08-30 0%
- 1163 kaist-ai/janus-rm-7b Three-shot, text-only, bfloat16, 2024-10-09 0%
- 1164 J-LAB/Qwen2.5_Thinik_base_v1.0 Three-shot, text-only, float16, 2024-10-15 0%
- 1165 J-LAB/Thinik Three-shot, text-only, float16, 2024-10-15 0%
Source: Open Portuguese LLM Leaderboard’s leaderboard
- 95.0
Gemini 2.5 Pro
- 91.4 GPT-5 mini
- 89.8 Grok-3 mini
- 86.5
Gemini 2.5 Flash
- 85.8
Qwen3-32B
- 85.3 GPT-5 nano
- 84.6 Claude 3.7 Sonnet
- 84.1
DeepSeek-V3
- 84.0
Gemini 2.5 Flash-Lite
- 83.3
Qwen3-14B
- 83.0
Qwen3-30B-A3B
- 82.8 Kimi K2
- 81.8
DeepSeek-V3.1
- 81.2
Llama 4 Maverick
- 80.7
Qwen3-8B
- 80.5
Qwen2.5-VL-72B
- 80.5
Qwen2.5-VL-32B
- 80.4
Gemini 2.0 Flash
- 79.7 GPT-4o
- 79.0
Qwen2.5-72B
- 78.9 GPT-5
- 78.7
Gemini 2.0 Flash-Lite
- 78.3
Falcon-H1-34B
- 78.0
Qwen3-4B
- 76.9
Qwen3-30B-A3B-Instruct
- 76.8
Qwen2.5-32B
- 76.6
QwQ-32B-Preview
- 76.5
DeepSeek-R1-Distill-Qwen-14B
- 76.1
Gemini 1.5 Flash
- 75.9
Llama 3.3 70B Instruct
- 75.8
Gemini 1.5 Flash
- 75.4
Qwen2-72B
- 72.0
Qwen2.5-14B-Instruct-1M
- 71.2
Llama 3.1-70B
- 71.1
Llama 3.2 90B
- 70.4
Llama 3-70B
- 70.2
Phi-4
- 68.2
Gemma 3 12B PT
- 68.0
Gemma 2 27B
- 67.9
Qwen1.5-110B
- 67.9 Qwen2.5-Coder-14B
- 67.7 qwen3-4b-instruct-2507
- 67.6
Qwen1.5-72B
- 67.3
Qwen2.5-Coder-32B-Instruct
- 66.6
Yi-1.5-34B
- 66.6
Gemma 3 12B
- 66.5
Yi-34B
- 66.5 Qwen2.5-Coder-14B-Instruct
- 65.9
Keye-VL-1.5-8B
- 65.8
WizardLM-2 8x22B
- 65.8
Nemotron-4-340B-Instruct
- 65.4 c4ai-command-r-08-2024
- 65.4
Aya Expanse 32B
- 65.4
OLMo 2 32B Instruct
- 65.0 GLM-4-9B-Chat
- 64.5 GLM-4-9B
- 64.3
Mixtral 8x7B
- 64.3
Qwen3-1.7B
- 64.0
Gemma 2 9B
- 63.4
Phi-3.5-MoE
- 63.0
Tulu 2 DPO 70B
- 62.9
Falcon3-10B-Instruct
- 62.5 GPT-3.5 Turbo
- 62.5
phi-3-medium 14B
- 62.0
Command R (03-2024)
- 61.9 GLM-4-9B-Chat-1M
- 61.8
Mistral-Nemo-Base-2407
- 61.5
phi-3-small 7.4B
- 61.5
Phi-3-medium-128k-instruct
- 61.3
Llama 2-70B
- 61.3
InternLM2.5-20B-Chat
- 61.3
Falcon3-7B-Instruct
- 61.1
Qwen2-7B
- 61.1
Qwen2-7B-Instruct
- 60.8
Qwen1.5-14B-Chat
- 60.8
Qwen3-4B-Thinking-2507
- 60.6 Aria
- 59.9
Llama 3.1-8B
- 59.3
Llama 3.2 11B
- 58.7
Gemini 1.0 Pro
- 58.3
SOLAR-10.7B-Instruct-v1.0
- 57.9
Qwen2.5-Coder (7B)
- 57.3
Llama 3-8B
- 57.3 Granite-3.1-8B-Instruct
- 56.9
Phi-4-reasoning
- 56.5
Gemma 7B
- 55.9
Phi-4-Reasoning-plus
- 55.6
Starling-LM-7B-alpha
- 55.5
Qwen-14B
- 55.4
LLaMA-65B
- 55.4 Nous-Hermes-2-Mixtral-8x7B-DPO
- 54.9 Yi-9B
- 54.8
Yi-1.5-9B-Chat
- 54.4
Aya Expanse 8B
- 54.1
Qwen1.5-32B
- 54.1
Phi-3-mini-128k-instruct
- 54.0
phi-3-mini 3.8B
- 53.8
Starling-LM-7B-beta
- 53.1
Mistral 7B v0.2
- 52.9
DeepSeek-R1-Distill-Qwen-7B
- 52.6 internlm-20b
- 52.3
Mistral 7B v0.3
- 52.3
Qwen1.5-7B-Chat
- 52.3
Gemma 3 4B
- 52.2
Mistral-7B-Instruct-v0.2
- 52.0
Qwen2.5-7B
- 51.5
Qwen3-14B-Base
- 51.3
Yi 6B
- 51.0
Zephyr 7B Alpha
- 50.5
Llama 3.2 3B
- 50.2
Mistral 7B v0.1
- 50.2
Qwen3-30B-A3B-Base
- 50.1
Yi-6B-Chat
- 49.6
Falcon-40B
- 49.0
MAmmoTH2-7B-Plus
- 48.8
Qwen-7B
- 48.1
Gemma 2 2B IT
- 48.0
Zephyr 7B Beta
- 47.7
Gemma 1.1 7B IT
- 47.3
Gemma 3n E2B
- 46.6
Qwen1.5-4B-Chat
- 46.5
Falcon3-3B-Instruct
- 46.3
Yi-1.5-6B-Chat
- 46.2
Qwen2.5-3B
- 45.6
Qwen1.5-14B
- 45.6
DeepSeek-R1-Distill-Llama-70B
- 45.3
Qwen3-4B-Base
- 43.4
Qwen3-0.6B
- 42.3 LFM2-1.2B
- 41.6
Mistral-7B-Instruct-v0.1
- 38.7
MPT-30B
- 37.7 gpt-oss-20b
- 37.5
Qwen1.5-7B
- 36.0
Qwen3-8B-Base
- 35.6 ChatGLM3-6B
- 34.5
Qwen2-0.5B-Instruct
- 33.5 internlm-7b
- 33.0
Gemma 3 1B
- 32.8
LLaMA-13B
- 31.6
Falcon3-1B-Instruct
- 30.3
MAmmoTH2-8B-Plus
- 29.9 chatglm2-6b
- 29.2
DeepSeek-R1-Distill-Qwen-32B
- 28.4
Gemma 2B
- 27.0
Phi-2
- 26.3 Baichuan2-13B-Chat
- 26.3 Qwen-1_8B
- 25.6
OPT-66B
- 25.6 gpt-oss-120b
- 25.3
SmolLM-360M
- 25.0 RedPajama-INCITE-7B-Base
- 24.9
Gemma 1.1 2B IT
- 24.9
OLMo 2 1B Instruct
- 24.2
Cerebras-GPT-13B
- 24.1 Emu3-Chat
- 23.9
LLaMA-7B
- 23.6 GPT-J-6B
- 23.5
Phi-1.5
- 23.4
Llama 3.2 1B
- 22.8 GPT-NeoX-20B
- 22.8
SmolLM-1.7B
- 22.7
MPT-7B
- 22.5
Qwen2-0.5B
- 22.3
Gemma 3 1B PT
- 22.0
Falcon-7B
- 22.0 open_llama_7b
- 21.7 GPT-Neo-2.7B
- 20.0
Qwen2.5-Coder-32B
- 19.2
OPT-1.3B
- 19.2
SmolLM-135M
- 18.5
Gemma 3 270M
- 13.9
DeepSeek-R1-Distill-Qwen-1.5B
- 13.5 T5-Large
- 13.1 T5-Small
- 10.2 T5-Base
- 6.68
Qwen2.5-0.5B
- 0.14
Qwen2.5-1.5B
- 1
Gemini 2.5 Pro Mar 2025, Three-shot, text-only, reasoning, 2025-04-03 95%
- 2 GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
- 3 Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
- 4
Gemini 2.5 Flash Jun 2025, Three-shot, text-only, 2025-09-01 86.5%
- 5
Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
- 6 GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
- 7 Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
- 8
DeepSeek-V3 Mar 2025, Three-shot, text-only, 2025-04-03 84.1%
- 9
Gemini 2.5 Flash-Lite Jun 2025, Three-shot, text-only, reasoning: low, 2025-09-01 84%
- 10
Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
- 11
Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
- 12 Kimi K2 Jul 2025, Three-shot, text-only, 2025-09-01 82.8%
- 13
DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
- 14
Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
- 15
Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
- 16
Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
- 17
Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
- 18
Gemini 2.0 Flash Feb 2025, Three-shot, text-only, 2025-04-03 80.4%
- 19 GPT-4o Aug 2024, Three-shot, text-only, 2025-04-09 79.7%
- 20
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
- 21 GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
- 22
Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
- 23
Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
- 24
Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
- 25
Qwen3-30B-A3B-Instruct Jul 2025, Three-shot, text-only, bfloat16, 2025-08-30 76.9%
- 26
Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
- 27
QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
- 28
DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
- 29
Gemini 1.5 Flash Sep 2024, Three-shot, text-only, 2025-04-03 76.1%
- 30
Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
- 31
Gemini 1.5 Flash May 2024, Three-shot, text-only, 2024-08-09 75.8%
- 32
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
- 33
Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
- 34
Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
- 35
Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
- 36
Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
- 37
Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
- 38
Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
- 39
Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
- 40
Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
- 41 Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
- 42 qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
- 43
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
- 44
Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
- 45
Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
- 46
Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
- 47
Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
- 48 Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
- 49
Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
- 50
WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
- 51
Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
- 52 c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
- 53
Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
- 54
OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
- 55 GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
- 56 GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
- 57
Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
- 58
Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
- 59
Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
- 60
Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
- 61
Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
- 62
Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
- 63 GPT-3.5 Turbo Jan 2024, Three-shot, text-only, 2024-03-08 62.5%
- 64
phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
- 65
Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
- 66 GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
- 67
Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
- 68
phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
- 69
Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
- 70
Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
- 71
InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
- 72
Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
- 73
Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
- 74
Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
- 75
Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
- 76
Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
- 77 Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
- 78
Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
- 79
Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
- 80
Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
- 81
SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
- 82
Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
- 83
Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
- 84 Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
- 85
Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
- 86
Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
- 87
Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
- 88
Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
- 89
Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
- 90
LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
- 91 Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
- 92 Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
- 93
Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
- 94
Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
- 95
Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
- 96
Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
- 97
phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
- 98
Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
- 99
Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
- 100
DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
- 101 internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
- 102
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
- 103
Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
- 104
Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
- 105
Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
- 106
Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
- 107
Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
- 108
Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
- 109
Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
- 110
Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
- 111
Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
- 112
Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
- 113
Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
- 114
Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
- 115
MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
- 116
Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
- 117
Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
- 118
Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
- 119
Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
- 120
Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
- 121
Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
- 122
Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
- 123
Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
- 124
Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
- 125
Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
- 126
DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
- 127
Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
- 128
Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
- 129 LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
- 130
Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
- 131
MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
- 132 gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
- 133
Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
- 134
Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
- 135 ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
- 136
Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
- 137 internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
- 138
Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
- 139
LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
- 140
Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
- 141
MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
- 142 chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
- 143
DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
- 144
Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
- 145
Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
- 146 Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
- 147 Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
- 148
OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
- 149 gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
- 150
SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
- 151 RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
- 152
Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
- 153
OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
- 154
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
- 155 Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
- 156
LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
- 157 GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
- 158
Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
- 159
Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
- 160 GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
- 161
SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
- 162
MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
- 163
Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
- 164
Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
- 165
Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
- 166 open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
- 167 GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
- 168
Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
- 169
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
- 170
SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
- 171
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
- 172
DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
- 173 T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
- 174 T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
- 175 T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
- 176
Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
- 177
Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%
Source: Open Portuguese LLM Leaderboard’s leaderboard
| # | Entry | Score | Setting | Released | Run on | Link | Source |
|---|---|---|---|---|---|---|---|
| 1 | | 95% | Three-shot, text-only, reasoning, 2025-04-03 | Mar 2025 | Apr 2025 | aistudio.google.com | Official leaderboard |
| 2 | GPT-5 mini | 91.4% | Three-shot, text-only, reasoning, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 3 | Grok-3 mini | 89.8% | Three-shot, text-only, reasoning, 2025-09-01 | Apr 2025 | Sep 2025 | x.ai | Official leaderboard |
| 4 | | 86.5% | Three-shot, text-only, 2025-09-01 | Jun 2025 | Sep 2025 | aistudio.google.com | Official leaderboard |
| 5 | | 85.8% | Three-shot, text-only, 4bit, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 6 | GPT-5 nano | 85.3% | Three-shot, text-only, reasoning, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 7 | Claude 3.7 Sonnet | 84.6% | Three-shot, text-only, 2025-04-04 | Feb 2025 | Apr 2025 | anthropic.com | Official leaderboard |
| 8 | | 84.1% | Three-shot, text-only, 2025-04-03 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 9 | | 84% | Three-shot, text-only, reasoning: low, 2025-09-01 | Jun 2025 | Sep 2025 | aistudio.google.com | Official leaderboard |
| 10 | | 83.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 11 | | 83% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 12 | Kimi K2 Jul 2025 | 82.8% | Three-shot, text-only, 2025-09-01 | Jul 2025 | Sep 2025 | huggingface.co | Official leaderboard |
| 13 | | 81.8% | Three-shot, text-only, 2025-09-01 | Aug 2025 | Sep 2025 | huggingface.co | Official leaderboard |
| 14 | Sabiá-3.1 (2025-05-08) | 81.8% | Three-shot, text-only, 2025-09-01 | Sep 2025 | maritaca.ai | Official leaderboard | |
| 15 | | 81.2% | Three-shot, text-only, 2025-04-05 | Apr 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 16 | | 80.7% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 17 | | 80.5% | Three-shot, text-only, 2025-04-03 | Jan 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 18 | | 80.5% | Three-shot, text-only, 2025-04-03 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 19 | | 80.4% | Three-shot, text-only, 2025-04-03 | Feb 2025 | Apr 2025 | cloud.google.com | Official leaderboard |
| 20 | meta-llama/Llama-3.1-405B-Instruct (Vertex AI) 406B | 80.1% | Three-shot, text-only, 2024-08-20 | Aug 2024 | huggingface.co | Official leaderboard | |
| 21 | GPT-4o Aug 2024 | 79.7% | Three-shot, text-only, 2025-04-09 | Aug 2024 | Apr 2025 | openai.com | Official leaderboard |
| 22 | Sabiá-3 (2024-07-15) | 79% | Three-shot, text-only, 2024-08-20 | Aug 2024 | maritaca.ai | Official leaderboard | |
| 23 | | 79% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | Sep 2024 | huggingface.co | Official leaderboard |
| 24 | GPT-5 | 78.9% | Three-shot, text-only, reasoning: minimal, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 25 | | 78.7% | Three-shot, text-only, 2025-04-03 | Feb 2025 | Apr 2025 | cloud.google.com | Official leaderboard |
| 26 | Sabiá-3 (2024-12-11) | 78.7% | Three-shot, text-only, 2025-09-01 | Sep 2025 | maritaca.ai | Official leaderboard | |
| 27 | huihui-ai/Qwen2.5-32B-Instruct-abliterated 32.8B | 78.6% | Three-shot, text-only, bfloat16, 2024-10-04 | Oct 2024 | huggingface.co | Official leaderboard | |
| 28 | rombodawg/Rombos-LLM-V2.5-Qwen-32b 32.8B | 78.6% | Three-shot, text-only, bfloat16, 2024-10-10 | Oct 2024 | huggingface.co | Official leaderboard | |
| 29 | Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B 32.8B | 78.6% | Three-shot, text-only, bfloat16, 2025-01-21 | Jan 2025 | huggingface.co | Official leaderboard | |
| 30 | Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B 32.8B | 78.6% | Three-shot, text-only, bfloat16, 2025-01-21 | Jan 2025 | huggingface.co | Official leaderboard | |
| 31 | maldv/Qwentile2.5-32B-Instruct 32.8B | 78.4% | Three-shot, text-only, bfloat16, 2024-12-21 | Dec 2024 | huggingface.co | Official leaderboard | |
| 32 | Qwen/Qwen2.5-32B-Instruct 32.8B | 78.3% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 33 | AXCXEPT/EZO-Qwen2.5-32B-Instruct 32.8B | 78.3% | Three-shot, text-only, bfloat16, 2024-10-04 | Oct 2024 | huggingface.co | Official leaderboard | |
| 34 | Sakalti/Oxyge1-33B 32.8B | 78.3% | Three-shot, text-only, bfloat16, 2024-12-21 | Dec 2024 | huggingface.co | Official leaderboard | |
| 35 | | 78.3% | Three-shot, text-only, bfloat16, 2025-07-08 | May 2025 | Jul 2025 | huggingface.co | Official leaderboard |
| 36 | fblgit/TheBeagle-v2beta-32B-MGS 32.8B | 78% | Three-shot, text-only, bfloat16, 2024-12-12 | Dec 2024 | huggingface.co | Official leaderboard | |
| 37 | | 78% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 38 | tiiuae/Falcon-H1-34B-Base 33.6B | 77.8% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 39 | huihui-ai/QwQ-32B-Coder-Fusion-9010 32.8B | 77.6% | Three-shot, text-only, bfloat16, 2024-12-12 | Dec 2024 | huggingface.co | Official leaderboard | |
| 40 | Gemini 1.5 Pro Preview (0409) | 77.2% | Three-shot, text-only, 2024-04-15 | Apr 2024 | cloud.google.com | Official leaderboard | |
| 41 | | 76.9% | Three-shot, text-only, bfloat16, 2025-08-30 | Jul 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 42 | | 76.8% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | Sep 2024 | huggingface.co | Official leaderboard |
| 43 | | 76.6% | Three-shot, text-only, bfloat16, 2024-12-03 | Nov 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 44 | huihui-ai/QwQ-32B-Preview-abliterated 32.8B | 76.5% | Three-shot, text-only, bfloat16, 2024-12-12 | Dec 2024 | huggingface.co | Official leaderboard | |
| 45 | | 76.5% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 46 | OpenBuddy/openbuddy-qwq-32b-v24.1-200k 32.8B | 76.5% | Three-shot, text-only, bfloat16, 2025-01-22 | Jan 2025 | huggingface.co | Official leaderboard | |
| 47 | | 76.1% | Three-shot, text-only, 2025-04-03 | Aug 2024 | Apr 2025 | cloud.google.com | Official leaderboard |
| 48 | | 75.9% | Three-shot, text-only, 2025-04-03 | Dec 2024 | Apr 2025 | huggingface.co | Official leaderboard |
| 49 | | 75.8% | Three-shot, text-only, 2024-08-09 | May 2024 | Aug 2024 | cloud.google.com | Official leaderboard |
| 50 | | 75.4% | Three-shot, text-only, bfloat16, 2024-06-08 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 51 | google/medgemma-27b-text-it 27B | 75.4% | Three-shot, text-only, bfloat16, 2025-07-15 | Jul 2025 | huggingface.co | Official leaderboard | |
| 52 | meta-llama/Meta-Llama-3.1-70B-Instruct 70.6B | 75.1% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 53 | amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct 72.7B | 75.1% | Three-shot, text-only, float16, 2025-06-16 | Jun 2025 | huggingface.co | Official leaderboard | |
| 54 | Gemini 1.5 Flash Preview (0514) | 74.8% | Three-shot, text-only, 2024-05-18 | May 2024 | cloud.google.com | Official leaderboard | |
| 55 | nisten/franqwenstein-35b 34.7B | 74.8% | Three-shot, text-only, bfloat16, 2024-10-10 | Oct 2024 | huggingface.co | Official leaderboard | |
| 56 | meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI) 88.6B | 74.8% | Three-shot, text-only, 2025-04-03 | Apr 2025 | huggingface.co | Official leaderboard | |
| 57 | arcee-ai/Virtuoso-Small 14.8B | 74.5% | Three-shot, text-only, bfloat16, 2024-12-21 | Dec 2024 | huggingface.co | Official leaderboard | |
| 58 | prithivMLmods/Megatron-Opus-14B-Exp 14.8B | 74.1% | Three-shot, text-only, bfloat16, 2025-02-03 | Feb 2025 | huggingface.co | Official leaderboard | |
| 59 | sometimesanotion/Qwen2.5-14B-Vimarckoso-v3 14.8B | 74% | Three-shot, text-only, bfloat16, 2025-01-21 | Jan 2025 | huggingface.co | Official leaderboard | |
| 60 | mistralai/Mistral-Small-24B-Base-2501 23.6B | 74% | Three-shot, text-only, bfloat16, 2025-01-31 | Jan 2025 | huggingface.co | Official leaderboard | |
| 61 | google/gemma-3-27b-it (GoogleAI API) 27.4B | 73.8% | Three-shot, text-only, 2025-04-08 | Apr 2025 | huggingface.co | Official leaderboard | |
| 62 | Replete-AI/Replete-LLM-V2.5-Qwen-14b 14.8B | 73.7% | Three-shot, text-only, bfloat16, 2024-10-01 | Oct 2024 | huggingface.co | Official leaderboard | |
| 63 | rombodawg/Rombos-LLM-V2.6-Qwen-14b 14.8B | 73.6% | Three-shot, text-only, bfloat16, 2024-10-14 | Oct 2024 | huggingface.co | Official leaderboard | |
| 64 | hotmailuser/QwenSlerp2-14B 14.8B | 73.6% | Three-shot, text-only, bfloat16, 2025-01-21 | Jan 2025 | huggingface.co | Official leaderboard | |
| 65 | sometimesanotion/Lamarck-14B-v0.6 14.8B | 73.6% | Three-shot, text-only, bfloat16, 2025-01-21 | Jan 2025 | huggingface.co | Official leaderboard | |
| 66 | sometimesanotion/Lamarck-14B-v0.7 14.8B | 73.6% | Three-shot, text-only, bfloat16, 2025-02-02 | Feb 2025 | huggingface.co | Official leaderboard | |
| 67 | meta-llama/Meta-Llama-3-70B-Instruct 70.6B | 73.4% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 68 | v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno 14.8B | 73.4% | Three-shot, text-only, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 69 | allknowingroger/Qwen2.5-slerp-14B 14.8B | 73.4% | Three-shot, text-only, bfloat16, 2024-11-01 | Nov 2024 | huggingface.co | Official leaderboard | |
| 70 | mistralai/Mistral-Small-24B-Instruct-2501 23.6B | 73.4% | Three-shot, text-only, bfloat16, 2025-01-31 | Jan 2025 | huggingface.co | Official leaderboard | |
| 71 | Sabiázinho-3 (2025-02-06) | 73.4% | Three-shot, text-only, 2025-09-01 | Sep 2025 | maritaca.ai | Official leaderboard | |
| 72 | Qwen/Qwen2.5-14B-Instruct 14.8B | 73.3% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 73 | Lambent/qwen2.5-reinstruct-alternate-lumen-14B 14.8B | 73.3% | Three-shot, text-only, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 74 | v000000/Qwen2.5-14B-Gutenberg-1e-Delta 14.8B | 73.3% | Three-shot, text-only, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 75 | CultriX/Qwen2.5-14B-Wernicke 14.8B | 73.3% | Three-shot, text-only, bfloat16, 2024-11-17 | Nov 2024 | huggingface.co | Official leaderboard | |
| 76 | allknowingroger/QwenSlerp6-14B 14.8B | 73.3% | Three-shot, text-only, bfloat16, 2024-12-21 | Dec 2024 | huggingface.co | Official leaderboard | |
| 77 | tanliboy/lambda-qwen2.5-14b-dpo-test 14.8B | 73.2% | Three-shot, text-only, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 78 | Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 14.8B | 73.2% | Three-shot, text-only, bfloat16, 2024-11-01 | Nov 2024 | huggingface.co | Official leaderboard | |
| 79 | CultriX/SeQwence-14Bv1 14.8B | 72.5% | Three-shot, text-only, bfloat16, 2024-12-21 | Dec 2024 | huggingface.co | Official leaderboard | |
| 80 | janhq/Jan-v1-4B 4B | 72.3% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 81 | meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API) 109B | 72.2% | Three-shot, text-only, 2025-04-05 | Apr 2025 | huggingface.co | Official leaderboard | |
| 82 | arcee-ai/SuperNova-Medius 14.8B | 72% | Three-shot, text-only, bfloat16, 2024-10-20 | Oct 2024 | huggingface.co | Official leaderboard | |
| 83 | CultriX/Qwen2.5-14B-Wernicke-SFT 14.8B | 72% | Three-shot, text-only, bfloat16, 2024-11-17 | Nov 2024 | huggingface.co | Official leaderboard | |
| 84 | | 72% | Three-shot, text-only, bfloat16, 2025-01-31 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 85 | Sabiá-2 Medium | 71.8% | Three-shot, text-only, 2024-04-13 | Apr 2024 | maritaca.ai | Official leaderboard | |
| 86 | Qwen/Qwen1.5-110B-Chat 111.2B | 71.8% | Three-shot, text-only, 4bit, 2024-05-23 | May 2024 | huggingface.co | Official leaderboard | |
| 87 | AALF/gemma-2-27b-it-SimPO-37K-100steps 27.2B | 71.6% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 88 | | 71.2% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 89 | byroneverson/gemma-2-27b-it-abliterated 27.2B | 71.1% | Three-shot, text-only, bfloat16, 2024-09-05 | Sep 2024 | huggingface.co | Official leaderboard | |
| 90 | | 71.1% | Three-shot, text-only, 4bit, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 91 | Qwen-Turbo (2024-11-01) | 70.8% | Three-shot, text-only, 2025-04-03 | Apr 2025 | alibabacloud.com | Official leaderboard | |
| 92 | google/gemma-2-27b-it 27.2B | 70.5% | Three-shot, text-only, bfloat16, 2024-07-02 | Jul 2024 | huggingface.co | Official leaderboard | |
| 93 | | 70.4% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 94 | THUDM/GLM-Z1-9B-0414 9.4B | 70.4% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 95 | | 70.2% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 96 | botbot-ai/CabraLlama3-70b 70.6B | 70.1% | Three-shot, text-only, bfloat16, 2024-06-21 | Jun 2024 | huggingface.co | Official leaderboard | |
| 97 | tiiuae/Falcon-H1-7B-Instruct 7.6B | 70.1% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 98 | abacusai/Smaug-Llama-3-70B-Instruct 70.6B | 69.5% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 99 | DeepSeek-V2 Chat (API) | 69.5% | Three-shot, text-only, 2024-05-18 | May 2024 | deepseek.com | Official leaderboard | |
| 100 | google/medgemma-27b-it 27.4B | 69.3% | Three-shot, text-only, bfloat16, 2025-07-15 | Jul 2025 | huggingface.co | Official leaderboard | |
| 101 | unsloth/llama-3-70b-Instruct-bnb-4bit 70.6B | 68.8% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 102 | tiiuae/Falcon-H1-7B-Base 7.6B | 68.7% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 103 | Qwen/Qwen-72B 72.3B | 68.4% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 104 | GPT 4o Mini (2024-07-18) | 68.4% | Three-shot, text-only, 2024-07-25 | Jul 2024 | openai.com | Official leaderboard | |
| 105 | abacusai/Smaug-72B-v0.1 72.3B | 68.3% | Three-shot, text-only, bfloat16, 2024-02-28 | Feb 2024 | huggingface.co | Official leaderboard | |
| 106 | unsloth/Llama-3.3-70B-Instruct-bnb-4bit 70.6B | 68.2% | Three-shot, text-only, 4bit, 2024-12-10 | Dec 2024 | huggingface.co | Official leaderboard | |
| 107 | | 68.2% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 108 | Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp 34.4B | 68% | Three-shot, text-only, bfloat16, 2024-06-16 | Jun 2024 | huggingface.co | Official leaderboard | |
| 109 | | 68% | Three-shot, text-only, bfloat16, 2024-07-02 | Jun 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 110 | huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated 32.8B | 68% | Three-shot, text-only, bfloat16, 2024-12-12 | Dec 2024 | huggingface.co | Official leaderboard | |
| 111 | | 67.9% | Three-shot, text-only, 4bit, 2024-05-23 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 112 | 01-ai/Yi-1.5-34B-32K 34.4B | 67.9% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 113 | cognitivecomputations/dolphin-2.9.1-llama-3-70b 70.6B | 67.9% | Three-shot, text-only, bfloat16, 2024-05-24 | May 2024 | huggingface.co | Official leaderboard | |
| 114 | Qwen2.5-Coder-14B | 67.9% | Three-shot, text-only, bfloat16, 2024-11-12 | Sep 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 115 | qwen3-4b-instruct-2507 | 67.7% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 116 | | 67.6% | Three-shot, text-only, bfloat16, 2024-02-18 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 117 | Weyaxi/Bagel-Hermes-34B-Slerp 34.4B | 67.6% | Three-shot, text-only, rev: 459676b, bfloat16, 2024-05-26 | May 2024 | huggingface.co | Official leaderboard | |
| 118 | botbot-ai/Cabra-72b 72.3B | 67.5% | Three-shot, text-only, bfloat16, 2024-04-06 | Apr 2024 | huggingface.co | Official leaderboard | |
| 119 | unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit 70.6B | 67.3% | Three-shot, text-only, 4bit, 2024-08-13 | Aug 2024 | huggingface.co | Official leaderboard | |
| 120 | | 67.3% | Three-shot, text-only, bfloat16, 2024-11-12 | Nov 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 121 | mistral-community/Mixtral-8x22B-v0.1-4bit 140.6B | 67.2% | Three-shot, text-only, 4bit, 2024-04-12 | Apr 2024 | huggingface.co | Official leaderboard | |
| 122 | Azure99/blossom-v5.1-34b 34.4B | 67.2% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 123 | VAGOsolutions/SauerkrautLM-Qwen-32b 32.5B | 67.2% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 124 | jondurbin/bagel-dpo-34b-v0.2 34.4B | 66.9% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 125 | altomek/YiSM-34B-0rn 34.4B | 66.9% | Three-shot, text-only, float16, 2024-06-06 | Jun 2024 | huggingface.co | Official leaderboard | |
| 126 | jondurbin/bagel-dpo-34b-v0.5 34.4B | 66.8% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 127 | upstage/solar-pro-preview-instruct 22.1B | 66.8% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 128 | Claude-3 Haiku (20240307) | 66.6% | Three-shot, text-only, 2024-04-13 | Apr 2024 | claude.ai | Official leaderboard | |
| 129 | | 66.6% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 130 | mistralai/Mixtral-8x22B-Instruct-v0.1 140.6B | 66.6% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 131 | Orion-zhen/Qwen2.5-7B-Instruct-Uncensored 7.6B | 66.6% | Three-shot, text-only, bfloat16, 2024-10-19 | Oct 2024 | huggingface.co | Official leaderboard | |
| 132 | | 66.6% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 133 | | 66.5% | Three-shot, text-only, bfloat16, 2024-02-05 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 134 | SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit 140.6B | 66.5% | Three-shot, text-only, 4bit, 2024-04-17 | Apr 2024 | huggingface.co | Official leaderboard | |
| 135 | 01-ai/Yi-1.5-34B-Chat 34.4B | 66.5% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 136 | Cran-May/T.E-8.1 7.6B | 66.5% | Three-shot, text-only, bfloat16, 2024-09-30 | Sep 2024 | huggingface.co | Official leaderboard | |
| 137 | Qwen2.5-Coder-14B-Instruct | 66.5% | Three-shot, text-only, bfloat16, 2024-11-12 | Nov 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 138 | Qwen/Qwen2.5-7B-Instruct-1M 7.6B | 66.5% | Three-shot, text-only, float16, 2025-09-01 | Sep 2025 | huggingface.co | Official leaderboard | |
| 139 | adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1 32.5B | 66.3% | Three-shot, text-only, bfloat16, 2024-04-30 | Apr 2024 | huggingface.co | Official leaderboard | |
| 140 | CohereForAI/c4ai-command-r-plus-4bit 103.8B | 66.2% | Three-shot, text-only, 4bit, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 141 | mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 140.6B | 66.2% | Three-shot, text-only, 4bit, 2024-04-20 | Apr 2024 | huggingface.co | Official leaderboard | |
| 142 | CombinHorizon/YiSM-blossom5.1-34B-SLERP 34.4B | 66.2% | Three-shot, text-only, bfloat16, 2024-08-27 | Aug 2024 | huggingface.co | Official leaderboard | |
| 143 | VAGOsolutions/SauerkrautLM-Phi-3-medium 14B | 66.2% | Three-shot, text-only, bfloat16, 2024-09-19 | Sep 2024 | huggingface.co | Official leaderboard | |
| 144 | CausalLM/34b-beta 34.4B | 66.1% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 145 | | 65.9% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 146 | NousResearch/Nous-Hermes-2-Yi-34B 34.4B | 65.8% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 147 | abacusai/Smaug-34B-v0.1 34.4B | 65.8% | Three-shot, text-only, bfloat16, 2024-02-28 | Feb 2024 | huggingface.co | Official leaderboard | |
| 148 | | 65.8% | Three-shot, text-only, bfloat16, 2024-05-22 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 149 | ConvexAI/Luminex-34B-v0.2 34.4B | 65.8% | Three-shot, text-only, float16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 150 | | 65.8% | Three-shot, text-only, 2024-06-30 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 151 | wenbopan/Faro-Yi-34B-DPO 34.4B | 65.8% | Three-shot, text-only, bfloat16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 152 | Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO 14B | 65.8% | Three-shot, text-only, float16, 2024-07-31 | Jul 2024 | huggingface.co | Official leaderboard | |
| 153 | Qwen/Qwen1.5-32B-Chat 32.5B | 65.7% | Three-shot, text-only, bfloat16, 2024-04-08 | Apr 2024 | huggingface.co | Official leaderboard | |
| 154 | recoilme/recoilme-gemma-2-9B-v0.4 10.2B | 65.7% | Three-shot, text-only, rev: 2691f2c, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 155 | anthracite-org/magnum-v3-9b-customgemma2 9.2B | 65.5% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 156 | fblgit/UNA-SimpleSmaug-34b-v1beta 34.4B | 65.4% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 157 | princeton-nlp/gemma-2-9b-it-SimPO 9.2B | 65.4% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 158 | c4ai-command-r-08-2024 | 65.4% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2024 | Aug 2025 | huggingface.co | Official leaderboard |
| 159 | | 65.4% | Three-shot, text-only, float16, 2024-10-27 | Oct 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 160 | | 65.4% | Three-shot, text-only, bfloat16, 2025-05-01 | Mar 2025 | May 2025 | huggingface.co | Official leaderboard |
| 161 | baidu/ERNIE-4.5-21B-A3B-PT 22B | 65.4% | Three-shot, text-only, bfloat16, 2025-08-31 | Aug 2025 | huggingface.co | Official leaderboard | |
| 162 | Qwen/Qwen2-57B-A14B 57.4B | 65.2% | Three-shot, text-only, bfloat16, 2024-06-08 | Jun 2024 | huggingface.co | Official leaderboard | |
| 163 | Qwen/Qwen2-57B-A14B-Instruct 57.4B | 65.2% | Three-shot, text-only, float16, 2024-06-08 | Jun 2024 | huggingface.co | Official leaderboard | |
| 164 | anthracite-org/magnum-v3-9b-chatml 9.2B | 65.2% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 165 | GLM-4-9B-Chat | 65% | Three-shot, text-only, float16, 2024-06-09 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 166 | 01-ai/Yi-34B-200K 34.4B | 64.8% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 167 | 152334H/miqu-1-70b-sf 69B | 64.8% | Three-shot, text-only, float16, 2024-04-26 | Apr 2024 | huggingface.co | Official leaderboard | |
| 168 | migtissera/Tess-M-v1.3 34.4B | 64.8% | Three-shot, text-only, float16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 169 | ConvexAI/Luminex-34B-v0.1 34.4B | 64.8% | Three-shot, text-only, float16, 2024-06-08 | Jun 2024 | huggingface.co | Official leaderboard | |
| 170 | wenbopan/Faro-Yi-34B 34.4B | 64.8% | Three-shot, text-only, bfloat16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 171 | BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference 9.2B | 64.8% | Three-shot, text-only, bfloat16, 2024-09-02 | Sep 2024 | huggingface.co | Official leaderboard | |
| 172 | anthracite-org/magnum-v3-27b-kto 27.2B | 64.7% | Three-shot, text-only, bfloat16, 2024-09-15 | Sep 2024 | huggingface.co | Official leaderboard | |
| 173 | huihui-ai/Qwen2.5-7B-Instruct-abliterated 7.6B | 64.7% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 174 | Gemini 1.5 Flash 8B (001) | 64.7% | Three-shot, text-only, 2025-04-03 | Apr 2025 | aistudio.google.com | Official leaderboard | |
| 175 | GLM-4-9B | 64.5% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 176 | Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated 7.6B | 64.5% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 177 | Qwen/Qwen2.5-7B-Instruct 7.6B | 64.5% | Three-shot, text-only, rev: bb46c15, bfloat16, 2024-10-15 | Oct 2024 | huggingface.co | Official leaderboard | |
| 178 | tiiuae/Falcon3-10B-Base 10.3B | 64.5% | Three-shot, text-only, bfloat16, 2025-01-15 | Jan 2025 | huggingface.co | Official leaderboard | |
| 179 | | 64.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 180 | recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp 10.2B | 64.3% | Three-shot, text-only, bfloat16, 2024-09-16 | Sep 2024 | huggingface.co | Official leaderboard | |
| 181 | TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule 7.6B | 64.3% | Three-shot, text-only, bfloat16, 2025-03-07 | Mar 2025 | huggingface.co | Official leaderboard | |
| 182 | | 64.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 183 | botbot-ai/CabraMixtral-8x7b 46.7B | 64.1% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 184 | | 64% | Three-shot, text-only, bfloat16, 2024-07-02 | Jun 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 185 | recoilme/recoilme-gemma-2-9B-v0.2 10.2B | 64% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 186 | arcee-ai/Virtuoso-Lite 10.3B | 64% | Three-shot, text-only, bfloat16, 2025-02-05 | Feb 2025 | huggingface.co | Official leaderboard | |
| 187 | Replete-AI/Replete-LLM-V2.5-Qwen-7b 7.6B | 63.7% | Three-shot, text-only, bfloat16, 2024-10-01 | Oct 2024 | huggingface.co | Official leaderboard | |
| 188 | sethuiyer/Qwen2.5-7B-Anvita 7.6B | 63.7% | Three-shot, text-only, bfloat16, 2024-11-01 | Nov 2024 | huggingface.co | Official leaderboard | |
| 189 | cognitivecomputations/dolphin-2.9.1-yi-1.5-34b 34.4B | 63.6% | Three-shot, text-only, bfloat16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 190 | google/gemma-2-9b-it 9.2B | 63.6% | Three-shot, text-only, bfloat16, 2024-07-02 | Jul 2024 | huggingface.co | Official leaderboard | |
| 191 | TheDrummer/Gemmasutra-9B-v1 10.2B | 63.6% | Three-shot, text-only, bfloat16, 2024-09-19 | Sep 2024 | huggingface.co | Official leaderboard | |
| 192 | huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2 7.6B | 63.6% | Three-shot, text-only, bfloat16, 2024-10-01 | Oct 2024 | huggingface.co | Official leaderboard | |
| 193 | | 63.4% | Three-shot, text-only, 4bit, 2024-12-05 | Aug 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 194 | OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k 14.8B | 63.4% | Three-shot, text-only, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 195 | 01-ai/Yi-34B-Chat 34.4B | 63.3% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 196 | lucianosb/boto-9B 9.2B | 63.3% | Three-shot, text-only, bfloat16, 2024-07-10 | Jul 2024 | huggingface.co | Official leaderboard | |
| 197 | rhymes-ai/Aria-Base-64K 25.3B | 63.3% | Three-shot, text-only, bfloat16, 2024-12-05 | Dec 2024 | huggingface.co | Official leaderboard | |
| 198 | THUDM/GLM-4-9B-0414 9.4B | 63.1% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 199 | | 63% | Three-shot, text-only, bfloat16, 2024-03-05 | Nov 2023 | Mar 2024 | huggingface.co | Official leaderboard |
| 200 | NousResearch/Nous-Capybara-34B 34.4B | 63% | Three-shot, text-only, bfloat16, 2024-04-26 | Apr 2024 | huggingface.co | Official leaderboard | |
| 201 | UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2 9.2B | 63% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 202 | UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 9.2B | 63% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 203 | | 62.9% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 204 | speakleash/Bielik-11B-v2.2-Instruct 11.2B | 62.7% | Three-shot, text-only, bfloat16, 2024-10-17 | Oct 2024 | huggingface.co | Official leaderboard | |
| 205 | speakleash/Bielik-11B-v2.1-Instruct 11.2B | 62.6% | Three-shot, text-only, bfloat16, 2024-10-17 | Oct 2024 | huggingface.co | Official leaderboard | |
| 206 | GPT-3.5 Turbo Jan 2024 | 62.5% | Three-shot, text-only, 2024-03-08 | Jan 2024 | Mar 2024 | openai.com | Official leaderboard |
| 207 | | 62.5% | Three-shot, text-only, bfloat16, 2024-05-21 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 208 | microsoft/Phi-3-small-128k-instruct 7.4B | 62.5% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | huggingface.co | Official leaderboard | |
| 209 | cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b 12.3B | 62.5% | Three-shot, text-only, bfloat16, 2024-07-25 | Jul 2024 | huggingface.co | Official leaderboard | |
| 210 | PrunaAI/dbrx-base-bnb-4bit 131.6B | 62.3% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 211 | Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2 7.6B | 62.3% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 212 | recoilme/recoilme-gemma-2-9B-v0.3 10.2B | 62.3% | Three-shot, text-only, rev: 772cab4, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 213 | speakleash/Bielik-11B-v2.3-Instruct 11.2B | 62.3% | Three-shot, text-only, float16, 2024-10-17 | Oct 2024 | huggingface.co | Official leaderboard | |
| 214 | chujiezheng/Smaug-34B-v0.1-ExPO 34.4B | 62.2% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 215 | jpacifico/Chocolatine-14B-Instruct-4k-DPO 14B | 62.2% | Three-shot, text-only, float16, 2024-08-27 | Aug 2024 | huggingface.co | Official leaderboard | |
| 216 | MarinaraSpaghetti/NemoReRemix-12B 12.3B | 62.2% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 217 | | 62% | Three-shot, text-only, float16, 2024-04-05 | Mar 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 218 | PrunaAI/dbrx-instruct-bnb-4bit 131.6B | 62% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 219 | OrionStarAI/OrionStar-Yi-34B-Chat 34.4B | 62% | Three-shot, text-only, float16, 2024-06-09 | Jun 2024 | huggingface.co | Official leaderboard | |
| 220 | Weyaxi/Einstein-v7-Qwen2-7B 7.6B | 62% | Three-shot, text-only, bfloat16, 2024-07-16 | Jul 2024 | huggingface.co | Official leaderboard | |
| 221 | GLM-4-9B-Chat-1M | 61.9% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 222 | tiiuae/Falcon-H1-3B-Instruct 3.2B | 61.9% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 223 | | 61.8% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 224 | NLPark/AnFeng_v3.1-Avocet 34.4B | 61.8% | Three-shot, text-only, float16, 2024-08-04 | Aug 2024 | huggingface.co | Official leaderboard | |
| 225 | MaziyarPanahi/calme-2.4-qwen2-7b 7.6B | 61.8% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 226 | allknowingroger/Ph3della5-14B 14B | 61.8% | Three-shot, text-only, float16, 2024-10-10 | Oct 2024 | huggingface.co | Official leaderboard | |
| 227 | macadeliccc/Samantha-Qwen-2-7B 7.6B | 61.6% | Three-shot, text-only, rev: 5905897, float16, 2024-07-17 | Jul 2024 | huggingface.co | Official leaderboard | |
| 228 | | 61.5% | Three-shot, text-only, bfloat16, 2024-05-21 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 229 | | 61.5% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 230 | mistralai/Mistral-Nemo-Instruct-2407 12.3B | 61.5% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 231 | speakleash/Bielik-11B-v2.0-Instruct 11.2B | 61.5% | Three-shot, text-only, bfloat16, 2024-10-17 | Oct 2024 | huggingface.co | Official leaderboard | |
| 232 | | 61.3% | Three-shot, text-only, float16, 2024-02-05 | Jul 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 233 | OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k 32.5B | 61.3% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 234 | | 61.3% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | Aug 2024 | huggingface.co | Official leaderboard |
| 235 | | 61.3% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 236 | informatiker/Qwen2-7B-Instruct-abliterated 7.6B | 61.2% | Three-shot, text-only, bfloat16, 2024-09-15 | Sep 2024 | huggingface.co | Official leaderboard | |
| 237 | MaziyarPanahi/calme-2.2-qwen2-7b 7.6B | 61.2% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 238 | natong19/Mistral-Nemo-Instruct-2407-abliterated 12.3B | 61.2% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 239 | | 61.1% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 240 | | 61.1% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 241 | migtissera/Tess-v2.5-Phi-3-medium-128k-14B 14B | 60.9% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 242 | arcee-ai/Arcee-Spark 7.6B | 60.9% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 243 | | 60.8% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 244 | nicolasdec/CabraQwen14b 14.2B | 60.8% | Three-shot, text-only, bfloat16, 2024-04-02 | Apr 2024 | huggingface.co | Official leaderboard | |
| 245 | cognitivecomputations/dolphin-2.9.2-Phi-3-Medium 14B | 60.8% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 246 | lucianosb/boto-9B-it 9.2B | 60.8% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 247 | axolotl-ai-co/romulus-mistral-nemo-12b-simpo 12.3B | 60.8% | Three-shot, text-only, rev: 19e2c43, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 248 | v000000/L3.1-Niitorm-8B-DPO-t0.0001 8B | 60.8% | Three-shot, text-only, float16, 2024-09-30 | Sep 2024 | huggingface.co | Official leaderboard | |
| 249 | | 60.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 250 | BAAI/Infinity-Instruct-3M-0625-Qwen2-7B 7.6B | 60.6% | Three-shot, text-only, bfloat16, 2024-07-16 | Jul 2024 | huggingface.co | Official leaderboard | |
| 251 | Aria | 60.6% | Three-shot, text-only, bfloat16, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 252 | byroneverson/Mistral-Small-Instruct-2409-abliterated 22.3B | 60.6% | Three-shot, text-only, bfloat16, 2024-10-13 | Oct 2024 | huggingface.co | Official leaderboard | |
| 253 | jaspionjader/f-9-8b 8B | 60.5% | Three-shot, text-only, bfloat16, 2025-01-02 | Jan 2025 | huggingface.co | Official leaderboard | |
| 254 | natong19/Qwen2-7B-Instruct-abliterated 7.6B | 60.4% | Three-shot, text-only, bfloat16, 2024-06-19 | Jun 2024 | huggingface.co | Official leaderboard | |
| 255 | meta-llama/Llama-3.2-11B-Vision 10.6B | 60.4% | Three-shot, text-only, bfloat16, 2024-12-05 | Dec 2024 | huggingface.co | Official leaderboard | |
| 256 | argilla/notux-8x7b-v1 46.7B | 60.2% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 257 | CohereForAI/aya-23-35B 35B | 60.2% | Three-shot, text-only, float16, 2024-05-23 | May 2024 | huggingface.co | Official leaderboard | |
| 258 | mlabonne/NeuralDaredevil-8B-abliterated 8B | 60.2% | Three-shot, text-only, float16, 2024-05-28 | May 2024 | huggingface.co | Official leaderboard | |
| 259 | SeaLLMs/SeaLLMs-v3-7B-Chat 7.6B | 60.2% | Three-shot, text-only, bfloat16, 2024-07-28 | Jul 2024 | huggingface.co | Official leaderboard | |
| 260 | grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter 8B | 60.2% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 261 | Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base 8B | 60.2% | Three-shot, text-only, bfloat16, 2024-10-04 | Oct 2024 | huggingface.co | Official leaderboard | |
| 262 | Sao10K/L3.1-8B-Niitama-v1.1 8B | 60.2% | Three-shot, text-only, float16, 2024-11-08 | Nov 2024 | huggingface.co | Official leaderboard | |
| 263 | vicgalle/CarbonBeagle-11B-truthy 10.7B | 60.1% | Three-shot, text-only, float16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 264 | mlabonne/Daredevil-8B-abliterated 8B | 60.1% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 265 | lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25 8B | 60.1% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | huggingface.co | Official leaderboard | |
| 266 | nbeerbower/mistral-nemo-wissenschaft-12B 12.3B | 60.1% | Three-shot, text-only, bfloat16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 267 | arcee-ai/Llama-3.1-SuperNova-Lite 8B | 60.1% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 268 | tiiuae/Falcon3-7B-Base 7.5B | 60.1% | Three-shot, text-only, bfloat16, 2025-01-15 | Jan 2025 | huggingface.co | Official leaderboard | |
| 269 | | 59.9% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 270 | mistralai/Mixtral-8x7B-Instruct-v0.1 46.7B | 59.8% | Three-shot, text-only, bfloat16, 2024-02-18 | Feb 2024 | huggingface.co | Official leaderboard | |
| 271 | WizardLMTeam/WizardLM-70B-V1.0 70B | 59.8% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 272 | cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated 14B | 59.8% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 273 | JJhooww/Qwen2-7B_reload_v1 7.6B | 59.8% | Three-shot, text-only, float16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 274 | THUDM/LongWriter-glm4-9b 9.4B | 59.8% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 275 | meta-llama/Llama-3.1-8B-Instruct 8B | 59.8% | Three-shot, text-only, float16, 2024-10-23 | Oct 2024 | huggingface.co | Official leaderboard | |
| 276 | ai21labs/Jamba-v0.1 51.6B | 59.7% | Three-shot, text-only, bfloat16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 277 | cognitivecomputations/dolphin-2.9.2-qwen2-7b 7.6B | 59.5% | Three-shot, text-only, bfloat16, 2024-06-10 | Jun 2024 | huggingface.co | Official leaderboard | |
| 278 | Kukedlc/NeuralLLaMa-3-8b-DT-v0.1 8B | 59.4% | Three-shot, text-only, float16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 279 | bunnycore/HyperLlama-3.1-8B 8B | 59.4% | Three-shot, text-only, bfloat16, 2024-09-05 | Sep 2024 | huggingface.co | Official leaderboard | |
| 280 | failspy/Phi-3-medium-4k-instruct-abliterated-v3 14B | 59.3% | Three-shot, text-only, bfloat16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 281 | MaziyarPanahi/Llama-3-8B-Instruct-v0.8 8B | 59.3% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 282 | | 59.3% | Three-shot, text-only, bfloat16, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 283 | princeton-nlp/gemma-2-9b-it-DPO 9.2B | 59.3% | Three-shot, text-only, rev: 422941a, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 284 | RDson/WomboCombo-R1-Coder-14B-Preview 14.8B | 59.3% | Three-shot, text-only, bfloat16, 2025-02-06 | Feb 2025 | huggingface.co | Official leaderboard | |
| 285 | rhaymison/Mistral-8x7b-portuguese-luana 46.7B | 59.1% | Three-shot, text-only, float16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 286 | mlabonne/ChimeraLlama-3-8B-v3 8B | 59.1% | Three-shot, text-only, float16, 2024-08-06 | Aug 2024 | huggingface.co | Official leaderboard | |
| 287 | upstage/SOLAR-10.7B-v1.0 10.7B | 59% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 288 | vicgalle/ConfigurableBeagle-11B 10.7B | 59% | Three-shot, text-only, rev: bbc16db, float16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 289 | recogna-nlp/Bode-3.1-8B-Instruct-full 8B | 59% | Three-shot, text-only, rev: oldalpaca, float16, 2024-08-31 | Aug 2024 | huggingface.co | Official leaderboard | |
| 290 | deepcogito/cogito-v1-preview-llama-8B 8B | 59% | Three-shot, text-only, bfloat16, 2025-04-09 | Apr 2025 | huggingface.co | Official leaderboard | |
| 291 | tiiuae/Falcon-H1-3B-Base 3.2B | 59% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 292 | lightblue/suzume-llama-3-8B-multilingual 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 293 | uygarkurt/llama-3-merged-linear 8B | 58.8% | Three-shot, text-only, float16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 294 | DeepMount00/Llama-3-8b-Ita 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 295 | meta-llama/Meta-Llama-3.1-8B-Instruct 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 296 | BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B 8.8B | 58.8% | Three-shot, text-only, rev: a42c86c, bfloat16, 2024-08-01 | Aug 2024 | huggingface.co | Official leaderboard | |
| 297 | BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-08-05 | Aug 2024 | huggingface.co | Official leaderboard | |
| 298 | BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-08-22 | Aug 2024 | huggingface.co | Official leaderboard | |
| 299 | v000000/SwallowMaid-8B-L3-SPPO-abliterated 8B | 58.8% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 300 | | 58.7% | Three-shot, text-only, 2024-03-08 | Dec 2023 | Mar 2024 | ai.google.dev | Official leaderboard |
| 301 | OrionStarAI/Orion-14B-Base 14.5B | 58.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 302 | recogna-nlp/internlm-chatbode-20b 19.9B | 58.7% | Three-shot, text-only, float16, 2024-05-07 | May 2024 | huggingface.co | Official leaderboard | |
| 303 | internlm/internlm2_5-7b-chat-1m 7.7B | 58.7% | Three-shot, text-only, bfloat16, 2024-07-05 | Jul 2024 | huggingface.co | Official leaderboard | |
| 304 | vicgalle/Configurable-Llama-3.1-8B-Instruct 8B | 58.7% | Three-shot, text-only, float16, 2024-08-03 | Aug 2024 | huggingface.co | Official leaderboard | |
| 305 | freewheelin/free-llama3-dpo-v0.2 8B | 58.7% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 306 | Eurdem/Defne-llama3.1-8B 8B | 58.7% | Three-shot, text-only, bfloat16, 2024-08-13 | Aug 2024 | huggingface.co | Official leaderboard | |
| 307 | unsloth/Meta-Llama-3.1-70B-bnb-4bit 70.6B | 58.7% | Three-shot, text-only, 4bit, 2024-08-13 | Aug 2024 | huggingface.co | Official leaderboard | |
| 308 | internlm/internlm2-20b 20B | 58.5% | Three-shot, text-only, bfloat16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 309 | PrunaAI/Jamba-v0.1-bnb-4bit 51.6B | 58.5% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 310 | VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct 8B | 58.5% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 311 | shadowml/Mixolar-4x7b 36.1B | 58.5% | Three-shot, text-only, float16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 312 | OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k 7.6B | 58.5% | Three-shot, text-only, bfloat16, 2024-10-10 | Oct 2024 | huggingface.co | Official leaderboard | |
| 313 | speakleash/Bielik-11B-v2 11.2B | 58.5% | Three-shot, text-only, bfloat16, 2024-10-16 | Oct 2024 | huggingface.co | Official leaderboard | |
| 314 | invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp 10.7B | 58.4% | Three-shot, text-only, float16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 315 | VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct 12.3B | 58.4% | Three-shot, text-only, bfloat16, 2024-07-29 | Jul 2024 | huggingface.co | Official leaderboard | |
| 316 | MaziyarPanahi/Llama-3-8B-Instruct-v0.10 8B | 58.4% | Three-shot, text-only, bfloat16, 2024-08-13 | Aug 2024 | huggingface.co | Official leaderboard | |
| 317 | TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule 7.6B | 58.4% | Three-shot, text-only, bfloat16, 2025-03-07 | Mar 2025 | huggingface.co | Official leaderboard | |
| 318 | | 58.3% | Three-shot, text-only, float16, 2024-02-19 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 319 | unsloth/llama-3-70b-bnb-4bit 70.6B | 58.3% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 320 | Danielbrdz/Barcenas-Llama3-8b-ORPO 8B | 58.3% | Three-shot, text-only, float16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 321 | MaziyarPanahi/Llama-3-8B-Instruct-v0.9 8B | 58.3% | Three-shot, text-only, bfloat16, 2024-08-13 | Aug 2024 | huggingface.co | Official leaderboard | |
| 322 | princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2 8B | 58.3% | Three-shot, text-only, rev: 5ed8372, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 323 | princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2 8B | 58.3% | Three-shot, text-only, rev: d06275e, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 324 | princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2 8B | 58.3% | Three-shot, text-only, rev: 3ea5c54, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 325 | princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2 8B | 58.3% | Three-shot, text-only, rev: 4e5bc97, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 326 | kekmodel/StopCarbon-10.7B-v5 10.7B | 58.1% | Three-shot, text-only, float16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 327 | DeepMount00/Llama-3.1-8b-Ita 8B | 58.1% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 328 | princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2 8B | 58.1% | Three-shot, text-only, rev: 81191fb, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 329 | princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2 8B | 58.1% | Three-shot, text-only, rev: 1821cc4, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 330 | jeonsworld/CarbonVillain-en-10.7B-v4 10.7B | 58% | Three-shot, text-only, bfloat16, 2024-04-26 | Apr 2024 | huggingface.co | Official leaderboard | |
| 331 | rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct 8B | 58% | Three-shot, text-only, float16, 2024-04-30 | Apr 2024 | huggingface.co | Official leaderboard | |
| 332 | saltlux/luxia-21.4b-alignment-v1.0 21.4B | 58% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 333 | failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 8B | 58% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 334 | saltlux/luxia-21.4b-alignment-v1.2 21.4B | 58% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 335 | RLHFlow/LLaMA3-iterative-DPO-final 8B | 58% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 336 | UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3 8B | 58% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 337 | dnhkng/RYS-Llama-3.1-8B-Instruct 8.7B | 58% | Three-shot, text-only, bfloat16, 2024-08-22 | Aug 2024 | huggingface.co | Official leaderboard | |
| 338 | internlm/internlm2-chat-20b 20B | 57.9% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 339 | openchat/openchat-3.5-0106-gemma 8.5B | 57.9% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 340 | adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3 8.1B | 57.9% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 341 | vicgalle/ConfigurableSOLAR-10.7B 10.7B | 57.9% | Three-shot, text-only, rev: c5c844a, float16, 2024-08-25 | Aug 2024 | huggingface.co | Official leaderboard | |
| 342 | | 57.9% | Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 343 | 01-ai/Yi-1.5-9B 8.8B | 57.7% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 344 | lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75 8B | 57.7% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | huggingface.co | Official leaderboard | |
| 345 | UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2 8B | 57.7% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 346 | Dampfinchen/Llama-3.1-8B-Ultra-Instruct 8B | 57.7% | Three-shot, text-only, bfloat16, 2024-09-16 | Sep 2024 | huggingface.co | Official leaderboard | |
| 347 | princeton-nlp/Llama-3-Instruct-8B-CPO 8B | 57.7% | Three-shot, text-only, rev: d4645ae, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 348 | ibivibiv/llama-3-nectar-dpo-8B 8B | 57.6% | Three-shot, text-only, bfloat16, 2024-06-22 | Jun 2024 | huggingface.co | Official leaderboard | |
| 349 | princeton-nlp/Llama-3-Instruct-8B-KTO 8B | 57.6% | Three-shot, text-only, rev: e697908, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 350 | anthracite-org/magnum-v2.5-12b-kto 12.3B | 57.6% | Three-shot, text-only, rev: aee0374, float16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 351 | Sao10K/L3-8B-Niitama-v1 8B | 57.6% | Three-shot, text-only, float16, 2024-12-18 | Dec 2024 | huggingface.co | Official leaderboard | |
| 352 | VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct 8B | 57.4% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 353 | migtissera/Trinity-2-Codestral-22B 22.3B | 57.4% | Three-shot, text-only, bfloat16, 2024-09-16 | Sep 2024 | huggingface.co | Official leaderboard | |
| 354 | princeton-nlp/Llama-3-Instruct-8B-RDPO 8B | 57.4% | Three-shot, text-only, rev: 9497ca2, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 355 | | 57.3% | Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 356 | internlm/internlm2-chat-20b-sft 19.9B | 57.3% | Three-shot, text-only, bfloat16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 357 | mlabonne/Llama-3-8B-Instruct-abliterated-dpomix 8B | 57.3% | Three-shot, text-only, float16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 358 | princeton-nlp/Llama-3-Instruct-8B-SimPO 8B | 57.3% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 359 | grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge 8B | 57.3% | Three-shot, text-only, bfloat16, 2024-08-08 | Aug 2024 | huggingface.co | Official leaderboard | |
| 360 | recogna-nlp/Bode-3.1-8B-Instruct-lora 8.1B | 57.3% | Three-shot, text-only, float16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 361 | EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection 8B | 57.3% | Three-shot, text-only, rev: 22257d3, float16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 362 | princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2 8B | 57.3% | Three-shot, text-only, rev: 477d33e, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 363 | princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2 8B | 57.3% | Three-shot, text-only, rev: 24601cd, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 364 | princeton-nlp/Llama-3-Instruct-8B-RRHF 8B | 57.3% | Three-shot, text-only, rev: 73561d9, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 365 | Granite-3.1-8B-Instruct | 57.3% | Three-shot, text-only, float16, 2025-08-29 | Dec 2024 | Aug 2025 | huggingface.co | Official leaderboard |
| 366 | MagusCorp/grpo_lora_enem_llama3_7b 8B | 57.3% | Three-shot, text-only, float16, 2025-02-11 | Feb 2025 | huggingface.co | Official leaderboard | |
| 367 | recogna-nlp/gembode-7b 8.7B | 57.2% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 368 | unsloth/llama-3-8b-Instruct-bnb-4bit 8B | 57.2% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 369 | vicgalle/Configurable-Llama-3-8B-v0.3 8B | 57.2% | Three-shot, text-only, float16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 370 | princeton-nlp/Llama-3-Instruct-8B-DPO 8B | 57.2% | Three-shot, text-only, rev: 0afbf4c, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 371 | tiiuae/Falcon-H1-1.5B-Deep-Instruct 1.6B | 57.2% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 372 | NousResearch/Hermes-2-Pro-Llama-3-8B 8B | 57% | Three-shot, text-only, float16, 2024-05-06 | May 2024 | huggingface.co | Official leaderboard | |
| 373 | 01-ai/Yi-1.5-9B-32K 8.8B | 57% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 374 | NousResearch/Hermes-2-Theta-Llama-3-8B 8B | 57% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 375 | arthrod/cicerollamatry8 8B | 57% | Three-shot, text-only, float16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 376 | maywell/Qwen2-7B-Multilingual-RP 7.6B | 57% | Three-shot, text-only, bfloat16, 2024-07-24 | Jul 2024 | huggingface.co | Official leaderboard | |
| 377 | botbot-ai/CabraLlama3-8b 8B | 56.9% | Three-shot, text-only, bfloat16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 378 | jondurbin/bagel-8b-v1.0 8B | 56.9% | Three-shot, text-only, bfloat16, 2024-05-18 | May 2024 | huggingface.co | Official leaderboard | |
| 379 | vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B 8B | 56.9% | Three-shot, text-only, float16, 2024-06-12 | Jun 2024 | huggingface.co | Official leaderboard | |
| 380 | BAAI/Infinity-Instruct-3M-0625-Llama3-8B 8B | 56.9% | Three-shot, text-only, bfloat16, 2024-07-18 | Jul 2024 | huggingface.co | Official leaderboard | |
| 381 | EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta 8B | 56.9% | Three-shot, text-only, rev: ef37828, float16, 2024-09-15 | Sep 2024 | huggingface.co | Official leaderboard | |
| 382 | MaziyarPanahi/calme-2.7-qwen2-7b 7.6B | 56.9% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 383 | Qwen/Qwen2.5-3B-Instruct 3.1B | 56.9% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 384 | | 56.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 385 | qnguyen3/Master-Yi-9B 8.8B | 56.8% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 386 | OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k 32.5B | 56.8% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 387 | tobiaspires/command-r-p11-fn 35B | 56.8% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 388 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4 8.8B | 56.8% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 389 | EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta 8B | 56.8% | Three-shot, text-only, rev: 010aaa1, float16, 2024-09-13 | Sep 2024 | huggingface.co | Official leaderboard | |
| 390 | EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta 8B | 56.8% | Three-shot, text-only, float16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 391 | grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge 8B | 56.8% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 392 | 01-ai/Yi-1.5-9B-Chat-16K 8.8B | 56.6% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 393 | chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO 8B | 56.6% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 394 | microsoft/Phi-3.5-mini-instruct 3.8B | 56.6% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 395 | | 56.5% | Three-shot, text-only, bfloat16, 2024-02-21 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 396 | EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200 8B | 56.5% | Three-shot, text-only, float16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 397 | TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule 7.6B | 56.5% | Three-shot, text-only, bfloat16, 2025-03-07 | Mar 2025 | huggingface.co | Official leaderboard | |
| 398 | rishiraj/CatPPT 7.2B | 56.3% | Three-shot, text-only, bfloat16, 2024-02-25 | Feb 2024 | huggingface.co | Official leaderboard | |
| 399 | VAGOsolutions/SauerkrautLM-Gemma-7b 8.5B | 56.3% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 400 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2 8.8B | 56.3% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 401 | NousResearch/Hermes-3-Llama-3.1-8B 8B | 56.3% | Three-shot, text-only, bfloat16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 402 | leafspark/Llama-3.1-8B-MultiReflection-Instruct 8B | 56.3% | Three-shot, text-only, float16, 2024-09-16 | Sep 2024 | huggingface.co | Official leaderboard | |
| 403 | Qwen/Qwen2.5-Coder-7B-Instruct 7.6B | 56.3% | Three-shot, text-only, bfloat16, 2024-10-13 | Oct 2024 | huggingface.co | Official leaderboard | |
| 404 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1 8.8B | 56.2% | Three-shot, text-only, bfloat16, 2024-07-09 | Jul 2024 | huggingface.co | Official leaderboard | |
| 405 | vicgalle/Configurable-Hermes-3-Llama-3.1-8B 8B | 56.2% | Three-shot, text-only, float16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 406 | MaziyarPanahi/calme-2.3-qwen2-7b 7.6B | 56.2% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 407 | mistralai/Ministral-8B-Instruct-2410 8B | 56.2% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 408 | cognitivecomputations/Dolphin3.0-R1-Mistral-24B 23.6B | 56.2% | Three-shot, text-only, bfloat16, 2025-02-11 | Feb 2025 | huggingface.co | Official leaderboard | |
| 409 | NousResearch/Nous-Hermes-2-SOLAR-10.7B 10.7B | 56% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 410 | nicolasdec/CabraQwen7b 7.7B | 56% | Three-shot, text-only, bfloat16, 2024-04-02 | Apr 2024 | huggingface.co | Official leaderboard | |
| 411 | tiiuae/Falcon-H1-1.5B-Deep-Base 1.6B | 56% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 412 | rishiraj/CatPPT-base 7.2B | 55.9% | Three-shot, text-only, float16, 2024-02-25 | Feb 2024 | huggingface.co | Official leaderboard | |
| 413 | cognitivecomputations/dolphin-2.9.1-yi-1.5-9b 8.8B | 55.9% | Three-shot, text-only, bfloat16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 414 | internlm/internlm2_5-7b-chat 7.7B | 55.9% | Three-shot, text-only, bfloat16, 2024-07-05 | Jul 2024 | huggingface.co | Official leaderboard | |
| 415 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3 8.8B | 55.9% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 416 | arcee-ai/Arcee-Scribe 7.7B | 55.9% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 417 | princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2 8B | 55.9% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 418 | EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos 8B | 55.9% | Three-shot, text-only, float16, 2024-09-09 | Sep 2024 | huggingface.co | Official leaderboard | |
| 419 | | 55.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 420 | vicgalle/CarbonBeagle-11B 10.7B | 55.8% | Three-shot, text-only, float16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 421 | microsoft/MediPhi 3.8B | 55.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 422 | | 55.6% | Three-shot, text-only, bfloat16, 2024-03-04 | Nov 2023 | Mar 2024 | huggingface.co | Official leaderboard |
| 423 | SeaLLMs/SeaLLM-7B-v2.5 8.5B | 55.6% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 424 | princeton-nlp/Llama-3-8B-ProLong-512k-Instruct 8B | 55.6% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 425 | princeton-nlp/Llama-3-8B-ProLong-64k-Base 8B | 55.6% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 426 | | 55.5% | Three-shot, text-only, float16, 2024-04-18 | Sep 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 427 | Sabiá-2 Small | 55.5% | Three-shot, text-only, 2024-04-12 | Apr 2024 | maritaca.ai | Official leaderboard | |
| 428 | lemon-mint/gemma-ko-7b-instruct-v0.62 8.5B | 55.5% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 429 | wenbopan/Faro-Yi-9B 8.8B | 55.5% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 430 | OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k 8B | 55.5% | Three-shot, text-only, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 431 | princeton-nlp/Llama-3-Instruct-8B-IPO 8B | 55.5% | Three-shot, text-only, rev: fbe883f, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 432 | princeton-nlp/Llama-3-Instruct-8B-SLiC-HF 8B | 55.5% | Three-shot, text-only, rev: 7e9001f, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 433 | | 55.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 434 | Nous-Hermes-2-Mixtral-8x7B-DPO | 55.4% | Three-shot, text-only, bfloat16, 2024-02-27 | Jan 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 435 | wenbopan/Faro-Yi-9B-DPO 8.8B | 55.2% | Three-shot, text-only, rev: 58a4349, float16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 436 | Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 8B | 55.2% | Three-shot, text-only, bfloat16, 2024-08-06 | Aug 2024 | huggingface.co | Official leaderboard | |
| 437 | terrycraddock/Reflection-Llama-3.1-8B 8B | 55.2% | Three-shot, text-only, float16, 2024-09-15 | Sep 2024 | huggingface.co | Official leaderboard | |
| 438 | migtissera/Trinity-2-Codestral-22B-v0.2 22.3B | 55.2% | Three-shot, text-only, bfloat16, 2024-09-16 | Sep 2024 | huggingface.co | Official leaderboard | |
| 439 | MaziyarPanahi/calme-2.1-qwen2-7b 7.6B | 55.2% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 440 | vicgalle/Configurable-Yi-1.5-9B-Chat 8.8B | 55.1% | Three-shot, text-only, float16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 441 | meraGPT/mera-mix-4x7B 24.2B | 55.1% | Three-shot, text-only, bfloat16, 2024-06-10 | Jun 2024 | huggingface.co | Official leaderboard | |
| 442 | BAAI/Infinity-Instruct-3M-0625-Mistral-7B 7.2B | 55.1% | Three-shot, text-only, bfloat16, 2024-07-18 | Jul 2024 | huggingface.co | Official leaderboard | |
| 443 | Yi-9B | 54.9% | Three-shot, text-only, bfloat16, 2024-04-13 | Mar 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 444 | FuseAI/FuseChat-7B-VaRM 7.2B | 54.9% | Three-shot, text-only, bfloat16, 2024-03-04 | Mar 2024 | huggingface.co | Official leaderboard | |
| 445 | unsloth/llama-3-8b-bnb-4bit 8B | 54.9% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 446 | princeton-nlp/Llama-3-8B-ProLong-64k-Instruct 8B | 54.9% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 447 | internlm/internlm2-base-20b 20B | 54.8% | Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 448 | | 54.8% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 449 | ibivibiv/multimaster-7b-v6 35.4B | 54.8% | Three-shot, text-only, bfloat16, 2024-06-08 | Jun 2024 | huggingface.co | Official leaderboard | |
| 450 | MaziyarPanahi/Topxtral-4x7B-v0.1 18.5B | 54.8% | Three-shot, text-only, bfloat16, 2024-06-10 | Jun 2024 | huggingface.co | Official leaderboard | |
| 451 | Kukedlc/NeuralSynthesis-7B-v0.1 7.2B | 54.8% | Three-shot, text-only, bfloat16, 2024-06-12 | Jun 2024 | huggingface.co | Official leaderboard | |
| 452 | jsfs11/MixtureofMerges-MoE-4x7b-v5 24.2B | 54.8% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 453 | mistralai/Codestral-22B-v0.1 22.3B | 54.8% | Three-shot, text-only, bfloat16, 2024-07-02 | Jul 2024 | huggingface.co | Official leaderboard | |
| 454 | cognitivecomputations/laserxtral 24.2B | 54.8% | Three-shot, text-only, bfloat16, 2024-07-31 | Jul 2024 | huggingface.co | Official leaderboard | |
| 455 | freewheelin/free-solar-evo-v0.1 10.7B | 54.8% | Three-shot, text-only, float16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 456 | FuseAI/OpenChat-3.5-7B-Solar 7.2B | 54.7% | Three-shot, text-only, bfloat16, 2024-03-04 | Mar 2024 | huggingface.co | Official leaderboard | |
| 457 | kevin009/llamaRAGdrama 7.2B | 54.7% | Three-shot, text-only, float16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 458 | cognitivecomputations/WestLake-7B-v2-laser 7.2B | 54.7% | Three-shot, text-only, bfloat16, 2024-07-31 | Jul 2024 | huggingface.co | Official leaderboard | |
| 459 | freewheelin/free-solar-evo-v0.13 10.7B | 54.7% | Three-shot, text-only, float16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 460 | princeton-nlp/Llama-3-Instruct-8B-ORPO 8B | 54.7% | Three-shot, text-only, rev: 4bb3ffc, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 461 | Kukedlc/NeuralSynthesis-7b-v0.4-slerp 7.2B | 54.5% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 462 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5 8.8B | 54.5% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 463 | liminerity/M7-7b 7.2B | 54.5% | Three-shot, text-only, bfloat16, 2024-07-13 | Jul 2024 | huggingface.co | Official leaderboard | |
| 464 | freewheelin/free-solar-evo-v0.11 10.7B | 54.5% | Three-shot, text-only, float16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 465 | Magpie-Align/MagpieLM-8B-SFT-v0.1 8B | 54.5% | Three-shot, text-only, rev: b91f605, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 466 | rombodawg/rombos_Replete-Coder-Instruct-8b-Merged 8B | 54.5% | Three-shot, text-only, bfloat16, 2024-10-14 | Oct 2024 | huggingface.co | Official leaderboard | |
| 467 | paulml/OGNO-7B 7.2B | 54.4% | Three-shot, text-only, bfloat16, 2024-02-25 | Feb 2024 | huggingface.co | Official leaderboard | |
| 468 | MaziyarPanahi/Mistral-7B-Instruct-Aya-101 7.2B | 54.4% | Three-shot, text-only, bfloat16, 2024-04-17 | Apr 2024 | huggingface.co | Official leaderboard | |
| 469 | J-LAB/BRisa-7B-Instruct-v0.2 7.2B | 54.4% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 470 | Kquant03/CognitiveFusion2-4x7B-BF16 24.2B | 54.4% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 471 | NotAiLOL/Yi-1.5-dolphin-9B 8.8B | 54.4% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 472 | 01-ai/Yi-9B-200K 8.8B | 54.4% | Three-shot, text-only, rev: v20240318, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 473 | allknowingroger/MultiverseEx26-7B-slerp 7.2B | 54.4% | Three-shot, text-only, bfloat16, 2024-07-03 | Jul 2024 | huggingface.co | Official leaderboard | |
| 474 | EpistemeAI/Fireball-3.1-8B-ORPO 8.1B | 54.4% | Three-shot, text-only, bfloat16, 2024-08-26 | Aug 2024 | huggingface.co | Official leaderboard | |
| 475 | | 54.4% | Three-shot, text-only, float16, 2024-10-24 | Oct 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 476 | bardsai/jaskier-7b-dpo-v5.6 7.2B | 54.2% | Three-shot, text-only, bfloat16, 2024-02-25 | Feb 2024 | huggingface.co | Official leaderboard | |
| 477 | teknium/OpenHermes-2-Mistral-7B 7.2B | 54.2% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 478 | automerger/YamshadowExperiment28-7B 7.2B | 54.2% | Three-shot, text-only, bfloat16, 2024-05-30 | May 2024 | huggingface.co | Official leaderboard | |
| 479 | Kukedlc/NeuralSynthesis-7B-v0.3 7.2B | 54.2% | Three-shot, text-only, bfloat16, 2024-07-29 | Jul 2024 | huggingface.co | Official leaderboard | |
| 480 | TIGER-Lab/AceCodeRM-7B 7.6B | 54.2% | Three-shot, text-only, bfloat16, 2025-03-07 | Mar 2025 | huggingface.co | Official leaderboard | |
| 481 | | 54.1% | Three-shot, text-only, bfloat16, 2024-04-08 | Feb 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 482 | NousResearch/Nous-Hermes-2-Mistral-7B-DPO 7.2B | 54.1% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 483 | stabilityai/stablelm-2-12b 12.1B | 54.1% | Three-shot, text-only, bfloat16, 2024-04-08 | Apr 2024 | huggingface.co | Official leaderboard | |
| 484 | adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1 8B | 54.1% | Three-shot, text-only, bfloat16, 2024-04-20 | Apr 2024 | huggingface.co | Official leaderboard | |
| 485 | | 54.1% | Three-shot, text-only, bfloat16, 2024-04-23 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 486 | zhengr/MixTAO-7Bx2-MoE-v8.1 12.9B | 54.1% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 487 | jsfs11/MixtureofMerges-MoE-4x7b-v4 24.2B | 54.1% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 488 | J-LAB/FluxiIA-Small 7.2B | 54.1% | Three-shot, text-only, float16, 2024-11-19 | Nov 2024 | huggingface.co | Official leaderboard | |
| 489 | JJhooww/Mistral-7B-v0.2-Base_ptbr 7.2B | 54% | Three-shot, text-only, float16, 2024-04-13 | Apr 2024 | huggingface.co | Official leaderboard | |
| 490 | | 54% | Three-shot, text-only, bfloat16, 2024-04-23 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 491 | princeton-nlp/Llama-3-Base-8B-SFT-ORPO 8B | 54% | Three-shot, text-only, rev: 54d5840, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 492 | princeton-nlp/Llama-3-Base-8B-SFT-RDPO 8B | 54% | Three-shot, text-only, rev: b41a964, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 493 | EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic 8B | 54% | Three-shot, text-only, float16, 2024-12-13 | Dec 2024 | huggingface.co | Official leaderboard | |
| 494 | | 53.8% | Three-shot, text-only, bfloat16, 2024-03-29 | Mar 2024 | Mar 2024 | huggingface.co | Official leaderboard |
| 495 | Walmart-the-bag/Misted-v2-7B 7.2B | 53.8% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 496 | adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2 8B | 53.8% | Three-shot, text-only, bfloat16, 2024-04-30 | Apr 2024 | huggingface.co | Official leaderboard | |
| 497 | internlm/internlm2-wqx-20b 19.9B | 53.8% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 498 | princeton-nlp/Llama-3-Base-8B-SFT-RRHF 8B | 53.8% | Three-shot, text-only, rev: aea8c04, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 499 | kurakurai/Luth-1.7B-Instruct 1.7B | 53.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 500 | utter-project/EuroLLM-9B-Instruct 9.2B | 53.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 501 | Walmart-the-bag/WordWoven-2x7B 12.9B | 53.7% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 502 | adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3 8B | 53.7% | Three-shot, text-only, bfloat16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 503 | adalbertojunior/Llama-3-8B-Dolphin-Portuguese 8B | 53.7% | Three-shot, text-only, bfloat16, 2024-04-27 | Apr 2024 | huggingface.co | Official leaderboard | |
| 504 | abacusai/Slerp-CM-mist-dpo 7.2B | 53.7% | Three-shot, text-only, float16, 2024-09-05 | Sep 2024 | huggingface.co | Official leaderboard | |
| 505 | ValiantLabs/Llama3.1-8B-Cobalt 8B | 53.7% | Three-shot, text-only, bfloat16, 2024-10-04 | Oct 2024 | huggingface.co | Official leaderboard | |
| 506 | princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF 8B | 53.7% | Three-shot, text-only, rev: 325092c, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 507 | HuggingFaceTB/SmolLM3-3B-Base 3.1B | 53.7% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 508 | 01-ai/Yi-9B-200k 8.8B | 53.5% | Three-shot, text-only, bfloat16, 2024-04-13 | Apr 2024 | huggingface.co | Official leaderboard | |
| 509 | eduagarcia/mistral-orpo-mix-21k 7.2B | 53.5% | Three-shot, text-only, bfloat16, 2024-05-06 | May 2024 | huggingface.co | Official leaderboard | |
| 510 | EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto 8B | 53.5% | Three-shot, text-only, float16, 2024-11-04 | Nov 2024 | huggingface.co | Official leaderboard | |
| 511 | kaist-ai/mistral-orpo-capybara-7k 7.2B | 53.4% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 512 | yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B 12.9B | 53.4% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 513 | CultriX/NeuralMona_MoE-4x7B 24.2B | 53.4% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 514 | Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R 8B | 53.4% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 515 | RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2 12.9B | 53.4% | Three-shot, text-only, bfloat16, 2024-07-03 | Jul 2024 | huggingface.co | Official leaderboard | |
| 516 | Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3 8B | 53.4% | Three-shot, text-only, bfloat16, 2024-08-06 | Aug 2024 | huggingface.co | Official leaderboard | |
| 517 | mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated 8B | 53.4% | Three-shot, text-only, bfloat16, 2024-09-10 | Sep 2024 | huggingface.co | Official leaderboard | |
| 518 | princeton-nlp/Mistral-7B-Instruct-SimPO 7.2B | 53.4% | Three-shot, text-only, rev: 03191ee, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 519 | princeton-nlp/Llama-3-Base-8B-SFT-DPO 8B | 53.4% | Three-shot, text-only, rev: 3f5ec47, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 520 | BAAI/Infinity-Instruct-3M-0613-Mistral-7B 7.2B | 53.3% | Three-shot, text-only, float16, 2024-06-22 | Jun 2024 | huggingface.co | Official leaderboard | |
| 521 | J-LAB/Nemo_RolePlay_PTBR_new 12.3B | 53.3% | Three-shot, text-only, float16, 2024-09-10 | Sep 2024 | huggingface.co | Official leaderboard | |
| 522 | EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2 8B | 53.3% | Three-shot, text-only, float16, 2024-09-14 | Sep 2024 | huggingface.co | Official leaderboard | |
| 523 | byroneverson/Yi-1.5-9B-Chat-16K-abliterated 8.8B | 53.3% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 524 | | 53.1% | Three-shot, text-only, bfloat16, 2024-04-17 | Dec 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 525 | eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1 3.8B | 53.1% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 526 | mistralai/Mistral-7B-Instruct-v0.3 7.3B | 53.1% | Three-shot, text-only, bfloat16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 527 | MaziyarPanahi/Mistral-7B-Instruct-v0.3 7.3B | 53.1% | Three-shot, text-only, bfloat16, 2024-05-26 | May 2024 | huggingface.co | Official leaderboard | |
| 528 | yunconglong/MoE_13B_DPO 12.9B | 53.1% | Three-shot, text-only, bfloat16, 2024-07-03 | Jul 2024 | huggingface.co | Official leaderboard | |
| 529 | cognitivecomputations/openchat-3.5-0106-laser 7.2B | 53.1% | Three-shot, text-only, bfloat16, 2024-07-31 | Jul 2024 | huggingface.co | Official leaderboard | |
| 530 | Magpie-Align/Llama-3-8B-Magpie-Align-v0.3 8B | 53.1% | Three-shot, text-only, bfloat16, 2024-08-06 | Aug 2024 | huggingface.co | Official leaderboard | |
| 531 | leliuga/Phi-3-mini-4k-instruct-bnb-4bit 3.8B | 53% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 532 | princeton-nlp/Llama-3-Base-8B-SFT-CPO 8B | 53% | Three-shot, text-only, rev: 536ce7e, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 533 | utter-project/EuroLLM-9B 9.2B | 53% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 534 | teknium/OpenHermes-2.5-Mistral-7B 7.2B | 52.9% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 535 | unsloth/Phi-3-mini-4k-instruct-bnb-4bit 3.8B | 52.9% | Three-shot, text-only, 4bit, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 536 | | 52.9% | Three-shot, text-only, bfloat16, 2025-01-28 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 537 | tiiuae/Falcon-H1-1.5B-Instruct 1.6B | 52.9% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 538 | openchat/openchat-3.5-0106 7.2B | 52.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 539 | eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1 3.8B | 52.7% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 540 | Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5 7.2B | 52.7% | Three-shot, text-only, float16, 2024-07-27 | Jul 2024 | huggingface.co | Official leaderboard | |
| 541 | Magpie-Align/MagpieLM-8B-Chat-v0.1 8B | 52.7% | Three-shot, text-only, rev: 0b30eab, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 542 | princeton-nlp/Llama-3-Base-8B-SFT-IPO 8B | 52.7% | Three-shot, text-only, rev: 85055cc, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 543 | princeton-nlp/Mistral-7B-Instruct-KTO 7.2B | 52.7% | Three-shot, text-only, rev: 834422e, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 544 | internlm-20b | 52.6% | Three-shot, text-only, bfloat16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 545 | mlabonne/Monarch-7B 7.2B | 52.6% | Three-shot, text-only, bfloat16, 2024-02-25 | Feb 2024 | huggingface.co | Official leaderboard | |
| 546 | JJhooww/Mistral_Relora_Step2k 7.2B | 52.6% | Three-shot, text-only, float16, 2024-03-08 | Mar 2024 | huggingface.co | Official leaderboard | |
| 547 | princeton-nlp/Llama-3-Base-8B-SFT-SimPO 8B | 52.6% | Three-shot, text-only, rev: 0a6e518, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 548 | Qwen/Qwen2.5-1.5B-Instruct 1.5B | 52.6% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 549 | utter-project/EuroLLM-22B-Instruct-Preview 22.6B | 52.6% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 550 | internlm/internlm2-7b 7.7B | 52.4% | Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 551 | argilla/CapybaraHermes-2.5-Mistral-7B 7.2B | 52.4% | Three-shot, text-only, float16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 552 | unsloth/gemma-7b-bnb-4bit 8.5B | 52.4% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 553 | eduagarcia/mistral-orpo-capybara-3k 7.2B | 52.4% | Three-shot, text-only, bfloat16, 2024-05-01 | May 2024 | huggingface.co | Official leaderboard | |
| 554 | recogna-nlp/internlm-chatbode2-7b-beta 8.4B | 52.4% | Three-shot, text-only, float16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 555 | | 52.3% | Three-shot, text-only, bfloat16, 2024-05-22 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 556 | | 52.3% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 557 | yunconglong/DARE_TIES_13B 12.9B | 52.3% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 558 | uukuguy/speechless-zephyr-code-functionary-7b 7.2B | 52.3% | Three-shot, text-only, bfloat16, 2024-07-27 | Jul 2024 | huggingface.co | Official leaderboard | |
| 559 | princeton-nlp/Llama-3-Base-8B-SFT 8B | 52.3% | Three-shot, text-only, rev: b622b7d, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 560 | meta-llama/Llama-3.2-3B-Instruct 3.2B | 52.3% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 561 | | 52.3% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 562 | | 52.2% | Three-shot, text-only, bfloat16, 2024-02-18 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 563 | alvarobartt/Mistral-7B-v0.1-ORPO 7.2B | 52.2% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 564 | tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1 8B | 52.2% | Three-shot, text-only, bfloat16, 2024-09-12 | Sep 2024 | huggingface.co | Official leaderboard | |
| 565 | princeton-nlp/Llama-3-Base-8B-SFT-KTO 8B | 52.2% | Three-shot, text-only, rev: 49a8c2e, bfloat16, 2024-09-28 | Sep 2024 | huggingface.co | Official leaderboard | |
| 566 | Qwen/Qwen1.5-MoE-A2.7B-Chat 14.3B | 52% | Three-shot, text-only, bfloat16, 2024-04-12 | Apr 2024 | huggingface.co | Official leaderboard | |
| 567 | mlabonne/Beyonder-4x7B-v3 24.2B | 52% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 568 | uukuguy/zephyr-7b-alpha-dare-0.85 7.2B | 52% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 569 | 01-ai/Yi-1.5-34B-Chat-16K 34.4B | 52% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 570 | dzakwan/dzakwan-MoE-4x7b-Beta 24.2B | 52% | Three-shot, text-only, float16, 2024-06-10 | Jun 2024 | huggingface.co | Official leaderboard | |
| 571 | | 52% | Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 572 | kaist-ai/janus-dpo-7b 7.2B | 52% | Three-shot, text-only, bfloat16, 2024-10-09 | Oct 2024 | huggingface.co | Official leaderboard | |
| 573 | huggyllama/llama-30b 32.5B | 51.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 574 | eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1 3.8B | 51.9% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 575 | princeton-nlp/Mistral-7B-Instruct-RRHF 7.2B | 51.9% | Three-shot, text-only, rev: 493d3ce, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 576 | BornSaint/Dare_Angel_8B 8B | 51.9% | Three-shot, text-only, float16, 2025-05-22 | May 2025 | huggingface.co | Official leaderboard | |
| 577 | rhaymison/Llama3-portuguese-luana-8b-instruct 8B | 51.7% | Three-shot, text-only, float16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 578 | Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4 8B | 51.7% | Three-shot, text-only, float16, 2024-06-15 | Jun 2024 | huggingface.co | Official leaderboard | |
| 579 | SeaLLMs/SeaLLM-7B-v2 7.4B | 51.7% | Three-shot, text-only, bfloat16, 2024-08-06 | Aug 2024 | huggingface.co | Official leaderboard | |
| 580 | abacusai/bigstral-12b-32k 12.5B | 51.7% | Three-shot, text-only, float16, 2024-09-04 | Sep 2024 | huggingface.co | Official leaderboard | |
| 581 | abacusai/bigyi-15b 15.1B | 51.7% | Three-shot, text-only, float16, 2024-09-04 | Sep 2024 | huggingface.co | Official leaderboard | |
| 582 | byroneverson/Yi-1.5-9B-Chat-abliterated 8.8B | 51.7% | Three-shot, text-only, bfloat16, 2024-09-17 | Sep 2024 | huggingface.co | Official leaderboard | |
| 583 | internlm/internlm2-chat-7b-sft 7.7B | 51.6% | Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 584 | eduagarcia/mistral-orpo-mix-7k 7.2B | 51.6% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 585 | rombodawg/Everyone-Coder-4x7b-Base 24.2B | 51.6% | Three-shot, text-only, float16, 2024-07-27 | Jul 2024 | huggingface.co | Official leaderboard | |
| 586 | recogna-nlp/internlm-chatbode-7b 7.7B | 51.5% | Three-shot, text-only, float16, 2024-05-07 | May 2024 | huggingface.co | Official leaderboard | |
| 587 | vicgalle/Configurable-Mistral-7B 7.2B | 51.5% | Three-shot, text-only, float16, 2024-06-12 | Jun 2024 | huggingface.co | Official leaderboard | |
| 588 | vicgalle/ConfigurableHermes-7B 7.2B | 51.5% | Three-shot, text-only, float16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 589 | princeton-nlp/Mistral-7B-Instruct-DPO 7.2B | 51.5% | Three-shot, text-only, rev: 5e96cff, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 590 | | 51.5% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 591 | | 51.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 592 | Skywork/Skywork-13B-base 13.9B | 51.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 593 | bartowski/internlm2-chat-7b-llama 7.7B | 51.3% | Three-shot, text-only, rev: refs/pr/2, float16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 594 | uukuguy/speechless-code-mistral-7b-v1.0 7.2B | 51.3% | Three-shot, text-only, float16, 2024-06-16 | Jun 2024 | huggingface.co | Official leaderboard | |
| 595 | unsloth/mistral-7b-v0.3-bnb-4bit 7.3B | 51.2% | Three-shot, text-only, 4bit, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 596 | openchat/openchat-3.6-8b-20240522 8B | 51.2% | Three-shot, text-only, bfloat16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 597 | shadowml/BeagSake-7B 7.2B | 51.2% | Three-shot, text-only, bfloat16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 598 | rombodawg/rombos_Replete-Coder-Llama3-8B 8B | 51.2% | Three-shot, text-only, bfloat16, 2024-10-14 | Oct 2024 | huggingface.co | Official leaderboard | |
| 599 | | 51% | Three-shot, text-only, bfloat16, 2024-04-14 | Oct 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 600 | MagusCorp/legislinho 7.2B | 51% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 601 | GritLM/GritLM-7B-KTO 7.2B | 51% | Three-shot, text-only, bfloat16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 602 | beowolx/CodeNinja-1.0-OpenChat-7B 7.2B | 51% | Three-shot, text-only, bfloat16, 2024-07-27 | Jul 2024 | huggingface.co | Official leaderboard | |
| 603 | UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3 7.2B | 51% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 604 | princeton-nlp/Mistral-7B-Instruct-CPO 7.2B | 51% | Three-shot, text-only, rev: 32492f8, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 605 | internlm/internlm2-chat-7b 7.7B | 50.8% | Three-shot, text-only, rev: v1.0.0, float16, 2024-02-19 | Feb 2024 | huggingface.co | Official leaderboard | |
| 606 | gradientai/Llama-3-8B-Instruct-262k 8B | 50.8% | Three-shot, text-only, bfloat16, 2024-06-13 | Jun 2024 | huggingface.co | Official leaderboard | |
| 607 | AetherResearch/Cerebrum-1.0-7b 7.2B | 50.6% | Three-shot, text-only, float16, 2024-03-14 | Mar 2024 | huggingface.co | Official leaderboard | |
| 608 | rhaymison/phi-3-portuguese-tom-cat-4k-instruct 3.8B | 50.6% | Three-shot, text-only, float16, 2024-04-29 | Apr 2024 | huggingface.co | Official leaderboard | |
| 609 | UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2 7.2B | 50.6% | Three-shot, text-only, bfloat16, 2024-08-07 | Aug 2024 | huggingface.co | Official leaderboard | |
| 610 | mlabonne/FineLlama-3.1-8B 8B | 50.6% | Three-shot, text-only, bfloat16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 611 | princeton-nlp/Mistral-7B-Instruct-RDPO 7.2B | 50.6% | Three-shot, text-only, rev: 23ec6ab, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 612 | argilla/notus-7b-v1 7.2B | 50.5% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 613 | | 50.5% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 614 | princeton-nlp/Mistral-7B-Instruct-ORPO 7.2B | 50.5% | Three-shot, text-only, rev: 69c0481, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 615 | Qwen/Qwen3-1.7B-Base 1.7B | 50.5% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 616 | Intel/neural-chat-7b-v3-3 7.2B | 50.4% | Three-shot, text-only, float16, 2024-02-21 | Feb 2024 | huggingface.co | Official leaderboard | |
| 617 | | 50.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 618 | THUDM/chatglm3-6b-base 6.2B | 50.2% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 619 | lmsys/vicuna-33b-v1.3 33B | 50.2% | Three-shot, text-only, float16, 2024-03-05 | Mar 2024 | huggingface.co | Official leaderboard | |
| 620 | kaist-ai/janus-7b 7.2B | 50.2% | Three-shot, text-only, bfloat16, 2024-10-09 | Oct 2024 | huggingface.co | Official leaderboard | |
| 621 | | 50.2% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 622 | | 50.1% | Three-shot, text-only, bfloat16, 2024-02-27 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 623 | recogna-nlp/internlmbode-7b 7.7B | 50.1% | Three-shot, text-only, float16, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 624 | mlabonne/NeuralMonarch-7B 7.2B | 50.1% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 625 | UCLA-AGI/Mistral7B-PairRM-SPPO 7.2B | 50.1% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 626 | princeton-nlp/Mistral-7B-Instruct-SLiC-HF 7.2B | 50.1% | Three-shot, text-only, rev: 3d08c8b, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 627 | unsloth/mistral-7b-bnb-4bit 7.2B | 49.9% | Three-shot, text-only, 4bit, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 628 | 01-ai/Yi-1.5-6B 6.1B | 49.9% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 629 | eldogbbhed/Peagle-9b 9B | 49.9% | Three-shot, text-only, float16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 630 | amazingvince/Not-WizardLM-2-7B 7.2B | 49.9% | Three-shot, text-only, bfloat16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 631 | google/medgemma-4b-it 4.3B | 49.9% | Three-shot, text-only, bfloat16, 2025-07-15 | Jul 2025 | huggingface.co | Official leaderboard | |
| 632 | CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it 4.3B | 49.8% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 633 | | 49.6% | Three-shot, text-only, bfloat16, 2024-02-05 | Mar 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 634 | cognitivecomputations/dolphin-2.9-llama3-8b 8B | 49.6% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 635 | alvarobartt/mistral-7b-orpo-alignment-handbook 7.2B | 49.6% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 636 | cosmicvalor/mistral-orthogonalized 7.2B | 49.6% | Three-shot, text-only, float16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 637 | J-AI/Mistral_7b_ptbr_icatalogo 7.2B | 49.6% | Three-shot, text-only, float16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 638 | princeton-nlp/Mistral-7B-Instruct-IPO 7.2B | 49.6% | Three-shot, text-only, rev: 32ad99c, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 639 | deepcogito/cogito-v1-preview-llama-3B 3.6B | 49.6% | Three-shot, text-only, bfloat16, 2025-04-09 | Apr 2025 | huggingface.co | Official leaderboard | |
| 640 | chujiezheng/Mistral7B-PairRM-SPPO-ExPO 7.2B | 49.5% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 641 | stabilityai/stablelm-2-12b-chat 12.1B | 49.4% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 642 | lucianosb/boto-7B-v1.1 7.2B | 49.4% | Three-shot, text-only, float16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 643 | cognitivecomputations/dolphin-2.9.3-mistral-7B-32k 7.3B | 49.4% | Three-shot, text-only, bfloat16, 2024-06-30 | Jun 2024 | huggingface.co | Official leaderboard | |
| 644 | failspy/Codestral-22B-v0.1-abliterated-v3 22.3B | 49.4% | Three-shot, text-only, bfloat16, 2024-07-02 | Jul 2024 | huggingface.co | Official leaderboard | |
| 645 | kaist-ai/janus-orpo-7b 7.2B | 49.4% | Three-shot, text-only, bfloat16, 2024-10-09 | Oct 2024 | huggingface.co | Official leaderboard | |
| 646 | BSC-LT/salamandra-7b-instruct 7.8B | 49.4% | Three-shot, text-only, bfloat16, 2025-04-04 | Apr 2025 | huggingface.co | Official leaderboard | |
| 647 | microsoft/Phi-4-mini-instruct 3.8B | 49.4% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 648 | rhaymison/Mistral-portuguese-luana-7b-chat 7.2B | 49.2% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 649 | Walmart-the-bag/Quintellect-10.7B 10.7B | 49.2% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 650 | adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4 8B | 49.2% | Three-shot, text-only, bfloat16, 2024-04-24 | Apr 2024 | huggingface.co | Official leaderboard | |
| 651 | lucianosb/boto-7B-v1.2 7.3B | 49.2% | Three-shot, text-only, bfloat16, 2024-05-24 | May 2024 | huggingface.co | Official leaderboard | |
| 652 | GritLM/GritLM-7B 7.2B | 49.2% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | huggingface.co | Official leaderboard | |
| 653 | ValiantLabs/Llama3.1-8B-ShiningValiant2 8B | 49.2% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 654 | mlabonne/AlphaMonarch-7B 7.2B | 49.1% | Three-shot, text-only, float16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 655 | alvarobartt/mistral-7b-orpo-capybara-reproduction 7.2B | 49% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 656 | | 49% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 657 | Xwin-LM/Xwin-LM-13B-V0.2 13B | 49% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 658 | | 48.8% | Three-shot, text-only, float16, 2024-04-18 | Sep 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 659 | TencentARC/Mistral_Pro_8B_v0.1 9B | 48.8% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | huggingface.co | Official leaderboard | |
| 660 | lucianosb/boto-7B 7.2B | 48.8% | Three-shot, text-only, float16, 2024-04-10 | Apr 2024 | huggingface.co | Official leaderboard | |
| 661 | Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0 8B | 48.8% | Three-shot, text-only, bfloat16, 2024-07-13 | Jul 2024 | huggingface.co | Official leaderboard | |
| 662 | princeton-nlp/Mistral-7B-Base-SFT-IPO 7.2B | 48.8% | Three-shot, text-only, rev: eea7817, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 663 | princeton-nlp/Mistral-7B-Base-SFT-KTO 7.2B | 48.8% | Three-shot, text-only, rev: 02148bb, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 664 | cnmoro/Mistral-7B-Portuguese 7.2B | 48.7% | Three-shot, text-only, float16, 2024-03-04 | Mar 2024 | huggingface.co | Official leaderboard | |
| 665 | princeton-nlp/Mistral-7B-Base-SFT-SimPO 7.2B | 48.7% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 666 | recogna-nlp/internlm-chatbode2-7b-alpha 8.4B | 48.7% | Three-shot, text-only, float16, 2024-06-12 | Jun 2024 | huggingface.co | Official leaderboard | |
| 667 | ghost-x/ghost-8b-beta-1608 8B | 48.7% | Three-shot, text-only, bfloat16, 2024-08-18 | Aug 2024 | huggingface.co | Official leaderboard | |
| 668 | allenai/OLMo-2-1124-7B 7.3B | 48.7% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 669 | rhaymison/Mistral-portuguese-luana-7b-mental-health 7.2B | 48.5% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 670 | alvarobartt/mistral-orpo-mix 7.2B | 48.5% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 671 | princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF 7.2B | 48.5% | Three-shot, text-only, rev: 65d2cc4, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 672 | HuggingFaceTB/SmolLM3-3B 3.1B | 48.5% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 673 | cognitivecomputations/WizardLM-30B-Uncensored 32.5B | 48.4% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 674 | Xwin-LM/Xwin-LM-13B-V0.1 13B | 48.4% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 675 | CohereForAI/aya-23-8B 8B | 48.4% | Three-shot, text-only, float16, 2024-05-23 | May 2024 | huggingface.co | Official leaderboard | |
| 676 | artificialguybr/OpenHermesV2-PTBR 7.2B | 48.4% | Three-shot, text-only, float16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 677 | princeton-nlp/Mistral-7B-Base-SFT-RDPO 7.2B | 48.4% | Three-shot, text-only, rev: 2a63a6d, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 678 | Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0 7.3B | 48.3% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 679 | amazon/MegaBeam-Mistral-7B-300k 7.2B | 48.3% | Three-shot, text-only, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 680 | allenai/OLMo-2-1124-7B-Instruct 7.3B | 48.3% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 681 | allenai/tulu-2-dpo-13b 13B | 48.1% | Three-shot, text-only, bfloat16, 2024-03-05 | Mar 2024 | huggingface.co | Official leaderboard | |
| 682 | rhaymison/Qwen-portuguese-luana-7b 7.7B | 48.1% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 683 | lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half 8B | 48.1% | Three-shot, text-only, rev: b82150a, bfloat16, 2024-06-14 | Jun 2024 | huggingface.co | Official leaderboard | |
| 684 | eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1 8B | 48.1% | Three-shot, text-only, bfloat16, 2024-07-09 | Jul 2024 | huggingface.co | Official leaderboard | |
| 685 | eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6 8.8B | 48.1% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 686 | | 48.1% | Three-shot, text-only, bfloat16, 2024-08-09 | Jul 2024 | Aug 2024 | huggingface.co | Official leaderboard |
| 687 | princeton-nlp/Mistral-7B-Base-SFT-CPO 7.2B | 48.1% | Three-shot, text-only, rev: 7f67394, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 688 | tiiuae/Falcon-H1-1.5B-Base 1.6B | 48.1% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 689 | | 48% | Three-shot, text-only, bfloat16, 2024-02-21 | Oct 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 690 | Intel/neural-chat-7b-v3-1 7.2B | 48% | Three-shot, text-only, float16, 2024-02-21 | Feb 2024 | huggingface.co | Official leaderboard | |
| 691 | JJhooww/MistralReloadBR_v2_ptbr 7.2B | 48% | Three-shot, text-only, bfloat16, 2024-03-08 | Mar 2024 | huggingface.co | Official leaderboard | |
| 692 | rhaymison/Mistral-portuguese-luana-7b 7.2B | 48% | Three-shot, text-only, bfloat16, 2024-04-08 | Apr 2024 | huggingface.co | Official leaderboard | |
| 693 | hkust-nlp/deita-7b-v1.0-sft 7.2B | 48% | Three-shot, text-only, bfloat16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 694 | CohereForAI/aya-101 12.9B | 47.8% | Three-shot, text-only, float16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 695 | royallab/ZephRP-m7b 7.2B | 47.8% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 696 | ValiantLabs/Llama3.1-8B-Fireplace2 8B | 47.8% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 697 | maritaca-ai/sabia-7b 6.7B | 47.7% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 698 | internlm/internlm2-base-7b 7.7B | 47.7% | Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 699 | | 47.7% | Three-shot, text-only, bfloat16, 2024-04-07 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 700 | deepseek-ai/DeepSeek-V2-Lite-Chat 15.7B | 47.7% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 701 | meta-llama/Llama-2-70b-chat-hf 69B | 47.6% | Three-shot, text-only, float16, 2024-02-18 | Feb 2024 | huggingface.co | Official leaderboard | |
| 702 | Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged 7.2B | 47.6% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 703 | kaitchup/Qwen1.5-7B-bnb-4bit 7.7B | 47.6% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 704 | alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt 7.2B | 47.6% | Three-shot, text-only, bfloat16, 2024-04-28 | Apr 2024 | huggingface.co | Official leaderboard | |
| 705 | HuggingFaceH4/zephyr-7b-gemma-v0.1 8.5B | 47.4% | Three-shot, text-only, bfloat16, 2024-03-02 | Mar 2024 | huggingface.co | Official leaderboard | |
| 706 | Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO 7.3B | 47.4% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 707 | | 47.3% | Three-shot, text-only, bfloat16, 2025-07-15 | Jun 2025 | Jul 2025 | huggingface.co | Official leaderboard |
| 708 | recogna-nlp/mistralbode_7b_qlora_ultraalpaca 7.4B | 47.1% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 709 | heloisy/zephyr-7b-cosmosqa-ptbr_text 7.3B | 47.1% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 710 | nicolasdec/Cabramistral7b 7.2B | 47% | Three-shot, text-only, float16, 2024-03-18 | Mar 2024 | huggingface.co | Official leaderboard | |
| 711 | chargoddard/internlm2-base-7b-llama 7.7B | 47% | Three-shot, text-only, rev: refs/pr/2, bfloat16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 712 | tiiuae/falcon-11B 11.1B | 47% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 713 | aws-prototyping/MegaBeam-Mistral-7B-512k 7.2B | 47% | Three-shot, text-only, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 714 | OpenLLM-France/Claire-Mistral-7B-0.1 7.2B | 46.9% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 715 | nicolasdec/CabraMistral7b 7.2B | 46.9% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 716 | maywell/Synatra-7B-v0.3-RP 7.2B | 46.9% | Three-shot, text-only, float16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 717 | matheusrdgsf/cesar-ptbr 1.1B | 46.9% | Three-shot, text-only, GPTQ, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 718 | TheBloke/zephyr-7B-beta-GPTQ 9.6B | 46.9% | Three-shot, text-only, GPTQ, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 719 | 01-ai/Yi-6B-200K 6.1B | 46.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 720 | | 46.6% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 721 | | 46.5% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 722 | | 46.3% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 723 | Qwen/Qwen-7B-Chat 7.7B | 46.2% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 724 | allenai/tulu-2-13b 13B | 46.2% | Three-shot, text-only, bfloat16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 725 | | 46.2% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 726 | rhaymison/Mistral-portuguese-luana-7b-Mathematics 7.2B | 46% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 727 | hkust-nlp/deita-7b-v1.0 7.2B | 45.9% | Three-shot, text-only, bfloat16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 728 | heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3 7.3B | 45.8% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 729 | Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3 8B | 45.8% | Three-shot, text-only, float16, 2024-05-28 | May 2024 | huggingface.co | Official leaderboard | |
| 730 | | 45.6% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 731 | Weni/ZeroShot-Multilanguage-Zephyr-7B 7.3B | 45.6% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 732 | meta-llama/Llama-2-13b-chat-hf 13B | 45.6% | Three-shot, text-only, bfloat16, 2024-04-19 | Apr 2024 | huggingface.co | Official leaderboard | |
| 733 | rhaymison/portuguese-tom-cat-13b 13B | 45.6% | Three-shot, text-only, bfloat16, 2024-05-20 | May 2024 | huggingface.co | Official leaderboard | |
| 734 | rfanucchi/Llama3-pt_br_cabrita 8.1B | 45.6% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | huggingface.co | Official leaderboard | |
| 735 | botbot-ai/CabraMistral-v3-7b-32k 7.3B | 45.6% | Three-shot, text-only, bfloat16, 2024-06-10 | Jun 2024 | huggingface.co | Official leaderboard | |
| 736 | | 45.6% | Three-shot, text-only, 4bit, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 737 | Motif-Technologies/Motif-2.6B 2.6B | 45.6% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 738 | heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2 7.3B | 45.5% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 739 | nvidia/Llama-3.1-Nemotron-Nano-8B-v1 8B | 45.5% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 740 | | 45.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 741 | princeton-nlp/Mistral-7B-Base-SFT-DPO 7.2B | 45.1% | Three-shot, text-only, rev: 17134fd, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 742 | recogna-nlp/zephyr_7b_beta_ultraalpaca 7.4B | 44.9% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 743 | meta-llama/Llama-2-13b-hf 13B | 44.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 744 | adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft 8B | 44.4% | Three-shot, text-only, bfloat16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 745 | lmsys/vicuna-13b-v1.5 13B | 44.2% | Three-shot, text-only, float16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 746 | allenai/tulu-2-7b 7B | 44.2% | Three-shot, text-only, bfloat16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 747 | Motif-Technologies/Motif-2.6b-v1.1-LC 2.6B | 44.2% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 748 | allenai/tulu-2-dpo-7b 7B | 44.1% | Three-shot, text-only, bfloat16, 2024-03-05 | Mar 2024 | huggingface.co | Official leaderboard | |
| 749 | SakanaAI/DiscoPOP-zephyr-7b-gemma 8.5B | 44.1% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 750 | AIDC-AI/Marco-LLM-ES 7.6B | 44.1% | Three-shot, text-only, bfloat16, 2025-02-27 | Feb 2025 | huggingface.co | Official leaderboard | |
| 751 | BAAI/Aquila2-34B 34B | 43.8% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 752 | OliveiraJLT/Sagui-7B-Instruct-v0.1 6.7B | 43.7% | Three-shot, text-only, bfloat16, 2024-07-18 | Jul 2024 | huggingface.co | Official leaderboard | |
| 753 | THUDM/chatglm3-6b-32k 6.2B | 43.5% | Three-shot, text-only, float16, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 754 | | 43.4% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 755 | GuiCas/Phituguese_FP16 3.8B | 43.3% | Three-shot, text-only, float16, 2024-06-04 | Jun 2024 | huggingface.co | Official leaderboard | |
| 756 | abacusai/Liberated-Qwen1.5-14B 14.2B | 43.1% | Three-shot, text-only, float16, 2024-06-12 | Jun 2024 | huggingface.co | Official leaderboard | |
| 757 | google/medgemma-4b-pt 4.3B | 42.8% | Three-shot, text-only, bfloat16, 2025-07-15 | Jul 2025 | huggingface.co | Official leaderboard | |
| 758 | xverse/XVERSE-13B 13.7B | 42.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 759 | rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct 3.8B | 42.6% | Three-shot, text-only, float16, 2024-05-23 | May 2024 | huggingface.co | Official leaderboard | |
| 760 | 01-ai/Yi-Coder-9B-Chat 9B | 42.6% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 761 | LFM2-1.2B | 42.3% | Three-shot, text-only, bfloat16, 2025-08-30 | Jul 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 762 | kurakurai/Luth-0.6B-Instruct 0.6B | 42.3% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 763 | Deci/DeciLM-7B 7B | 42% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 764 | J-LAB/Brisa_v0.2_sft 7.2B | 41.9% | Three-shot, text-only, float16, 2024-10-26 | Oct 2024 | huggingface.co | Official leaderboard | |
| 765 | google/gemma-2-2b 2.6B | 41.7% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 766 | dfurman/Llama-3-8B-Orpo-v0.1 8B | 41.7% | Three-shot, text-only, float16, 2024-08-22 | Aug 2024 | huggingface.co | Official leaderboard | |
| 767 | kurakurai/Luth-LFM2-1.2B 1.2B | 41.7% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 768 | | 41.6% | Three-shot, text-only, bfloat16, 2024-05-27 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 769 | LiquidAI/LFM2-700M 0.7B | 41.6% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 770 | Qwen/Qwen1.5-MoE-A2.7B 14.3B | 41.5% | Three-shot, text-only, bfloat16, 2024-04-12 | Apr 2024 | huggingface.co | Official leaderboard | |
| 771 | lmsys/vicuna-7b-v1.5 7B | 41.3% | Three-shot, text-only, float16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 772 | rfanucchi/Llama3-pt_br_cabrit_orca_qkvo 8.1B | 41.3% | Three-shot, text-only, bfloat16, 2024-06-04 | Jun 2024 | huggingface.co | Official leaderboard | |
| 773 | princeton-nlp/Mistral-7B-Base-SFT-RRHF 7.2B | 41.3% | Three-shot, text-only, rev: 0d58610, bfloat16, 2024-10-07 | Oct 2024 | huggingface.co | Official leaderboard | |
| 774 | tiiuae/Falcon3-3B-Base 3.2B | 41.2% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | huggingface.co | Official leaderboard | |
| 775 | nicolasdec/cabra13b 13B | 40.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 776 | recogna-nlp/phibode-3-mini-4k-ultraalpaca 3.8B | 40.8% | Three-shot, text-only, float16, 2024-05-05 | May 2024 | huggingface.co | Official leaderboard | |
| 777 | TIGER-Lab/Qwen2.5-Math-7B-CFT 7.6B | 40.8% | Three-shot, text-only, bfloat16, 2025-03-07 | Mar 2025 | huggingface.co | Official leaderboard | |
| 778 | Xwin-LM/Xwin-LM-7B-V0.1 7B | 40.6% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 779 | lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full 8B | 40.6% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | huggingface.co | Official leaderboard | |
| 780 | X-D-Lab/XrayQwen 9.7B | 40.5% | Three-shot, text-only, rev: 3f477a4, float16, 2024-09-18 | Sep 2024 | huggingface.co | Official leaderboard | |
| 781 | LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct 7.8B | 40.3% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 782 | baichuan-inc/Baichuan2-7B-Base 7.5B | 40.1% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 783 | kurakurai/Luth-LFM2-700M 0.7B | 40.1% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 784 | recogna-nlp/mistral-bode 7.3B | 39.8% | Three-shot, text-only, float16, 2024-04-04 | Apr 2024 | huggingface.co | Official leaderboard | |
| 785 | adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2 8B | 39.8% | Three-shot, text-only, bfloat16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 786 | 01-ai/Yi-Coder-9B 8.8B | 39.5% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 787 | h2oai/h2o-danube3.1-4b-chat 4B | 39.1% | Three-shot, text-only, bfloat16, 2024-12-05 | Dec 2024 | huggingface.co | Official leaderboard | |
| 788 | migtissera/Tess-3-Mistral-Nemo-12B 12.3B | 38.9% | Three-shot, text-only, bfloat16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 789 | xverse/XVERSE-65B-2 66.4B | 38.8% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 790 | | 38.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Jun 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 791 | AdaptLLM/finance-LLM-13B 13B | 38.5% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 792 | deepseek-ai/deepseek-llm-7b-base 7B | 38.4% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 793 | recogna-nlp/bode-13b-alpaca-pt-br 13B | 38.3% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 794 | h2oai/h2o-danube3-4b-chat 4B | 38.3% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 795 | J-LAB/FluxiIA-Small_Brisa 7.2B | 38.3% | Three-shot, text-only, float16, 2024-11-16 | Nov 2024 | huggingface.co | Official leaderboard | |
| 796 | AdaptLLM/law-LLM-13B 13B | 38% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 797 | deepseek-ai/deepseek-moe-16b-chat 16.4B | 38% | Three-shot, text-only, bfloat16, 2024-04-13 | Apr 2024 | huggingface.co | Official leaderboard | |
| 798 | xverse/XVERSE-65B 66.4B | 37.8% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 799 | ghost-x/ghost-8b-beta 8B | 37.7% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 800 | gpt-oss-20b | 37.7% | Three-shot, text-only, bfloat16, 2025-08-29 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 801 | | 37.5% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 802 | AdaptLLM/medicine-LLM-13B 13B | 37.5% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 803 | Xwin-LM/Xwin-LM-7B-V0.2 7B | 37.4% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 804 | haoranxu/ALMA-13B-Pretrain 13B | 37.3% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | huggingface.co | Official leaderboard | |
| 805 | rfanucchi/Llama3-pt_br_orca 8.1B | 37% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 806 | xverse/XVERSE-7B 7.3B | 36.9% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 807 | THUDM/agentlm-7b 6.7B | 36.7% | Three-shot, text-only, float16, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 808 | Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized 7.3B | 36.6% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 809 | recogna-nlp/gembode-7b-it 8.7B | 36.6% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 810 | h2oai/h2o-danube3-4b-base 4B | 36.4% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 811 | tanliboy/lambda-qwen2.5-32b-dpo-test 32.8B | 36.4% | Three-shot, text-only, bfloat16, 2024-09-30 | Sep 2024 | huggingface.co | Official leaderboard | |
| 812 | NousResearch/Nous-Hermes-13b 13B | 36.3% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 813 | Qwen/Qwen1.5-4B 4B | 36.2% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 814 | eduagarcia/gemma-7b-it_no_chat_template 8.5B | 36% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | huggingface.co | Official leaderboard | |
| 815 | stabilityai/stablelm-zephyr-3b 2.8B | 36% | Three-shot, text-only, bfloat16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 816 | | 36% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 817 | ChatGLM3-6B | 35.6% | Three-shot, text-only, float16, 2024-02-19 | Oct 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 818 | THUDM/chatglm3-6b-128k 6.2B | 35.5% | Three-shot, text-only, float16, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 819 | Qwen/Qwen2.5-0.5B-Instruct 0.5B | 35.5% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 820 | cnmoro/Qwen2.5-0.5B-Portuguese-v1 0.5B | 34.6% | Three-shot, text-only, float16, 2025-02-25 | Feb 2025 | huggingface.co | Official leaderboard | |
| 821 | | 34.5% | Three-shot, text-only, bfloat16, 2024-06-07 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 822 | THUDM/LongAlign-7B-64k 7B | 33.7% | Three-shot, text-only, float16, 2024-04-05 | Apr 2024 | huggingface.co | Official leaderboard | |
| 823 | internlm-7b | 33.5% | Three-shot, text-only, float16, 2024-02-05 | Jul 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 824 | nicolasdec/Cabra 6.7B | 33.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 825 | stabilityai/stablelm-2-1_6b-chat 1.7B | 33.2% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 826 | cognitivecomputations/dolphin-2.9.3-llama-3-8b 8B | 33.2% | Three-shot, text-only, bfloat16, 2024-07-02 | Jul 2024 | huggingface.co | Official leaderboard | |
| 827 | | 33% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 828 | | 32.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 829 | rhaymison/Llama-portuguese-13b-Luana-v0.2 13B | 32.7% | Three-shot, text-only, bfloat16, 2024-04-08 | Apr 2024 | huggingface.co | Official leaderboard | |
| 830 | cognitivecomputations/dolphin-2.9.1-mixtral-1x22b 22.2B | 32.7% | Three-shot, text-only, bfloat16, 2024-05-24 | May 2024 | huggingface.co | Official leaderboard | |
| 831 | BAAI/OPI-Llama-3.1-8B-Instruct 8B | 32.7% | Three-shot, text-only, bfloat16, 2024-09-21 | Sep 2024 | huggingface.co | Official leaderboard | |
| 832 | stabilityai/stablelm-2-zephyr-1_6b 1.7B | 32.4% | Three-shot, text-only, float16, 2024-02-27 | Feb 2024 | huggingface.co | Official leaderboard | |
| 833 | internlm/internlm2-chat-1_8b 1.9B | 32.3% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 834 | internlm/internlm2_5-1_8b 8B | 32.3% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 835 | internlm/internlm2-chat-1_8b-sft 1.9B | 32.1% | Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 836 | internlm/internlm2-1_8b 8B | 31.7% | Three-shot, text-only, bfloat16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 837 | cognitivecomputations/WizardLM-13B-Uncensored 13B | 31.7% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 838 | AdaptLLM/law-LLM 6.7B | 31.6% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 839 | internlm/internlm2_5-1_8b-chat 1.9B | 31.6% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 840 | | 31.6% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 841 | haoranxu/ALMA-13B-R 13B | 31.4% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | huggingface.co | Official leaderboard | |
| 842 | google/recurrentgemma-2b-it 2.7B | 31.4% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 843 | Oburaco/llama2-qlora-finetunined-ptbr 6.8B | 31.4% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 844 | TinyPixel/Llama-2-7B-bf16-sharded 6.7B | 31.4% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 845 | rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora 8.1B | 31.4% | Three-shot, text-only, 4bit, 2024-09-27 | Sep 2024 | huggingface.co | Official leaderboard | |
| 846 | unsloth/Llama-3.2-1B-Instruct 1.2B | 31.4% | Three-shot, text-only, float16, 2024-11-24 | Nov 2024 | huggingface.co | Official leaderboard | |
| 847 | cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning 0.5B | 31.4% | Three-shot, text-only, float16, 2025-03-08 | Mar 2025 | huggingface.co | Official leaderboard | |
| 848 | meta-llama/Llama-2-7b-hf 6.7B | 31.3% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 849 | AdaptLLM/medicine-LLM 6.7B | 31.3% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 850 | kurakurai/Luth-LFM2-350M 0.4B | 31% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 851 | recogna-nlp/internlm2-chat-1_8b-ultracabrita 8B | 30.7% | Three-shot, text-only, float16, 2024-05-05 | May 2024 | huggingface.co | Official leaderboard | |
| 852 | Unbabel/TowerBase-7B-v0.1 6.7B | 30.6% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 853 | tensoropera/Fox-1-1.6B-Instruct-v0.1 1.7B | 30.6% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 854 | meta-llama/Llama-3.2-1B-Instruct 1.2B | 30.6% | Three-shot, text-only, bfloat16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 855 | deepseek-ai/deepseek-moe-16b-base 16.4B | 30.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 856 | google/gemma-7b-it 8.5B | 30.3% | Three-shot, text-only, rev: float16, float16, 2024-02-23 | Feb 2024 | huggingface.co | Official leaderboard | |
| 857 | | 30.3% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 858 | tiiuae/Falcon-H1-0.5B-Instruct 0.5B | 30.3% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 859 | GeneZC/MiniMA-2-3B 3B | 30.2% | Three-shot, text-only, float16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 860 | chatglm2-6b | 29.9% | Three-shot, text-only, float16, 2024-04-05 | Jun 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 861 | stabilityai/stablelm-3b-4e1t 2.8B | 29.9% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 862 | dominguesm/canarim-7b 7B | 29.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 863 | stabilityai/stablelm-base-alpha-7b-v2 6.9B | 29.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 864 | Qwen/Qwen1.5-1.8B-Chat 1.8B | 29.8% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 865 | NTQAI/Nxcode-CQ-7B-orpo 7.3B | 29.6% | Three-shot, text-only, bfloat16, 2024-08-10 | Aug 2024 | huggingface.co | Official leaderboard | |
| 866 | deepseek-ai/DeepSeek-R1-Distill-Llama-8B 8B | 29.6% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | huggingface.co | Official leaderboard | |
| 867 | LiquidAI/LFM2-350M 0.4B | 29.5% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 868 | lrds-code/boana-7b-instruct 6.7B | 29.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 869 | | 29.2% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 870 | AdaptLLM/finance-LLM 6.7B | 29.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 871 | semantixai/LloroV2 6.7B | 29.1% | Three-shot, text-only, bfloat16, 2024-03-13 | Mar 2024 | huggingface.co | Official leaderboard | |
| 872 | meta-llama/Llama-2-7b-chat-hf 6.7B | 29.1% | Three-shot, text-only, bfloat16, 2024-04-19 | Apr 2024 | huggingface.co | Official leaderboard | |
| 873 | rhaymison/gemma-portuguese-tom-cat-2b-it 2.5B | 29.1% | Three-shot, text-only, float16, 2024-04-29 | Apr 2024 | huggingface.co | Official leaderboard | |
| 874 | recogna-nlp/bode-7b-alpaca-pt-br 7B | 28.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 875 | langtech-languagemodeling/IberianLLM-7B-Instruct 7.8B | 28.9% | Three-shot, text-only, bfloat16, 2025-07-14 | Jul 2025 | huggingface.co | Official leaderboard | |
| 876 | Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT 7.3B | 28.8% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 877 | Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT 7.2B | 28.8% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 878 | GeneZC/MiniLoong-3B 3B | 28.8% | Three-shot, text-only, float16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 879 | | 28.4% | Three-shot, text-only, bfloat16, 2024-02-21 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 880 | h2oai/h2o-danube2-1.8b-base 1.8B | 28.4% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 881 | nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 4.5B | 28.4% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 882 | baichuan-inc/Baichuan2-13B-Base 13.9B | 28.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 883 | AI-Sweden-Models/gpt-sw3-40b 39.9B | 28.1% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 884 | mosaicml/mpt-7b-8k 7B | 28.1% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 885 | h2oai/h2o-danube2-1.8b-chat 1.8B | 28.1% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 886 | BAAI/Aquila-7B 7.3B | 28% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 887 | pfnet/plamo-13b 13.1B | 27.7% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 888 | unsloth/gemma-2b-bnb-4bit 2.5B | 27.4% | Three-shot, text-only, 4bit, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 889 | cognitivecomputations/dolphin-2.9.4-llama3.1-8b 8B | 27.4% | Three-shot, text-only, bfloat16, 2024-08-25 | Aug 2024 | huggingface.co | Official leaderboard | |
| 890 | BSC-LT/salamandra-7b 7.8B | 27.1% | Three-shot, text-only, bfloat16, 2025-04-04 | Apr 2025 | huggingface.co | Official leaderboard | |
| 891 | baidu/ERNIE-4.5-0.3B-Base-PT 0.4B | 27.1% | Three-shot, text-only, bfloat16, 2025-08-31 | Aug 2025 | huggingface.co | Official leaderboard | |
| 892 | | 27% | Three-shot, text-only, float16, 2024-02-05 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 893 | nbeerbower/gemma2-gutenberg-27B 27.2B | 26.8% | Three-shot, text-only, bfloat16, 2024-09-15 | Sep 2024 | huggingface.co | Official leaderboard | |
| 894 | TucanoBR/Tucano-630m 0.6B | 26.8% | Three-shot, text-only, float16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 895 | cnmoro/Qwen2.5-0.5B-Portuguese-v2 0.5B | 26.8% | Three-shot, text-only, float16, 2025-03-08 | Mar 2025 | huggingface.co | Official leaderboard | |
| 896 | DAMO-NLP-MT/polylm-1.7b 1.7B | 26.6% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 897 | Oburaco/ptbr-falcon-7b 7B | 26.6% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 898 | Baichuan2-13B-Chat | 26.3% | Three-shot, text-only, bfloat16, 2024-05-27 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 899 | Qwen-1_8B | 26.3% | Three-shot, text-only, float16, 2024-04-18 | Nov 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 900 | dominguesm/Canarim-7B-Instruct 7B | 26.1% | Three-shot, text-only, float16, 2024-02-23 | Feb 2024 | huggingface.co | Official leaderboard | |
| 901 | google/recurrentgemma-2b 2.7B | 26.1% | Three-shot, text-only, float16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 902 | recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora 8B | 26% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 903 | tiiuae/Falcon3-1B-Base 1.7B | 26% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | huggingface.co | Official leaderboard | |
| 904 | BSC-LT/salamandra-2b 2.3B | 26% | Three-shot, text-only, bfloat16, 2025-04-04 | Apr 2025 | huggingface.co | Official leaderboard | |
| 905 | OpenLLM-France/Claire-7B-0.1 7B | 25.9% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 906 | google/gemma-2b-it 2.5B | 25.9% | Three-shot, text-only, bfloat16, 2024-02-21 | Feb 2024 | huggingface.co | Official leaderboard | |
| 907 | recogna-nlp/gembode-2b-ultraalpaca 2.5B | 25.9% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 908 | AI-Sweden-Models/gpt-sw3-6.7b 7.1B | 25.7% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 909 | nicholasKluge/TeenyTinyLlama-460m 0.5B | 25.7% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 910 | recogna-nlp/qwenbode_1_8b_chat_ultraalpaca 8B | 25.7% | Three-shot, text-only, float16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 911 | | 25.6% | Three-shot, text-only, float16, 2024-02-05 | May 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 912 | stabilityai/stablelm-2-1_6b 1.7B | 25.6% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 913 | TucanoBR/Tucano-1b1 1.1B | 25.6% | Three-shot, text-only, float16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 914 | gpt-oss-120b | 25.6% | Three-shot, text-only, bfloat16, 2025-08-29 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 915 | nicholasKluge/TeenyTinyLlama-460m-Chat 0.5B | 25.4% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 916 | Qwen/Qwen1.5-0.5B-Chat 0.6B | 25.4% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 917 | allenai/OLMo-2-0425-1B 1.5B | 25.4% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 918 | cerebras/btlm-3b-8k-base 3B | 25.3% | Three-shot, text-only, bfloat16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 919 | recogna-nlp/GemBode-2b-it 2.5B | 25.3% | Three-shot, text-only, float16, 2024-03-14 | Mar 2024 | huggingface.co | Official leaderboard | |
| 920 | recogna-nlp/Phi-Bode 2.8B | 25.3% | Three-shot, text-only, float16, 2024-03-14 | Mar 2024 | huggingface.co | Official leaderboard | |
| 921 | | 25.3% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 922 | GeneZC/MiniMA-3B 3B | 25.3% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 923 | TheDrummer/Big-Tiger-Gemma-27B-v1 27.2B | 25.3% | Three-shot, text-only, rev: 892ca94, bfloat16, 2024-09-29 | Sep 2024 | huggingface.co | Official leaderboard | |
| 924 | croissantllm/CroissantLLMBase 1.4B | 25.2% | Three-shot, text-only, float16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 925 | Qwen/Qwen1.5-1.8B 1.8B | 25.2% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 926 | recogna-nlp/phi-bode-2-ultraalpaca 2.8B | 25.2% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 927 | MulaBR/Mula-4x160-v0.1 0.4B | 25.2% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 928 | anthracite-org/magnum-v4-9b 9.2B | 25.2% | Three-shot, text-only, bfloat16, 2024-10-24 | Oct 2024 | huggingface.co | Official leaderboard | |
| 929 | TucanoBR/Tucano-160m 0.2B | 25.2% | Three-shot, text-only, float16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 930 | RedPajama-INCITE-7B-Base | 25% | Three-shot, text-only, float16, 2024-02-05 | May 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 931 | openlm-research/open_llama_7b_v2 7B | 25% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 932 | TucanoBR/Tucano-2b4 2.4B | 25% | Three-shot, text-only, float16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 933 | microsoft/phi-1 1.4B | 24.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 934 | | 24.9% | Three-shot, text-only, bfloat16, 2024-04-07 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 935 | rhaymison/gemma-portuguese-luana-2b 2.5B | 24.9% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 936 | h2oai/h2o-danube2-1.8b-sft 1.8B | 24.9% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | huggingface.co | Official leaderboard | |
| 937 | | 24.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 938 | openlm-research/open_llama_13b 13B | 24.8% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 939 | TheBloke/wizardLM-7B-HF 7B | 24.8% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 940 | togethercomputer/RedPajama-INCITE-Base-3B-v1 3B | 24.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 941 | haoranxu/ALMA-7B-R 6.8B | 24.6% | Three-shot, text-only, bfloat16, 2024-07-29 | Jul 2024 | huggingface.co | Official leaderboard | |
| 942 | Bruno/Caramelo_7B 7.1B | 24.5% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | huggingface.co | Official leaderboard | |
| 943 | Weni/WeniGPT-Mistral-7B-instructBase-4bit 7.3B | 24.5% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 944 | tensoropera/Fox-1-1.6B 1.7B | 24.5% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 945 | Ramikan-BR/Qwen2-0.5B-v5 0.5B | 24.3% | Three-shot, text-only, rev: ce92f05, float16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 946 | tiiuae/Falcon-H1-0.5B-Base 0.5B | 24.3% | Three-shot, text-only, bfloat16, 2025-07-08 | Jul 2025 | huggingface.co | Official leaderboard | |
| 947 | | 24.2% | Three-shot, text-only, float16, 2024-02-11 | Mar 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 948 | facebook/galactica-30b 30B | 24.2% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 949 | recogna-nlp/gembode-2b-base-ultraalpaca 2.5B | 24.2% | Three-shot, text-only, float16, 2024-04-22 | Apr 2024 | huggingface.co | Official leaderboard | |
| 950 | yahma/llama-7b-hf 7B | 24.2% | Three-shot, text-only, float16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 951 | fernandosola/bluearara-7B-instruct 7.2B | 24.1% | Three-shot, text-only, bfloat16, 2024-03-08 | Mar 2024 | huggingface.co | Official leaderboard | |
| 952 | Ramikan-BR/Qwen2-0.5B-v9 0.5B | 24.1% | Three-shot, text-only, rev: 51d076f, float16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 953 | TinyLlama/TinyLlama_v1.1 1.1B | 24.1% | Three-shot, text-only, float16, 2024-07-25 | Jul 2024 | huggingface.co | Official leaderboard | |
| 954 | Emu3-Chat | 24.1% | Three-shot, text-only, bfloat16, 2024-10-21 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 955 | | 23.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 956 | matsuo-lab/weblab-10b 10.7B | 23.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 957 | Oburaco/ptbr-falcon-7b-v3 7B | 23.9% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 958 | vilsonrodrigues/falcon-7b-instruct-sharded 6.9B | 23.9% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 959 | GPT-J-6B | 23.6% | Three-shot, text-only, float16, 2024-02-05 | Aug 2021 | Feb 2024 | huggingface.co | Official leaderboard |
| 960 | bigscience/bloom-7b1 7.1B | 23.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 961 | EleutherAI/pythia-410m 0.5B | 23.6% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 962 | allenai/OLMo-7B-Twin-2T 6.9B | 23.6% | Three-shot, text-only, float16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 963 | | 23.5% | Three-shot, text-only, float16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 964 | AI-Sweden-Models/gpt-sw3-6.7b-v2 7.1B | 23.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 965 | Weni/WeniGPT-Mistral-7B-instructBase 7.3B | 23.5% | Three-shot, text-only, float16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 966 | M4-ai/tau-1.8B 1.8B | 23.5% | Three-shot, text-only, bfloat16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 967 | cognitivecomputations/WizardLM-7B-Uncensored 7B | 23.5% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 968 | RogerioPiazzon/alpaca-lora-ptbr-7b 7B | 23.5% | Three-shot, text-only, float16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 969 | projecte-aina/FLOR-760M 0.8B | 23.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 970 | facebook/xglm-4.5B 5.1B | 23.4% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 971 | | 23.4% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 972 | NucleusAI/nucleus-22B-token-500B 21.8B | 23.2% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 973 | ericzzz/falcon-rw-1b-instruct-openorca 1.3B | 23.2% | Three-shot, text-only, bfloat16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 974 | lucianosb/boto-27B 27.2B | 23.2% | Three-shot, text-only, bfloat16, 2024-07-12 | Jul 2024 | huggingface.co | Official leaderboard | |
| 975 | 22h/cabrita_7b_pt_850000 7B | 23.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 976 | nicholasKluge/TeenyTinyLlama-160m 0.2B | 23.1% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 977 | openlm-research/open_llama_3b_v2 3.4B | 22.9% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 978 | fernandosola/bluearara-7B 7.2B | 22.9% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 979 | Oburaco/juridic-falcon-7b 7B | 22.9% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 980 | GPT-NeoX-20B | 22.8% | Three-shot, text-only, float16, 2024-02-05 | Apr 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 981 | TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T 1.1B | 22.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 982 | TechxGenus/Jamba-v0.1-9B 9.3B | 22.8% | Three-shot, text-only, bfloat16, 2024-05-29 | May 2024 | huggingface.co | Official leaderboard | |
| 983 | | 22.8% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 984 | TucanoBR/Tucano-2b4-Instruct 2.4B | 22.8% | Three-shot, text-only, float16, 2024-12-03 | Dec 2024 | huggingface.co | Official leaderboard | |
| 985 | utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview 2.6B | 22.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 986 | | 22.7% | Three-shot, text-only, bfloat16, 2024-02-05 | May 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 987 | stabilityai/stablelm-base-alpha-3b-v2 2.8B | 22.7% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 988 | cerebras/Cerebras-GPT-590M 0.6B | 22.7% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 989 | EleutherAI/pythia-12b 12B | 22.7% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 990 | h2oai/h2o-danube-1.8b-base 1.8B | 22.7% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 991 | AI-Sweden-Models/gpt-sw3-20b 20.9B | 22.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 992 | EleutherAI/pythia-2.8b-deduped 2.9B | 22.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 993 | unicamp-dl/ptt5-base-portuguese-vocab 0.2B | 22.5% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 994 | unicamp-dl/ptt5-small-portuguese-vocab 0.1B | 22.5% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 995 | state-spaces/mamba-790m-hf 0.8B | 22.5% | Three-shot, text-only, float16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 996 | | 22.5% | Three-shot, text-only, bfloat16, 2024-06-07 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 997 | baidu/ERNIE-4.5-0.3B-PT 0.4B | 22.5% | Three-shot, text-only, bfloat16, 2025-08-31 | Aug 2025 | huggingface.co | Official leaderboard | |
| 998 | EleutherAI/pythia-2.8b 2.9B | 22.4% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 999 | nicolasdec/CabraMistral7b-0.4 7.2B | 22.4% | Three-shot, text-only, float16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1000 | proxectonos/FLOR-1.3B-GL 1.3B | 22.4% | Three-shot, text-only, float16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1001 | utter-project/EuroLLM-1.7B 1.7B | 22.4% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | huggingface.co | Official leaderboard | |
| 1002 | openlm-research/open_llama_3b 3.4B | 22.3% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1003 | | 22.3% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 1004 | EleutherAI/pythia-6.9b-deduped 6.9B | 22.1% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1005 | cerebras/Cerebras-GPT-6.7B 6.7B | 22.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1006 | Bruno/Caramelinho 7.1B | 22.1% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1007 | GeneZC/MiniMA-2-1B 1.4B | 22.1% | Three-shot, text-only, float16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1008 | | 22% | Three-shot, text-only, bfloat16, 2024-02-05 | Apr 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 1009 | open_llama_7b | 22% | Three-shot, text-only, float16, 2024-02-11 | Jun 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 1010 | Ramikan-BR/TiamaPY-v31 1.1B | 22% | Three-shot, text-only, rev: d4612a5, float16, 2024-06-20 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1011 | facebook/opt-30b 30B | 21.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1012 | Ramikan-BR/TiamaPY-v30 1.1B | 21.8% | Three-shot, text-only, rev: 300C415, float16, 2024-06-19 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1013 | fernandosola/bluearara-7B-instruct-v02 7.2B | 21.8% | Three-shot, text-only, bfloat16, 2024-12-30 | Dec 2024 | huggingface.co | Official leaderboard | |
| 1014 | GPT-Neo-2.7B | 21.7% | Three-shot, text-only, float16, 2024-02-05 | Mar 2021 | Feb 2024 | huggingface.co | Official leaderboard |
| 1015 | LiteAI/Hare-1.1B-base 1.1B | 21.7% | Three-shot, text-only, float16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1016 | projecte-aina/FLOR-6.3B 6.3B | 21.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1017 | facebook/galactica-6.7b 6.7B | 21.6% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1018 | TinyLlama/TinyLlama-1.1B-Chat-v1.0 1.1B | 21.6% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1019 | recogna-nlp/gembode-2b-ultraalpaca-qlora 2.6B | 21.6% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1020 | utter-project/EuroLLM-1.7B-Instruct 1.7B | 21.6% | Three-shot, text-only, float16, 2025-02-21 | Feb 2025 | huggingface.co | Official leaderboard | |
| 1021 | bigscience/bloom-1b7 1.7B | 21.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1022 | openai-community/gpt2-xl 1.6B | 21.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1023 | pierreguillou/gpt2-small-portuguese 0.1B | 21.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1024 | openai-community/gpt2-large 0.8B | 21.3% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1025 | facebook/galactica-1.3b 1.3B | 21.3% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1026 | JosephusCheung/LL7M 6.8B | 21.3% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1027 | M4-ai/tau-0.5B-instruct-DPOP 0.5B | 21.3% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1028 | MulaBR/Mula-8x160-v0.1 0.8B | 21.3% | Three-shot, text-only, float16, 2024-05-08 | May 2024 | huggingface.co | Official leaderboard | |
| 1029 | h2oai/h2o-danube-1.8b-sft 1.8B | 21.3% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | huggingface.co | Official leaderboard | |
| 1030 | rhaymison/portuguese-phi1_5-tom-cat 1.4B | 21.3% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | huggingface.co | Official leaderboard | |
| 1031 | 22h/open-cabrita3b 3.6B | 21.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1032 | wandgibaut/periquito-3B 3.6B | 21.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1033 | allenai/OLMo-7B 6.9B | 21% | Three-shot, text-only, float16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1034 | PORTULAN/gervasio-7b-portuguese-ptbr-decoder 7B | 21% | Three-shot, text-only, bfloat16, 2024-03-07 | Mar 2024 | huggingface.co | Official leaderboard | |
| 1035 | facebook/opt-2.7b 2.7B | 20.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1036 | EleutherAI/pythia-70m 0.1B | 20.9% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1037 | dynamofl/dynamo-8B-v0.1 8.3B | 20.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1038 | HuggingFaceTB/cosmo-1b 1.7B | 20.7% | Three-shot, text-only, float16, 2024-02-24 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1039 | pedrogengo/gemma-ptbr 2.5B | 20.7% | Three-shot, text-only, float16, 2024-03-28 | Mar 2024 | huggingface.co | Official leaderboard | |
| 1040 | recogna-nlp/phibode_1_5_ultraalpaca 1.4B | 20.7% | Three-shot, text-only, float16, 2024-05-12 | May 2024 | huggingface.co | Official leaderboard | |
| 1041 | BAAI/Emu3-Stage1 8.5B | 20.7% | Three-shot, text-only, bfloat16, 2024-10-21 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1042 | bigscience/bloom-3b 3B | 20.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1043 | EleutherAI/pythia-1b-deduped 1.1B | 20.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1044 | openai-community/gpt2-medium 0.4B | 20.6% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1045 | nisten/Biggie-SmoLlm-0.15B-Base 0.2B | 20.6% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 1046 | EleutherAI/pythia-6.9b 6.9B | 20.3% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1047 | state-spaces/mamba-1.4b-hf 1.4B | 20.3% | Three-shot, text-only, float16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1048 | state-spaces/mamba-370m-hf 0.4B | 20.3% | Three-shot, text-only, float16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1049 | recogna-nlp/gembode-2b-base-ultraalpaca-qlora 2.6B | 20.3% | Three-shot, text-only, float16, 2024-04-23 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1050 | baichuan-inc/Baichuan-7B 7B | 20.2% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1051 | EleutherAI/pythia-410m-deduped 0.5B | 20.2% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1052 | facebook/xglm-7.5B 7.5B | 20.2% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1053 | nicholasKluge/baseline 0.8B | 20.2% | Three-shot, text-only, float16, 2024-05-06 | May 2024 | huggingface.co | Official leaderboard | |
| 1054 | LiteAI/Hare-1.1B-Chat 1.1B | 20% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1055 | | 20% | Three-shot, text-only, bfloat16, 2024-11-12 | Sep 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 1056 | proxectonos/Llama-3.1-Carballo 8B | 20% | Three-shot, text-only, float16, 2025-04-01 | Apr 2025 | huggingface.co | Official leaderboard | |
| 1057 | facebook/xglm-1.7B 1.7B | 19.9% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1058 | state-spaces/mamba-2.8b-hf 2.8B | 19.9% | Three-shot, text-only, float16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1059 | adalbertojunior/Mistral-7b-Portuguese-V0.1 7.2B | 19.9% | Three-shot, text-only, bfloat16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1060 | Delta-Vector/Odin-9B 9.2B | 19.9% | Three-shot, text-only, bfloat16, 2024-10-29 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1061 | facebook/xglm-2.9B 2.9B | 19.8% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1062 | facebook/xglm-564M 0.6B | 19.8% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1063 | cerebras/Cerebras-GPT-2.7B 2.7B | 19.6% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1064 | stabilityai/stablelm-base-alpha-3b 3.6B | 19.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1065 | BAAI/Emu3-Gen 8.5B | 19.5% | Three-shot, text-only, bfloat16, 2024-10-21 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1066 | gpt2 0.1B | 19.3% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1067 | h2oai/h2o-danube-1.8b-chat 1.8B | 19.3% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1068 | proxectonos/Cerebras-1.3B-GL 1.3B | 19.3% | Three-shot, text-only, bfloat16, 2024-04-24 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1069 | | 19.2% | Three-shot, text-only, float16, 2024-02-05 | May 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 1070 | EleutherAI/pythia-1b 1.1B | 19.2% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1071 | Nos-PT/Carvalho_pt-gl-1.3B 1.3B | 19.2% | Three-shot, text-only, float16, 2024-06-26 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1072 | | 19.2% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 1073 | facebook/opt-6.7b 6.7B | 19.1% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1074 | projecte-aina/aguila-7b 6.9B | 19.1% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1075 | EleutherAI/pythia-160m 0.2B | 19.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1076 | bigscience/bloom-560m 0.6B | 18.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1077 | stabilityai/stablelm-base-alpha-7b 7.9B | 18.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1078 | allenai/OLMo-1B 1.2B | 18.9% | Three-shot, text-only, float16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1079 | Qwen/Qwen1.5-0.5B 0.6B | 18.9% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1080 | PORTULAN/gervasio-7b-portuguese-ptpt-decoder 7B | 18.9% | Three-shot, text-only, bfloat16, 2024-03-07 | Mar 2024 | huggingface.co | Official leaderboard | |
| 1081 | M4-ai/tau-0.5B 0.5B | 18.9% | Three-shot, text-only, float16, 2024-04-21 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1082 | h2oai/h2o-danube3-500m-base 0.5B | 18.9% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1083 | premai-io/prem-1B-chat 1.1B | 18.9% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1084 | Nos-PT/Llama-Carvalho-PT 8B | 18.9% | Three-shot, text-only, float16, 2025-04-01 | Apr 2025 | huggingface.co | Official leaderboard | |
| 1085 | Nos-PT/Llama-Carvalho-PT-GL 8B | 18.9% | Three-shot, text-only, float16, 2025-04-01 | Apr 2025 | huggingface.co | Official leaderboard | |
| 1086 | projecte-aina/FLOR-1.3B 1.3B | 18.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1087 | state-spaces/mamba-130m-hf 0.1B | 18.8% | Three-shot, text-only, float16, 2024-04-07 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1088 | Ramikan-BR/tinyllama-coder-py-4bit-v10 1.1B | 18.6% | Three-shot, text-only, rev: da5637d, float16, 2024-05-28 | May 2024 | huggingface.co | Official leaderboard | |
| 1089 | h2oai/h2o-danube3-500m-chat 0.5B | 18.6% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1090 | EleutherAI/gpt-neo-125m 0.2B | 18.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1091 | HuggingFaceTB/SmolLM-1.7B-Instruct 1.7B | 18.5% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1092 | | 18.5% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 1093 | EleutherAI/gpt-neo-1.3B 1.4B | 18.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1094 | EleutherAI/pythia-70m-deduped 0.1B | 18.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1095 | facebook/opt-125m 0.1B | 18.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1096 | josu/gpt-neo-pt-1.3B 1.3B | 18.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1097 | cerebras/Cerebras-GPT-256M 0.3B | 18.4% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1098 | facebook/opt-350m 0.4B | 18.2% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1099 | cerebras/Cerebras-GPT-111M 0.1B | 18.1% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1100 | EleutherAI/pythia-14m 0B | 17.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1101 | EleutherAI/pythia-160m-deduped 0.2B | 17.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1102 | josu/gpt-neo-pt-br 0.1B | 17.7% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1103 | nicholasKluge/Aira-2-portuguese-124M 0.1B | 17.1% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1104 | HuggingFaceTB/SmolLM-360M-Instruct 0.4B | 16.7% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1105 | artificialguybr/llama3-8b-alpacadata-ptbr 8B | 16.4% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 1106 | HuggingFaceTB/SmolLM-135M-Instruct 0.1B | 16.3% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1107 | FluxiIA/Tucaninho_dpo 2.4B | 15.4% | Three-shot, text-only, float16, 2025-03-24 | Mar 2025 | huggingface.co | Official leaderboard | |
| 1108 | FluxiIA/Tucaninho 2.4B | 15.3% | Three-shot, text-only, float16, 2025-02-27 | Feb 2025 | huggingface.co | Official leaderboard | |
| 1109 | facebook/galactica-125m 0.1B | 14.9% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1110 | BAAI/Aquila2-7B 7.3B | 14.5% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1111 | deepseek-ai/DeepSeek-V2-Lite 15.7B | 14.5% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | huggingface.co | Official leaderboard | |
| 1112 | | 13.9% | Three-shot, text-only, bfloat16, 2025-01-28 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 1113 | T5-Large | 13.5% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 1114 | T5-Small | 13.1% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 1115 | pucpr/gpt2-bio-pt 0.1B | 12.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1116 | internlm/internlm2_5-7b 7.7B | 11.3% | Three-shot, text-only, bfloat16, 2024-07-05 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1117 | Ramikan-BR/tinyllama-coder-py-v11 1.1B | 10.7% | Three-shot, text-only, rev: f1b5e2e, float16, 2024-05-28 | May 2024 | huggingface.co | Official leaderboard | |
| 1118 | dominguesm/mambarim-110m 0.1B | 10.6% | Three-shot, text-only, float16, 2024-04-15 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1119 | Qwen/Qwen3-0.6B-Base 0.6B | 10.6% | Three-shot, text-only, bfloat16, 2025-05-01 | May 2025 | huggingface.co | Official leaderboard | |
| 1120 | ai-forever/mGPT-13B 13.1B | 10.4% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1121 | google/mt5-base 0.6B | 10.3% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1122 | T5-Base | 10.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 1123 | NLPark/AnFeng_v3_Avocet 35B | 9.60% | Three-shot, text-only, bfloat16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 1124 | lrds-code/samba-1.1B 1.1B | 8.07% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1125 | EleutherAI/polyglot-ko-12.8b 13.1B | 7.51% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1126 | | 6.68% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 1127 | adalbertojunior/NeuralDaredevil-Dolphin-Portuguese 8B | 6.12% | Three-shot, text-only, bfloat16, 2024-06-04 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1128 | HeyLucasLeao/gpt-neo-small-portuguese 0.1B | 3.89% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1129 | JJhooww/Mistral_Reload_v4_Functions 7.2B | 3.48% | Three-shot, text-only, float16, 2024-06-15 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1130 | NOVA-vision-language/GlorIA-1.3B 1.4B | 3.20% | Three-shot, text-only, float16, 2024-03-07 | Mar 2024 | huggingface.co | Official leaderboard | |
| 1131 | Ramikan-BR/tinyllama-coder-py-v12 1.1B | 2.78% | Three-shot, text-only, rev: abd0469, float16, 2024-05-28 | May 2024 | huggingface.co | Official leaderboard | |
| 1132 | Qwen/Qwen-1_8B-Chat 1.8B | 1.11% | Three-shot, text-only, bfloat16, 2024-02-22 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1133 | ssmits/Falcon2-5.5B-multilingual 5.5B | 0.83% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 1134 | ssmits/Falcon2-5.5B-Portuguese 5.5B | 0.83% | Three-shot, text-only, bfloat16, 2024-05-27 | May 2024 | huggingface.co | Official leaderboard | |
| 1135 | monilouise/opt125M_portuguese 0.1B | 0.70% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1136 | Qwen/Qwen-72B-Chat 72.3B | 0.70% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1137 | MTSAIR/multi_verse_model 7.2B | 0.70% | Three-shot, text-only, bfloat16, 2024-05-25 | May 2024 | huggingface.co | Official leaderboard | |
| 1138 | internlm/internlm2_5-20b 19.9B | 0.70% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | huggingface.co | Official leaderboard | |
| 1139 | MaziyarPanahi/Calme-4x7B-MoE-v0.2 24.2B | 0.42% | Three-shot, text-only, bfloat16, 2024-06-17 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1140 | nicholasKluge/Aira-2-portuguese-1B7 1.7B | 0.28% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1141 | MaziyarPanahi/Calme-4x7B-MoE-v0.1 24.2B | 0.28% | Three-shot, text-only, bfloat16, 2024-06-16 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1142 | eduagarcia/gemma-7b-it_singleturn_chat_template 8.5B | 0.14% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1143 | google/mt5-small 0.3B | 0.14% | Three-shot, text-only, float16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1144 | meta-llama/Meta-Llama-3-8B-Instruct 8B | 0.14% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1145 | abacusai/Llama-3-Smaug-8B 8B | 0.14% | Three-shot, text-only, bfloat16, 2024-05-13 | May 2024 | huggingface.co | Official leaderboard | |
| 1146 | | 0.14% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 1147 | gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES 8B | 0.14% | Three-shot, text-only, float16, 2024-09-19 | Sep 2024 | huggingface.co | Official leaderboard | |
| 1148 | RLHFlow/ArmoRM-Llama3-8B-v0.1 8B | 0.14% | Three-shot, text-only, bfloat16, 2024-10-08 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1149 | nicholasKluge/Aira-2-portuguese-560M 0.6B | 0% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1150 | openai-community/openai-gpt 0.1B | 0% | Three-shot, text-only, float16, 2024-02-05 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1151 | ai-forever/mGPT 1.4B | 0% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1152 | DAMO-NLP-MT/polylm-13b 13.9B | 0% | Three-shot, text-only, float16, 2024-02-11 | Feb 2024 | huggingface.co | Official leaderboard | |
| 1153 | rhaymison/gemma-portuguese-2b-it 2.5B | 0% | Three-shot, text-only, bfloat16, 2024-04-08 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1154 | Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO 7.3B | 0% | Three-shot, text-only, bfloat16, 2024-04-09 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1155 | abhishek/autotrain-llama3-orpo-v2 8B | 0% | Three-shot, text-only, bfloat16, 2024-04-25 | Apr 2024 | huggingface.co | Official leaderboard | |
| 1156 | WizardLMTeam/WizardLM-13B-V1.0 13B | 0% | Three-shot, text-only, float16, 2024-05-22 | May 2024 | huggingface.co | Official leaderboard | |
| 1157 | recogna-nlp/phibode_1_5_ultraalpaca_qlora 1.5B | 0% | Three-shot, text-only, float16, 2024-05-31 | May 2024 | huggingface.co | Official leaderboard | |
| 1158 | cognitivess/bella-1-8b 8.1B | 0% | Three-shot, text-only, float16, 2024-06-24 | Jun 2024 | huggingface.co | Official leaderboard | |
| 1159 | GeneZC/MiniChat-1.5-3B 3B | 0% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1160 | GeneZC/MiniChat-2-3B 3B | 0% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1161 | GeneZC/MiniChat-3B 3B | 0% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | huggingface.co | Official leaderboard | |
| 1162 | monsterapi/Llama-3_1-8B-Instruct-orca-ORPO 8.1B | 0% | Three-shot, text-only, bfloat16, 2024-08-30 | Aug 2024 | huggingface.co | Official leaderboard | |
| 1163 | kaist-ai/janus-rm-7b 7.2B | 0% | Three-shot, text-only, bfloat16, 2024-10-09 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1164 | J-LAB/Qwen2.5_Thinik_base_v1.0 3.4B | 0% | Three-shot, text-only, float16, 2024-10-15 | Oct 2024 | huggingface.co | Official leaderboard | |
| 1165 | J-LAB/Thinik 3.1B | 0% | Three-shot, text-only, float16, 2024-10-15 | Oct 2024 | huggingface.co | Official leaderboard |
| # | Model | Score | Setting | Released | Run on | Link | Source |
|---|---|---|---|---|---|---|---|
| 1 | | 95% | Three-shot, text-only, reasoning, 2025-04-03 | Mar 2025 | Apr 2025 | aistudio.google.com | Official leaderboard |
| 2 | GPT-5 mini | 91.4% | Three-shot, text-only, reasoning, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 3 | Grok-3 mini | 89.8% | Three-shot, text-only, reasoning, 2025-09-01 | Apr 2025 | Sep 2025 | x.ai | Official leaderboard |
| 4 | | 86.5% | Three-shot, text-only, 2025-09-01 | Jun 2025 | Sep 2025 | aistudio.google.com | Official leaderboard |
| 5 | | 85.8% | Three-shot, text-only, 4bit, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 6 | GPT-5 nano | 85.3% | Three-shot, text-only, reasoning, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 7 | Claude 3.7 Sonnet | 84.6% | Three-shot, text-only, 2025-04-04 | Feb 2025 | Apr 2025 | anthropic.com | Official leaderboard |
| 8 | | 84.1% | Three-shot, text-only, 2025-04-03 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 9 | | 84% | Three-shot, text-only, reasoning: low, 2025-09-01 | Jun 2025 | Sep 2025 | aistudio.google.com | Official leaderboard |
| 10 | | 83.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 11 | | 83% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 12 | Kimi K2 Jul 2025 | 82.8% | Three-shot, text-only, 2025-09-01 | Jul 2025 | Sep 2025 | huggingface.co | Official leaderboard |
| 13 | | 81.8% | Three-shot, text-only, 2025-09-01 | Aug 2025 | Sep 2025 | huggingface.co | Official leaderboard |
| 14 | | 81.2% | Three-shot, text-only, 2025-04-05 | Apr 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 15 | | 80.7% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 16 | | 80.5% | Three-shot, text-only, 2025-04-03 | Jan 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 17 | | 80.5% | Three-shot, text-only, 2025-04-03 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 18 | | 80.4% | Three-shot, text-only, 2025-04-03 | Feb 2025 | Apr 2025 | cloud.google.com | Official leaderboard |
| 19 | GPT-4o Aug 2024 | 79.7% | Three-shot, text-only, 2025-04-09 | Aug 2024 | Apr 2025 | openai.com | Official leaderboard |
| 20 | | 79% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | Sep 2024 | huggingface.co | Official leaderboard |
| 21 | GPT-5 | 78.9% | Three-shot, text-only, reasoning: minimal, 2025-09-01 | Aug 2025 | Sep 2025 | openai.com | Official leaderboard |
| 22 | | 78.7% | Three-shot, text-only, 2025-04-03 | Feb 2025 | Apr 2025 | cloud.google.com | Official leaderboard |
| 23 | | 78.3% | Three-shot, text-only, bfloat16, 2025-07-08 | May 2025 | Jul 2025 | huggingface.co | Official leaderboard |
| 24 | | 78% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 25 | | 76.9% | Three-shot, text-only, bfloat16, 2025-08-30 | Jul 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 26 | | 76.8% | Three-shot, text-only, bfloat16, 2024-09-18 | Sep 2024 | Sep 2024 | huggingface.co | Official leaderboard |
| 27 | | 76.6% | Three-shot, text-only, bfloat16, 2024-12-03 | Nov 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 28 | | 76.5% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 29 | | 76.1% | Three-shot, text-only, 2025-04-03 | Aug 2024 | Apr 2025 | cloud.google.com | Official leaderboard |
| 30 | | 75.9% | Three-shot, text-only, 2025-04-03 | Dec 2024 | Apr 2025 | huggingface.co | Official leaderboard |
| 31 | | 75.8% | Three-shot, text-only, 2024-08-09 | May 2024 | Aug 2024 | cloud.google.com | Official leaderboard |
| 32 | | 75.4% | Three-shot, text-only, bfloat16, 2024-06-08 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 33 | | 72% | Three-shot, text-only, bfloat16, 2025-01-31 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 34 | | 71.2% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 35 | | 71.1% | Three-shot, text-only, 4bit, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 36 | | 70.4% | Three-shot, text-only, bfloat16, 2024-04-18 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 37 | | 70.2% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 38 | | 68.2% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 39 | | 68% | Three-shot, text-only, bfloat16, 2024-07-02 | Jun 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 40 | | 67.9% | Three-shot, text-only, 4bit, 2024-05-23 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 41 | Qwen2.5-Coder-14B | 67.9% | Three-shot, text-only, bfloat16, 2024-11-12 | Sep 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 42 | qwen3-4b-instruct-2507 | 67.7% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 43 | | 67.6% | Three-shot, text-only, bfloat16, 2024-02-18 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 44 | | 67.3% | Three-shot, text-only, bfloat16, 2024-11-12 | Nov 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 45 | | 66.6% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 46 | | 66.6% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 47 | | 66.5% | Three-shot, text-only, bfloat16, 2024-02-05 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 48 | Qwen2.5-Coder-14B-Instruct | 66.5% | Three-shot, text-only, bfloat16, 2024-11-12 | Nov 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 49 | | 65.9% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 50 | | 65.8% | Three-shot, text-only, bfloat16, 2024-05-22 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 51 | | 65.8% | Three-shot, text-only, 2024-06-30 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 52 | c4ai-command-r-08-2024 | 65.4% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2024 | Aug 2025 | huggingface.co | Official leaderboard |
| 53 | | 65.4% | Three-shot, text-only, float16, 2024-10-27 | Oct 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 54 | | 65.4% | Three-shot, text-only, bfloat16, 2025-05-01 | Mar 2025 | May 2025 | huggingface.co | Official leaderboard |
| 55 | GLM-4-9B-Chat | 65% | Three-shot, text-only, float16, 2024-06-09 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 56 | GLM-4-9B | 64.5% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 57 | | 64.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 58 | | 64.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 59 | | 64% | Three-shot, text-only, bfloat16, 2024-07-02 | Jun 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 60 | | 63.4% | Three-shot, text-only, 4bit, 2024-12-05 | Aug 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 61 | | 63% | Three-shot, text-only, bfloat16, 2024-03-05 | Nov 2023 | Mar 2024 | huggingface.co | Official leaderboard |
| 62 | | 62.9% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 63 | GPT-3.5 Turbo Jan 2024 | 62.5% | Three-shot, text-only, 2024-03-08 | Jan 2024 | Mar 2024 | openai.com | Official leaderboard |
| 64 | | 62.5% | Three-shot, text-only, bfloat16, 2024-05-21 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 65 | | 62% | Three-shot, text-only, float16, 2024-04-05 | Mar 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 66 | GLM-4-9B-Chat-1M | 61.9% | Three-shot, text-only, bfloat16, 2024-06-05 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 67 | | 61.8% | Three-shot, text-only, bfloat16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 68 | | 61.5% | Three-shot, text-only, bfloat16, 2024-05-21 | Apr 2024 | May 2024 | huggingface.co | Official leaderboard |
| 69 | | 61.5% | Three-shot, text-only, bfloat16, 2024-05-21 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 70 | | 61.3% | Three-shot, text-only, float16, 2024-02-05 | Jul 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 71 | | 61.3% | Three-shot, text-only, bfloat16, 2024-08-09 | Aug 2024 | Aug 2024 | huggingface.co | Official leaderboard |
| 72 | | 61.3% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 73 | | 61.1% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 74 | | 61.1% | Three-shot, text-only, bfloat16, 2024-06-06 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 75 | | 60.8% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 76 | | 60.8% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 77 | Aria | 60.6% | Three-shot, text-only, bfloat16, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 78 | | 59.9% | Three-shot, text-only, bfloat16, 2024-07-23 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 79 | | 59.3% | Three-shot, text-only, bfloat16, 2024-12-05 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 80 | | 58.7% | Three-shot, text-only, 2024-03-08 | Dec 2023 | Mar 2024 | ai.google.dev | Official leaderboard |
| 81 | | 58.3% | Three-shot, text-only, float16, 2024-02-19 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 82 | | 57.9% | Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 83 | | 57.3% | Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 84 | Granite-3.1-8B-Instruct | 57.3% | Three-shot, text-only, float16, 2025-08-29 | Dec 2024 | Aug 2025 | huggingface.co | Official leaderboard |
| 85 | | 56.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 86 | | 56.5% | Three-shot, text-only, bfloat16, 2024-02-21 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 87 | | 55.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 88 | | 55.6% | Three-shot, text-only, bfloat16, 2024-03-04 | Nov 2023 | Mar 2024 | huggingface.co | Official leaderboard |
| 89 | | 55.5% | Three-shot, text-only, float16, 2024-04-18 | Sep 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 90 | | 55.4% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 91 | Nous-Hermes-2-Mixtral-8x7B-DPO | 55.4% | Three-shot, text-only, bfloat16, 2024-02-27 | Jan 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 92 | Yi-9B | 54.9% | Three-shot, text-only, bfloat16, 2024-04-13 | Mar 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 93 | | 54.8% | Three-shot, text-only, bfloat16, 2024-05-15 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 94 | | 54.4% | Three-shot, text-only, float16, 2024-10-24 | Oct 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 95 | | 54.1% | Three-shot, text-only, bfloat16, 2024-04-08 | Feb 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 96 | | 54.1% | Three-shot, text-only, bfloat16, 2024-04-23 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 97 | | 54% | Three-shot, text-only, bfloat16, 2024-04-23 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 98 | | 53.8% | Three-shot, text-only, bfloat16, 2024-03-29 | Mar 2024 | Mar 2024 | huggingface.co | Official leaderboard |
| 99 | | 53.1% | Three-shot, text-only, bfloat16, 2024-04-17 | Dec 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 100 | | 52.9% | Three-shot, text-only, bfloat16, 2025-01-28 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 101 | internlm-20b | 52.6% | Three-shot, text-only, bfloat16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 102 | | 52.3% | Three-shot, text-only, bfloat16, 2024-05-22 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 103 | | 52.3% | Three-shot, text-only, bfloat16, 2024-02-24 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 104 | | 52.3% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 105 | | 52.2% | Three-shot, text-only, bfloat16, 2024-02-18 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 106 | | 52% | Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 107 | | 51.5% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 108 | | 51.3% | Three-shot, text-only, bfloat16, 2024-02-05 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 109 | | 51% | Three-shot, text-only, bfloat16, 2024-04-14 | Oct 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 110 | | 50.5% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 111 | | 50.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 112 | | 50.2% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 113 | | 50.1% | Three-shot, text-only, bfloat16, 2024-02-27 | Nov 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 114 | | 49.6% | Three-shot, text-only, bfloat16, 2024-02-05 | Mar 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 115 | | 49% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 116 | | 48.8% | Three-shot, text-only, float16, 2024-04-18 | Sep 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 117 | | 48.1% | Three-shot, text-only, bfloat16, 2024-08-09 | Jul 2024 | Aug 2024 | huggingface.co | Official leaderboard |
| 118 | | 48% | Three-shot, text-only, bfloat16, 2024-02-21 | Oct 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 119 | | 47.7% | Three-shot, text-only, bfloat16, 2024-04-07 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 120 | | 47.3% | Three-shot, text-only, bfloat16, 2025-07-15 | Jun 2025 | Jul 2025 | huggingface.co | Official leaderboard |
| 121 | | 46.6% | Three-shot, text-only, bfloat16, 2024-02-23 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 122 | | 46.5% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 123 | | 46.3% | Three-shot, text-only, bfloat16, 2024-05-16 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 124 | | 46.2% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 125 | | 45.6% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 126 | | 45.6% | Three-shot, text-only, 4bit, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 127 | | 45.3% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 128 | | 43.4% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 129 | LFM2-1.2B | 42.3% | Three-shot, text-only, bfloat16, 2025-08-30 | Jul 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 130 | | 41.6% | Three-shot, text-only, bfloat16, 2024-05-27 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 131 | | 38.7% | Three-shot, text-only, bfloat16, 2024-02-05 | Jun 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 132 | gpt-oss-20b | 37.7% | Three-shot, text-only, bfloat16, 2025-08-29 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 133 | | 37.5% | Three-shot, text-only, bfloat16, 2024-02-17 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 134 | | 36% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 135 | ChatGLM3-6B | 35.6% | Three-shot, text-only, float16, 2024-02-19 | Oct 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 136 | | 34.5% | Three-shot, text-only, bfloat16, 2024-06-07 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 137 | internlm-7b | 33.5% | Three-shot, text-only, float16, 2024-02-05 | Jul 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 138 | | 33% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 139 | | 32.8% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 140 | | 31.6% | Three-shot, text-only, bfloat16, 2025-01-29 | Dec 2024 | Jan 2025 | huggingface.co | Official leaderboard |
| 141 | | 30.3% | Three-shot, text-only, bfloat16, 2024-05-17 | May 2024 | May 2024 | huggingface.co | Official leaderboard |
| 142 | chatglm2-6b | 29.9% | Three-shot, text-only, float16, 2024-04-05 | Jun 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 143 | | 29.2% | Three-shot, text-only, bfloat16, 2025-01-29 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 144 | | 28.4% | Three-shot, text-only, bfloat16, 2024-02-21 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 145 | | 27% | Three-shot, text-only, float16, 2024-02-05 | Dec 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 146 | Baichuan2-13B-Chat | 26.3% | Three-shot, text-only, bfloat16, 2024-05-27 | Sep 2023 | May 2024 | huggingface.co | Official leaderboard |
| 147 | Qwen-1_8B | 26.3% | Three-shot, text-only, float16, 2024-04-18 | Nov 2023 | Apr 2024 | huggingface.co | Official leaderboard |
| 148 | | 25.6% | Three-shot, text-only, float16, 2024-02-05 | May 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 149 | gpt-oss-120b | 25.6% | Three-shot, text-only, bfloat16, 2025-08-29 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 150 | | 25.3% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 151 | RedPajama-INCITE-7B-Base | 25% | Three-shot, text-only, float16, 2024-02-05 | May 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 152 | | 24.9% | Three-shot, text-only, bfloat16, 2024-04-07 | Apr 2024 | Apr 2024 | huggingface.co | Official leaderboard |
| 153 | | 24.9% | Three-shot, text-only, bfloat16, 2025-05-01 | Apr 2025 | May 2025 | huggingface.co | Official leaderboard |
| 154 | | 24.2% | Three-shot, text-only, float16, 2024-02-11 | Mar 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 155 | Emu3-Chat | 24.1% | Three-shot, text-only, bfloat16, 2024-10-21 | Sep 2024 | Oct 2024 | huggingface.co | Official leaderboard |
| 156 | | 23.9% | Three-shot, text-only, float16, 2024-02-05 | Feb 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 157 | GPT-J-6B | 23.6% | Three-shot, text-only, float16, 2024-02-05 | Aug 2021 | Feb 2024 | huggingface.co | Official leaderboard |
| 158 | | 23.5% | Three-shot, text-only, float16, 2024-02-05 | Sep 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 159 | | 23.4% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 160 | GPT-NeoX-20B | 22.8% | Three-shot, text-only, float16, 2024-02-05 | Apr 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 161 | | 22.8% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 162 | | 22.7% | Three-shot, text-only, bfloat16, 2024-02-05 | May 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 163 | | 22.5% | Three-shot, text-only, bfloat16, 2024-06-07 | Jun 2024 | Jun 2024 | huggingface.co | Official leaderboard |
| 164 | | 22.3% | Three-shot, text-only, bfloat16, 2025-04-04 | Mar 2025 | Apr 2025 | huggingface.co | Official leaderboard |
| 165 | | 22% | Three-shot, text-only, bfloat16, 2024-02-05 | Apr 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 166 | open_llama_7b | 22% | Three-shot, text-only, float16, 2024-02-11 | Jun 2023 | Feb 2024 | huggingface.co | Official leaderboard |
| 167 | GPT-Neo-2.7B | 21.7% | Three-shot, text-only, float16, 2024-02-05 | Mar 2021 | Feb 2024 | huggingface.co | Official leaderboard |
| 168 | | 20% | Three-shot, text-only, bfloat16, 2024-11-12 | Sep 2024 | Nov 2024 | huggingface.co | Official leaderboard |
| 169 | | 19.2% | Three-shot, text-only, float16, 2024-02-05 | May 2022 | Feb 2024 | huggingface.co | Official leaderboard |
| 170 | | 19.2% | Three-shot, text-only, float16, 2024-07-22 | Jul 2024 | Jul 2024 | huggingface.co | Official leaderboard |
| 171 | | 18.5% | Three-shot, text-only, bfloat16, 2025-08-30 | Aug 2025 | Aug 2025 | huggingface.co | Official leaderboard |
| 172 | | 13.9% | Three-shot, text-only, bfloat16, 2025-01-28 | Jan 2025 | Jan 2025 | huggingface.co | Official leaderboard |
| 173 | T5-Large | 13.5% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 174 | T5-Small | 13.1% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 175 | T5-Base | 10.2% | Three-shot, text-only, bfloat16, 2024-02-05 | Feb 2024 | Feb 2024 | huggingface.co | Official leaderboard |
| 176 | | 6.68% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
| 177 | | 0.14% | Three-shot, text-only, bfloat16, 2024-12-03 | Sep 2024 | Dec 2024 | huggingface.co | Official leaderboard |
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: Open Portuguese LLM Leaderboard’s leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Three-shot, text-only, reasoning, 2025-04-03 | 95% | ||||
| GPT-5 mini | Three-shot, text-only, reasoning, 2025-09-01 | 91.4% | |||
| Grok-3 mini | Three-shot, text-only, reasoning, 2025-09-01 | 89.8% | |||
| Three-shot, text-only, 2025-09-01 | 86.5% | ||||
| Three-shot, text-only, 4bit, 2025-05-01 | 85.8% | ||||
| GPT-5 nano | Three-shot, text-only, reasoning, 2025-09-01 | 85.3% | |||
| Claude 3.7 Sonnet | Three-shot, text-only, 2025-04-04 | 84.6% | |||
| Three-shot, text-only, 2025-04-03 | 84.1% | ||||
| Three-shot, text-only, reasoning: low, 2025-09-01 | 84% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 83.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 83% | ||||
| Kimi K2 Jul 2025 | Three-shot, text-only, 2025-09-01 | 82.8% | |||
| Three-shot, text-only, 2025-09-01 | 81.8% | ||||
| Three-shot, text-only, 2025-04-05 | 81.2% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 80.7% | ||||
| Three-shot, text-only, 2025-04-03 | 80.5% | ||||
| Three-shot, text-only, 2025-04-03 | 80.5% | ||||
| Three-shot, text-only, 2025-04-03 | 80.4% | ||||
| GPT-4o Aug 2024 | Three-shot, text-only, 2025-04-09 | 79.7% | |||
| Three-shot, text-only, bfloat16, 2024-09-18 | 79% | ||||
| GPT-5 | Three-shot, text-only, reasoning: minimal, 2025-09-01 | 78.9% | |||
| Three-shot, text-only, 2025-04-03 | 78.7% | ||||
| Three-shot, text-only, bfloat16, 2025-07-08 | 78.3% | ||||
| Three-shot, text-only, 2025-04-03 | 78% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 78% | ||||
| Three-shot, text-only, 4bit, 2024-12-04 | 77.6% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 76.9% | ||||
| Three-shot, text-only, bfloat16, 2024-09-18 | 76.8% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 76.6% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 76.5% | ||||
| Three-shot, text-only, 2025-04-03 | 76.1% | ||||
| Three-shot, text-only, 2025-04-03 | 75.9% | ||||
| Three-shot, text-only, 2024-08-09 | 75.8% | ||||
| Three-shot, text-only, bfloat16, 2024-06-08 | 75.4% | ||||
| Three-shot, text-only, bfloat16, 2024-06-08 | 75% | ||||
| Three-shot, text-only, 4bit, 2024-08-12 | 74.4% | ||||
| Three-shot, text-only, 2025-09-01 | 73.3% | ||||
| Three-shot, text-only, bfloat16, 2025-01-31 | 72% | ||||
| Three-shot, text-only, bfloat16, 2024-07-23 | 71.2% | ||||
| Three-shot, text-only, 4bit, 2024-12-05 | 71.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-18 | 70.4% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 70.2% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 68.2% | ||||
| Three-shot, text-only, bfloat16, 2024-07-02 | 68% | ||||
| Three-shot, text-only, 4bit, 2024-05-23 | 67.9% | ||||
| Qwen2.5-Coder-14B | Three-shot, text-only, bfloat16, 2024-11-12 | 67.9% | |||
| qwen3-4b-instruct-2507 | Three-shot, text-only, bfloat16, 2025-08-30 | 67.7% | |||
| Three-shot, text-only, bfloat16, 2024-02-18 | 67.6% | ||||
| Three-shot, text-only, bfloat16, 2024-11-12 | 67.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-15 | 66.6% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 66.6% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 66.5% | ||||
| Qwen2.5-Coder-14B-Instruct | Three-shot, text-only, bfloat16, 2024-11-12 | 66.5% | |||
| Three-shot, text-only, bfloat16, 2025-08-30 | 65.9% | ||||
| Three-shot, text-only, bfloat16, 2024-05-22 | 65.8% | ||||
| Three-shot, text-only, 4bit, 2024-05-22 | 65.8% | ||||
| Three-shot, text-only, 2024-06-30 | 65.8% | ||||
| c4ai-command-r-08-2024 | Three-shot, text-only, bfloat16, 2025-08-30 | 65.4% | |||
| Three-shot, text-only, float16, 2024-10-27 | 65.4% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 65.4% | ||||
| GLM-4-9B-Chat | Three-shot, text-only, float16, 2024-06-09 | 65% | |||
| GLM-4-9B-Chat | Three-shot, text-only, bfloat16, 2024-06-05 | 64.8% | |||
| GLM-4-9B | Three-shot, text-only, bfloat16, 2024-06-05 | 64.5% | |||
| Three-shot, text-only, bfloat16, 2024-02-05 | 64.3% | ||||
| Three-shot, text-only, 4bit, 2024-12-20 | 64.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 64.3% | ||||
| Three-shot, text-only, bfloat16, 2024-07-02 | 64% | ||||
| Three-shot, text-only, 4bit, 2024-12-05 | 63.4% | ||||
| Three-shot, text-only, bfloat16, 2024-03-05 | 63% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 62.9% | ||||
| GPT-3.5 Turbo Jan 2024 | Three-shot, text-only, 2024-03-08 | 62.5% | |||
| Three-shot, text-only, bfloat16, 2024-05-21 | 62.5% | ||||
| Three-shot, text-only, float16, 2024-04-05 | 62% | ||||
| GLM-4-9B-Chat-1M | Three-shot, text-only, bfloat16, 2024-06-05 | 61.9% | |||
| Three-shot, text-only, bfloat16, 2024-07-22 | 61.8% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 61.5% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 61.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2024-08-09 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2024-06-06 | 61.1% | ||||
| Three-shot, text-only, bfloat16, 2024-06-06 | 61.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-23 | 60.8% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 60.8% | ||||
| Aria | Three-shot, text-only, bfloat16, 2024-12-05 | 60.6% | |||
| Three-shot, text-only, bfloat16, 2024-09-18 | 60.2% | ||||
| Three-shot, text-only, bfloat16, 2024-07-23 | 59.9% | ||||
| Three-shot, text-only, bfloat16, 2024-12-05 | 59.3% | ||||
| Three-shot, text-only, 2024-03-08 | 58.7% | ||||
| Three-shot, text-only, float16, 2024-02-19 | 58.3% | ||||
| Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 | 57.9% | ||||
| Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 | 57.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 57.3% | ||||
| Granite-3.1-8B-Instruct | Three-shot, text-only, float16, 2025-08-29 | 57.3% | |||
| Three-shot, text-only, bfloat16, 2025-05-01 | 56.9% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 56.5% | ||||
| GLM-4-9B-Chat | Three-shot, text-only, bfloat16, 2024-12-05 | 56% | |||
| Three-shot, text-only, bfloat16, 2025-05-01 | 55.9% | ||||
| Three-shot, text-only, bfloat16, 2024-03-04 | 55.6% | ||||
| Three-shot, text-only, float16, 2024-04-18 | 55.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 55.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 55.4% | ||||
| Nous-Hermes-2-Mixtral-8x7B-DPO | Three-shot, text-only, bfloat16, 2024-02-27 | 55.4% | |||
| Nous-Hermes-2-Mixtral-8x7B-DPO | Three-shot, text-only, float16, 2024-02-21 | 55.4% | |||
| Yi-9B | Three-shot, text-only, bfloat16, 2024-04-13 | 54.9% | |||
| Three-shot, text-only, bfloat16, 2024-05-15 | 54.8% | ||||
| Three-shot, text-only, float16, 2024-10-24 | 54.4% | ||||
| Three-shot, text-only, bfloat16, 2024-04-08 | 54.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-23 | 54.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-23 | 54% | ||||
| Three-shot, text-only, bfloat16, 2024-03-29 | 53.8% | ||||
| Three-shot, text-only, bfloat16, 2024-04-17 | 53.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-17 | 53% | ||||
| Three-shot, text-only, bfloat16, 2025-01-28 | 52.9% | ||||
| internlm-20b | Three-shot, text-only, bfloat16, 2024-02-05 | 52.6% | |||
| Three-shot, text-only, bfloat16, 2024-05-22 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-26 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-24 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-18 | 52.2% | ||||
| Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 | 52% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 51.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 51.3% | ||||
| Three-shot, text-only, bfloat16, 2024-04-14 | 51% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 50.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 50.2% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 50.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-27 | 50.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 49.6% | ||||
| Three-shot, text-only, bfloat16, 2024-05-17 | 49% | ||||
| Three-shot, text-only, float16, 2024-04-18 | 48.8% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 48.7% | ||||
| Three-shot, text-only, bfloat16, 2024-08-09 | 48.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 48% | ||||
| Three-shot, text-only, bfloat16, 2024-04-07 | 47.7% | ||||
| Three-shot, text-only, 8bit, 2024-08-09 | 47.6% | ||||
| Three-shot, text-only, bfloat16, 2025-07-15 | 47.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-23 | 46.6% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 46.5% | ||||
| Three-shot, text-only, bfloat16, 2024-05-16 | 46.3% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 46.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-17 | 45.6% | ||||
| Three-shot, text-only, 4bit, 2025-01-29 | 45.6% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 45.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 43.4% | ||||
| LFM2-1.2B | Three-shot, text-only, bfloat16, 2025-08-30 | 42.3% | |||
| Three-shot, text-only, bfloat16, 2024-05-27 | 41.6% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 38.7% | ||||
| gpt-oss-20b | Three-shot, text-only, bfloat16, 2025-08-29 | 37.7% | |||
| Three-shot, text-only, bfloat16, 2024-02-17 | 37.5% | ||||
| Three-shot, text-only, float16, 2025-09-01 | 37.4% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 36% | ||||
| ChatGLM3-6B | Three-shot, text-only, float16, 2024-02-19 | 35.6% | |||
| Three-shot, text-only, bfloat16, 2024-06-07 | 34.5% | ||||
| internlm-7b | Three-shot, text-only, float16, 2024-02-05 | 33.5% | |||
| Three-shot, text-only, bfloat16, 2025-04-04 | 33% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 32.8% | ||||
| Three-shot, text-only, bfloat16, 2024-10-13 | 32.8% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 31.6% | ||||
| Three-shot, text-only, bfloat16, 2024-05-17 | 30.3% | ||||
| chatglm2-6b | Three-shot, text-only, float16, 2024-04-05 | 29.9% | |||
| Three-shot, text-only, bfloat16, 2025-01-29 | 29.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 28.4% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 27% | ||||
| Baichuan2-13B-Chat | Three-shot, text-only, bfloat16, 2024-05-27 | 26.3% | |||
| Qwen-1_8B | Three-shot, text-only, float16, 2024-04-18 | 26.3% | |||
| Qwen-1_8B | Three-shot, text-only, bfloat16, 2024-02-05 | 26.1% | |||
| Three-shot, text-only, float16, 2024-02-05 | 25.6% | ||||
| gpt-oss-120b | Three-shot, text-only, bfloat16, 2025-08-29 | 25.6% | |||
| Three-shot, text-only, float16, 2024-07-22 | 25.3% | ||||
| RedPajama-INCITE-7B-Base | Three-shot, text-only, float16, 2024-02-05 | 25% | |||
| Three-shot, text-only, bfloat16, 2024-04-07 | 24.9% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 24.9% | ||||
| Three-shot, text-only, float16, 2024-02-11 | 24.2% | ||||
| Emu3-Chat | Three-shot, text-only, bfloat16, 2024-10-21 | 24.1% | |||
| Three-shot, text-only, float16, 2024-02-05 | 23.9% | ||||
| GPT-J-6B | Three-shot, text-only, float16, 2024-02-05 | 23.6% | |||
| Three-shot, text-only, float16, 2024-02-11 | 23.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 23.5% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 23.4% | ||||
| GPT-NeoX-20B | Three-shot, text-only, float16, 2024-02-05 | 22.8% | |||
| Three-shot, text-only, float16, 2024-07-22 | 22.8% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 22.7% | ||||
| Three-shot, text-only, bfloat16, 2024-06-07 | 22.5% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 22.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 22% | ||||
| open_llama_7b | Three-shot, text-only, float16, 2024-02-11 | 22% | |||
| GPT-Neo-2.7B | Three-shot, text-only, float16, 2024-02-05 | 21.7% | |||
| Three-shot, text-only, bfloat16, 2024-11-12 | 20% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 19.2% | ||||
| Three-shot, text-only, float16, 2024-07-22 | 19.2% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 18.6% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 18.5% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 18.2% | ||||
| Three-shot, text-only, rev: refs/pr/33, bfloat16, 2024-04-19 | 17.7% | ||||
| Three-shot, text-only, bfloat16, 2025-01-28 | 13.9% | ||||
| T5-Large | Three-shot, text-only, bfloat16, 2024-02-05 | 13.5% | |||
| T5-Small | Three-shot, text-only, bfloat16, 2024-02-05 | 13.1% | |||
| T5-Base | Three-shot, text-only, bfloat16, 2024-02-05 | 10.2% | |||
| Three-shot, text-only, bfloat16, 2024-12-03 | 6.68% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 0.14% | ||||
| Three-shot, text-only, float16, 2025-08-30 | 0% |
Scores at each effort level
Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.
Source: Open Portuguese LLM Leaderboard’s leaderboard
| Model | Effort | Harness | Score | Cost per task | Output tokens |
|---|---|---|---|---|---|
| Three-shot, text-only, reasoning, 2025-04-03 | 95% | ||||
| GPT-5 mini | Three-shot, text-only, reasoning, 2025-09-01 | 91.4% | |||
| Grok-3 mini | Three-shot, text-only, reasoning, 2025-09-01 | 89.8% | |||
| Three-shot, text-only, 2025-09-01 | 86.5% | ||||
| Three-shot, text-only, 4bit, 2025-05-01 | 85.8% | ||||
| GPT-5 nano | Three-shot, text-only, reasoning, 2025-09-01 | 85.3% | |||
| Claude 3.7 Sonnet | Three-shot, text-only, 2025-04-04 | 84.6% | |||
| Three-shot, text-only, 2025-04-03 | 84.1% | ||||
| Three-shot, text-only, reasoning: low, 2025-09-01 | 84% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 83.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 83% | ||||
| Kimi K2 Jul 2025 | Three-shot, text-only, 2025-09-01 | 82.8% | |||
| Three-shot, text-only, 2025-09-01 | 81.8% | ||||
| Three-shot, text-only, 2025-04-05 | 81.2% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 80.7% | ||||
| Three-shot, text-only, 2025-04-03 | 80.5% | ||||
| Three-shot, text-only, 2025-04-03 | 80.5% | ||||
| Three-shot, text-only, 2025-04-03 | 80.4% | ||||
| GPT-4o Aug 2024 | Three-shot, text-only, 2025-04-09 | 79.7% | |||
| Three-shot, text-only, bfloat16, 2024-09-18 | 79% | ||||
| GPT-5 | Three-shot, text-only, reasoning: minimal, 2025-09-01 | 78.9% | |||
| Three-shot, text-only, 2025-04-03 | 78.7% | ||||
| Three-shot, text-only, bfloat16, 2025-07-08 | 78.3% | ||||
| Three-shot, text-only, 2025-04-03 | 78% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 78% | ||||
| Three-shot, text-only, 4bit, 2024-12-04 | 77.6% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 76.9% | ||||
| Three-shot, text-only, bfloat16, 2024-09-18 | 76.8% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 76.6% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 76.5% | ||||
| Three-shot, text-only, 2025-04-03 | 76.1% | ||||
| Three-shot, text-only, 2025-04-03 | 75.9% | ||||
| Three-shot, text-only, 2024-08-09 | 75.8% | ||||
| Three-shot, text-only, bfloat16, 2024-06-08 | 75.4% | ||||
| Three-shot, text-only, bfloat16, 2024-06-08 | 75% | ||||
| Three-shot, text-only, 4bit, 2024-08-12 | 74.4% | ||||
| Three-shot, text-only, 2025-09-01 | 73.3% | ||||
| Three-shot, text-only, bfloat16, 2025-01-31 | 72% | ||||
| Three-shot, text-only, bfloat16, 2024-07-23 | 71.2% | ||||
| Three-shot, text-only, 4bit, 2024-12-05 | 71.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-18 | 70.4% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 70.2% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 68.2% | ||||
| Three-shot, text-only, bfloat16, 2024-07-02 | 68% | ||||
| Three-shot, text-only, 4bit, 2024-05-23 | 67.9% | ||||
| Qwen2.5-Coder-14B | Three-shot, text-only, bfloat16, 2024-11-12 | 67.9% | |||
| qwen3-4b-instruct-2507 | Three-shot, text-only, bfloat16, 2025-08-30 | 67.7% | |||
| Three-shot, text-only, bfloat16, 2024-02-18 | 67.6% | ||||
| Three-shot, text-only, bfloat16, 2024-11-12 | 67.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-15 | 66.6% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 66.6% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 66.5% | ||||
| Qwen2.5-Coder-14B-Instruct | Three-shot, text-only, bfloat16, 2024-11-12 | 66.5% | |||
| Three-shot, text-only, bfloat16, 2025-08-30 | 65.9% | ||||
| Three-shot, text-only, bfloat16, 2024-05-22 | 65.8% | ||||
| Three-shot, text-only, 4bit, 2024-05-22 | 65.8% | ||||
| Three-shot, text-only, 2024-06-30 | 65.8% | ||||
| c4ai-command-r-08-2024 | Three-shot, text-only, bfloat16, 2025-08-30 | 65.4% | |||
| Three-shot, text-only, float16, 2024-10-27 | 65.4% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 65.4% | ||||
| GLM-4-9B-Chat | Three-shot, text-only, float16, 2024-06-09 | 65% | |||
| GLM-4-9B-Chat | Three-shot, text-only, bfloat16, 2024-06-05 | 64.8% | |||
| GLM-4-9B | Three-shot, text-only, bfloat16, 2024-06-05 | 64.5% | |||
| Three-shot, text-only, bfloat16, 2024-02-05 | 64.3% | ||||
| Three-shot, text-only, 4bit, 2024-12-20 | 64.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 64.3% | ||||
| Three-shot, text-only, bfloat16, 2024-07-02 | 64% | ||||
| Three-shot, text-only, 4bit, 2024-12-05 | 63.4% | ||||
| Three-shot, text-only, bfloat16, 2024-03-05 | 63% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 62.9% | ||||
| GPT-3.5 Turbo Jan 2024 | Three-shot, text-only, 2024-03-08 | 62.5% | |||
| Three-shot, text-only, bfloat16, 2024-05-21 | 62.5% | ||||
| Three-shot, text-only, float16, 2024-04-05 | 62% | ||||
| GLM-4-9B-Chat-1M | Three-shot, text-only, bfloat16, 2024-06-05 | 61.9% | |||
| Three-shot, text-only, bfloat16, 2024-07-22 | 61.8% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 61.5% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 61.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2024-08-09 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 61.3% | ||||
| Three-shot, text-only, bfloat16, 2024-06-06 | 61.1% | ||||
| Three-shot, text-only, bfloat16, 2024-06-06 | 61.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-23 | 60.8% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 60.8% | ||||
| Aria | Three-shot, text-only, bfloat16, 2024-12-05 | 60.6% | |||
| Three-shot, text-only, bfloat16, 2024-09-18 | 60.2% | ||||
| Three-shot, text-only, bfloat16, 2024-07-23 | 59.9% | ||||
| Three-shot, text-only, bfloat16, 2024-12-05 | 59.3% | ||||
| Three-shot, text-only, 2024-03-08 | 58.7% | ||||
| Three-shot, text-only, float16, 2024-02-19 | 58.3% | ||||
| Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 | 57.9% | ||||
| Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 | 57.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-21 | 57.3% | ||||
| Granite-3.1-8B-Instruct | Three-shot, text-only, float16, 2025-08-29 | 57.3% | |||
| Three-shot, text-only, bfloat16, 2025-05-01 | 56.9% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 56.5% | ||||
| GLM-4-9B-Chat | Three-shot, text-only, bfloat16, 2024-12-05 | 56% | |||
| Three-shot, text-only, bfloat16, 2025-05-01 | 55.9% | ||||
| Three-shot, text-only, bfloat16, 2024-03-04 | 55.6% | ||||
| Three-shot, text-only, float16, 2024-04-18 | 55.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 55.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 55.4% | ||||
| Nous-Hermes-2-Mixtral-8x7B-DPO | Three-shot, text-only, bfloat16, 2024-02-27 | 55.4% | |||
| Nous-Hermes-2-Mixtral-8x7B-DPO | Three-shot, text-only, float16, 2024-02-21 | 55.4% | |||
| Yi-9B | Three-shot, text-only, bfloat16, 2024-04-13 | 54.9% | |||
| Three-shot, text-only, bfloat16, 2024-05-15 | 54.8% | ||||
| Three-shot, text-only, float16, 2024-10-24 | 54.4% | ||||
| Three-shot, text-only, bfloat16, 2024-04-08 | 54.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-23 | 54.1% | ||||
| Three-shot, text-only, bfloat16, 2024-04-23 | 54% | ||||
| Three-shot, text-only, bfloat16, 2024-03-29 | 53.8% | ||||
| Three-shot, text-only, bfloat16, 2024-04-17 | 53.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-17 | 53% | ||||
| Three-shot, text-only, bfloat16, 2025-01-28 | 52.9% | ||||
| internlm-20b | Three-shot, text-only, bfloat16, 2024-02-05 | 52.6% | |||
| Three-shot, text-only, bfloat16, 2024-05-22 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-05-26 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-24 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 52.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-18 | 52.2% | ||||
| Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 | 52% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 51.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 51.3% | ||||
| Three-shot, text-only, bfloat16, 2024-04-14 | 51% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 50.5% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 50.2% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 50.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-27 | 50.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 49.6% | ||||
| Three-shot, text-only, bfloat16, 2024-05-17 | 49% | ||||
| Three-shot, text-only, float16, 2024-04-18 | 48.8% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 48.7% | ||||
| Three-shot, text-only, bfloat16, 2024-08-09 | 48.1% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 48% | ||||
| Three-shot, text-only, bfloat16, 2024-04-07 | 47.7% | ||||
| Three-shot, text-only, 8bit, 2024-08-09 | 47.6% | ||||
| Three-shot, text-only, bfloat16, 2025-07-15 | 47.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-23 | 46.6% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 46.5% | ||||
| Three-shot, text-only, bfloat16, 2024-05-16 | 46.3% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 46.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-17 | 45.6% | ||||
| Three-shot, text-only, 4bit, 2025-01-29 | 45.6% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 45.3% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 43.4% | ||||
| LFM2-1.2B | Three-shot, text-only, bfloat16, 2025-08-30 | 42.3% | |||
| Three-shot, text-only, bfloat16, 2024-05-27 | 41.6% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 38.7% | ||||
| gpt-oss-20b | Three-shot, text-only, bfloat16, 2025-08-29 | 37.7% | |||
| Three-shot, text-only, bfloat16, 2024-02-17 | 37.5% | ||||
| Three-shot, text-only, float16, 2025-09-01 | 37.4% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 36% | ||||
| ChatGLM3-6B | Three-shot, text-only, float16, 2024-02-19 | 35.6% | |||
| Three-shot, text-only, bfloat16, 2024-06-07 | 34.5% | ||||
| internlm-7b | Three-shot, text-only, float16, 2024-02-05 | 33.5% | |||
| Three-shot, text-only, bfloat16, 2025-04-04 | 33% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 32.8% | ||||
| Three-shot, text-only, bfloat16, 2024-10-13 | 32.8% | ||||
| Three-shot, text-only, bfloat16, 2025-01-29 | 31.6% | ||||
| Three-shot, text-only, bfloat16, 2024-05-17 | 30.3% | ||||
| chatglm2-6b | Three-shot, text-only, float16, 2024-04-05 | 29.9% | |||
| Three-shot, text-only, bfloat16, 2025-01-29 | 29.2% | ||||
| Three-shot, text-only, bfloat16, 2024-02-21 | 28.4% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 27% | ||||
| Baichuan2-13B-Chat | Three-shot, text-only, bfloat16, 2024-05-27 | 26.3% | |||
| Qwen-1_8B | Three-shot, text-only, float16, 2024-04-18 | 26.3% | |||
| Qwen-1_8B | Three-shot, text-only, bfloat16, 2024-02-05 | 26.1% | |||
| Three-shot, text-only, float16, 2024-02-05 | 25.6% | ||||
| gpt-oss-120b | Three-shot, text-only, bfloat16, 2025-08-29 | 25.6% | |||
| Three-shot, text-only, float16, 2024-07-22 | 25.3% | ||||
| RedPajama-INCITE-7B-Base | Three-shot, text-only, float16, 2024-02-05 | 25% | |||
| Three-shot, text-only, bfloat16, 2024-04-07 | 24.9% | ||||
| Three-shot, text-only, bfloat16, 2025-05-01 | 24.9% | ||||
| Three-shot, text-only, float16, 2024-02-11 | 24.2% | ||||
| Emu3-Chat | Three-shot, text-only, bfloat16, 2024-10-21 | 24.1% | |||
| Three-shot, text-only, float16, 2024-02-05 | 23.9% | ||||
| GPT-J-6B | Three-shot, text-only, float16, 2024-02-05 | 23.6% | |||
| Three-shot, text-only, float16, 2024-02-11 | 23.5% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 23.5% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 23.4% | ||||
| GPT-NeoX-20B | Three-shot, text-only, float16, 2024-02-05 | 22.8% | |||
| Three-shot, text-only, float16, 2024-07-22 | 22.8% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 22.7% | ||||
| Three-shot, text-only, bfloat16, 2024-06-07 | 22.5% | ||||
| Three-shot, text-only, bfloat16, 2025-04-04 | 22.3% | ||||
| Three-shot, text-only, bfloat16, 2024-02-05 | 22% | ||||
| open_llama_7b | Three-shot, text-only, float16, 2024-02-11 | 22% | |||
| GPT-Neo-2.7B | Three-shot, text-only, float16, 2024-02-05 | 21.7% | |||
| Three-shot, text-only, bfloat16, 2024-11-12 | 20% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 19.2% | ||||
| Three-shot, text-only, float16, 2024-07-22 | 19.2% | ||||
| Three-shot, text-only, float16, 2024-02-05 | 18.6% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 18.5% | ||||
| Three-shot, text-only, bfloat16, 2025-08-30 | 18.2% | ||||
| Three-shot, text-only, rev: refs/pr/33, bfloat16, 2024-04-19 | 17.7% | ||||
| Three-shot, text-only, bfloat16, 2025-01-28 | 13.9% | ||||
| T5-Large | Three-shot, text-only, bfloat16, 2024-02-05 | 13.5% | |||
| T5-Small | Three-shot, text-only, bfloat16, 2024-02-05 | 13.1% | |||
| T5-Base | Three-shot, text-only, bfloat16, 2024-02-05 | 10.2% | |||
| Three-shot, text-only, bfloat16, 2024-12-03 | 6.68% | ||||
| Three-shot, text-only, bfloat16, 2024-12-03 | 0.14% | ||||
| Three-shot, text-only, float16, 2025-08-30 | 0% |
10 models have held number one on Open Portuguese LLM Leaderboard’s leaderboard since its release in July 2023
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Open Portuguese LLM Leaderboard’s leaderboard
Gemini 2.5 Pro on the official leaderboard passed 85% in March 2025
That was 20 months after its release. By the same age, 36% of the benchmarks from 2023 had passed 85%. All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Open Portuguese LLM Leaderboard’s leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Multilingual
- MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
- WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET.
K-EXAONE 90.5%
- MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language.
Qwen3.7-Max 87%
- CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories.
Solar Open 2 90.7%
- Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
- MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%
Data audit
All 8 checks pass. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
- Pass Independent runs Scores from the official leaderboard (1,165 entries).
- Pass Models scored 177 models we track, plus 988 other entries on its leaderboard.
- Note Newest score The newest came 15 months ago, in August 2025, for Keye-VL-1.5-8B. That’s expected for a saturated test.
- Note Frontier models None of the top 10 has a score, which is fine for a retired test. The strongest tested is GPT-5 (#71).
- Note Headroom Saturated. The best is 95%, past 85% since March 2025.
Leaderboard import 3 pass
- Pass Importer We read the board on Open Portuguese LLM Leaderboard: 202 rows for models we track and 988 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.