Benchmark Almanac

BLUEX

Gemini 2.5 Pro Mar 2025 95% leads since March 2025
Not in model cards

Models answer questions from two Brazilian university entrance examinations. The questions cover high school subjects in Portuguese.

Released
July 2023
Kind
Knowledge in many languages
Level
School
Scored
Checked automatically
Answers
Multiple choice
Tasks
All public
Measures
Capability
Language
Portuguese
In and out
Text, Images → Text
Interaction
Single turn
Items from
Exams and contests
Refresh
One fixed set
Run by
Anyone
Strongest model tested
GPT-5 #71 on the capability index
Last model added
August 2025
Scores refreshed
November 20th, 2026
1,165
Entries on Open Portuguese LLM Leaderboard’s leaderboard, 177 models we track

Gemini 2.5 Pro leads with 95% among models released by August 2025 Gemini 2.5 Pro leads with 95% among models released by August 2025

Best score per entry from Open Portuguese LLM Leaderboard’s leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Every run is in the next chart. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. This view shows only models we track, each at its best.

The newest model with a score here came out in August 2025, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

1165 entries. Scroll sideways for the rest.

  1. 95.0 Gemini 2.5 Pro
  2. 91.4 GPT-5 mini
  3. 89.8 Grok-3 mini
  4. 86.5 Gemini 2.5 Flash
  5. 85.8 Qwen3-32B
  6. 85.3 GPT-5 nano
  7. 84.6 Claude 3.7 Sonnet
  8. 84.1 DeepSeek-V3
  9. 84.0 Gemini 2.5 Flash-Lite
  10. 83.3 Qwen3-14B
  11. 83.0 Qwen3-30B-A3B
  12. 82.8 Kimi K2
  13. 81.8 DeepSeek-V3.1
  14. 81.8 Sabiá-3.1 (2025-05-08)
  15. 81.2 Llama 4 Maverick
  16. 80.7 Qwen3-8B
  17. 80.5 Qwen2.5-VL-72B
  18. 80.5 Qwen2.5-VL-32B
  19. 80.4 Gemini 2.0 Flash
  20. 80.1 meta-llama/Llama-3.1-405B-Instruct (Vertex AI)
  21. 79.7 GPT-4o
  22. 79.0 Sabiá-3 (2024-07-15)
  23. 79.0 Qwen2.5-72B
  24. 78.9 GPT-5
  25. 78.7 Gemini 2.0 Flash-Lite
  26. 78.7 Sabiá-3 (2024-12-11)
  27. 78.6 huihui-ai/Qwen2.5-32B-Instruct-abliterated
  28. 78.6 rombodawg/Rombos-LLM-V2.5-Qwen-32b
  29. 78.6 Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B
  30. 78.6 Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B
  31. 78.4 maldv/Qwentile2.5-32B-Instruct
  32. 78.3 Qwen/Qwen2.5-32B-Instruct
  33. 78.3 AXCXEPT/EZO-Qwen2.5-32B-Instruct
  34. 78.3 Sakalti/Oxyge1-33B
  35. 78.3 Falcon-H1-34B
  36. 78.0 fblgit/TheBeagle-v2beta-32B-MGS
  37. 78.0 Qwen3-4B
  38. 77.8 tiiuae/Falcon-H1-34B-Base
  39. 77.6 huihui-ai/QwQ-32B-Coder-Fusion-9010
  40. 77.2 Gemini 1.5 Pro Preview (0409)
  41. 76.9 Qwen3-30B-A3B-Instruct
  42. 76.8 Qwen2.5-32B
  43. 76.6 QwQ-32B-Preview
  44. 76.5 huihui-ai/QwQ-32B-Preview-abliterated
  45. 76.5 DeepSeek-R1-Distill-Qwen-14B
  46. 76.5 OpenBuddy/openbuddy-qwq-32b-v24.1-200k
  47. 76.1 Gemini 1.5 Flash
  48. 75.9 Llama 3.3 70B Instruct
  49. 75.8 Gemini 1.5 Flash
  50. 75.4 Qwen2-72B
  51. 75.4 google/medgemma-27b-text-it
  52. 75.1 meta-llama/Meta-Llama-3.1-70B-Instruct
  53. 75.1 amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct
  54. 74.8 Gemini 1.5 Flash Preview (0514)
  55. 74.8 nisten/franqwenstein-35b
  56. 74.8 meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI)
  57. 74.5 arcee-ai/Virtuoso-Small
  58. 74.1 prithivMLmods/Megatron-Opus-14B-Exp
  59. 74.0 sometimesanotion/Qwen2.5-14B-Vimarckoso-v3
  60. 74.0 mistralai/Mistral-Small-24B-Base-2501
  61. 73.8 google/gemma-3-27b-it (GoogleAI API)
  62. 73.7 Replete-AI/Replete-LLM-V2.5-Qwen-14b
  63. 73.6 rombodawg/Rombos-LLM-V2.6-Qwen-14b
  64. 73.6 hotmailuser/QwenSlerp2-14B
  65. 73.6 sometimesanotion/Lamarck-14B-v0.6
  66. 73.6 sometimesanotion/Lamarck-14B-v0.7
  67. 73.4 meta-llama/Meta-Llama-3-70B-Instruct
  68. 73.4 v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno
  69. 73.4 allknowingroger/Qwen2.5-slerp-14B
  70. 73.4 mistralai/Mistral-Small-24B-Instruct-2501
  71. 73.4 Sabiázinho-3 (2025-02-06)
  72. 73.3 Qwen/Qwen2.5-14B-Instruct
  73. 73.3 Lambent/qwen2.5-reinstruct-alternate-lumen-14B
  74. 73.3 v000000/Qwen2.5-14B-Gutenberg-1e-Delta
  75. 73.3 CultriX/Qwen2.5-14B-Wernicke
  76. 73.3 allknowingroger/QwenSlerp6-14B
  77. 73.2 tanliboy/lambda-qwen2.5-14b-dpo-test
  78. 73.2 Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4
  79. 72.5 CultriX/SeQwence-14Bv1
  80. 72.3 janhq/Jan-v1-4B
  81. 72.2 meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API)
  82. 72.0 arcee-ai/SuperNova-Medius
  83. 72.0 CultriX/Qwen2.5-14B-Wernicke-SFT
  84. 72.0 Qwen2.5-14B-Instruct-1M
  85. 71.8 Sabiá-2 Medium
  86. 71.8 Qwen/Qwen1.5-110B-Chat
  87. 71.6 AALF/gemma-2-27b-it-SimPO-37K-100steps
  88. 71.2 Llama 3.1-70B
  89. 71.1 byroneverson/gemma-2-27b-it-abliterated
  90. 71.1 Llama 3.2 90B
  91. 70.8 Qwen-Turbo (2024-11-01)
  92. 70.5 google/gemma-2-27b-it
  93. 70.4 Llama 3-70B
  94. 70.4 THUDM/GLM-Z1-9B-0414
  95. 70.2 Phi-4
  96. 70.1 botbot-ai/CabraLlama3-70b
  97. 70.1 tiiuae/Falcon-H1-7B-Instruct
  98. 69.5 abacusai/Smaug-Llama-3-70B-Instruct
  99. 69.5 DeepSeek-V2 Chat (API)
  100. 69.3 google/medgemma-27b-it
  101. 68.8 unsloth/llama-3-70b-Instruct-bnb-4bit
  102. 68.7 tiiuae/Falcon-H1-7B-Base
  103. 68.4 Qwen/Qwen-72B
  104. 68.4 GPT 4o Mini (2024-07-18)
  105. 68.3 abacusai/Smaug-72B-v0.1
  106. 68.2 unsloth/Llama-3.3-70B-Instruct-bnb-4bit
  107. 68.2 Gemma 3 12B PT
  108. 68.0 Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp
  109. 68.0 Gemma 2 27B
  110. 68.0 huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated
  111. 67.9 Qwen1.5-110B
  112. 67.9 01-ai/Yi-1.5-34B-32K
  113. 67.9 cognitivecomputations/dolphin-2.9.1-llama-3-70b
  114. 67.9 Qwen2.5-Coder-14B
  115. 67.7 qwen3-4b-instruct-2507
  116. 67.6 Qwen1.5-72B
  117. 67.6 Weyaxi/Bagel-Hermes-34B-Slerp
  118. 67.5 botbot-ai/Cabra-72b
  119. 67.3 unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit
  120. 67.3 Qwen2.5-Coder-32B-Instruct
  121. 67.2 mistral-community/Mixtral-8x22B-v0.1-4bit
  122. 67.2 Azure99/blossom-v5.1-34b
  123. 67.2 VAGOsolutions/SauerkrautLM-Qwen-32b
  124. 66.9 jondurbin/bagel-dpo-34b-v0.2
  125. 66.9 altomek/YiSM-34B-0rn
  126. 66.8 jondurbin/bagel-dpo-34b-v0.5
  127. 66.8 upstage/solar-pro-preview-instruct
  128. 66.6 Claude-3 Haiku (20240307)
  129. 66.6 Yi-1.5-34B
  130. 66.6 mistralai/Mixtral-8x22B-Instruct-v0.1
  131. 66.6 Orion-zhen/Qwen2.5-7B-Instruct-Uncensored
  132. 66.6 Gemma 3 12B
  133. 66.5 Yi-34B
  134. 66.5 SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit
  135. 66.5 01-ai/Yi-1.5-34B-Chat
  136. 66.5 Cran-May/T.E-8.1
  137. 66.5 Qwen2.5-Coder-14B-Instruct
  138. 66.5 Qwen/Qwen2.5-7B-Instruct-1M
  139. 66.3 adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1
  140. 66.2 CohereForAI/c4ai-command-r-plus-4bit
  141. 66.2 mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit
  142. 66.2 CombinHorizon/YiSM-blossom5.1-34B-SLERP
  143. 66.2 VAGOsolutions/SauerkrautLM-Phi-3-medium
  144. 66.1 CausalLM/34b-beta
  145. 65.9 Keye-VL-1.5-8B
  146. 65.8 NousResearch/Nous-Hermes-2-Yi-34B
  147. 65.8 abacusai/Smaug-34B-v0.1
  148. 65.8 WizardLM-2 8x22B
  149. 65.8 ConvexAI/Luminex-34B-v0.2
  150. 65.8 Nemotron-4-340B-Instruct
  151. 65.8 wenbopan/Faro-Yi-34B-DPO
  152. 65.8 Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO
  153. 65.7 Qwen/Qwen1.5-32B-Chat
  154. 65.7 recoilme/recoilme-gemma-2-9B-v0.4
  155. 65.5 anthracite-org/magnum-v3-9b-customgemma2
  156. 65.4 fblgit/UNA-SimpleSmaug-34b-v1beta
  157. 65.4 princeton-nlp/gemma-2-9b-it-SimPO
  158. 65.4 c4ai-command-r-08-2024
  159. 65.4 Aya Expanse 32B
  160. 65.4 OLMo 2 32B Instruct
  161. 65.4 baidu/ERNIE-4.5-21B-A3B-PT
  162. 65.2 Qwen/Qwen2-57B-A14B
  163. 65.2 Qwen/Qwen2-57B-A14B-Instruct
  164. 65.2 anthracite-org/magnum-v3-9b-chatml
  165. 65.0 GLM-4-9B-Chat
  166. 64.8 01-ai/Yi-34B-200K
  167. 64.8 152334H/miqu-1-70b-sf
  168. 64.8 migtissera/Tess-M-v1.3
  169. 64.8 ConvexAI/Luminex-34B-v0.1
  170. 64.8 wenbopan/Faro-Yi-34B
  171. 64.8 BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference
  172. 64.7 anthracite-org/magnum-v3-27b-kto
  173. 64.7 huihui-ai/Qwen2.5-7B-Instruct-abliterated
  174. 64.7 Gemini 1.5 Flash 8B (001)
  175. 64.5 GLM-4-9B
  176. 64.5 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated
  177. 64.5 Qwen/Qwen2.5-7B-Instruct
  178. 64.5 tiiuae/Falcon3-10B-Base
  179. 64.3 Mixtral 8x7B
  180. 64.3 recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp
  181. 64.3 TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule
  182. 64.3 Qwen3-1.7B
  183. 64.1 botbot-ai/CabraMixtral-8x7b
  184. 64.0 Gemma 2 9B
  185. 64.0 recoilme/recoilme-gemma-2-9B-v0.2
  186. 64.0 arcee-ai/Virtuoso-Lite
  187. 63.7 Replete-AI/Replete-LLM-V2.5-Qwen-7b
  188. 63.7 sethuiyer/Qwen2.5-7B-Anvita
  189. 63.6 cognitivecomputations/dolphin-2.9.1-yi-1.5-34b
  190. 63.6 google/gemma-2-9b-it
  191. 63.6 TheDrummer/Gemmasutra-9B-v1
  192. 63.6 huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2
  193. 63.4 Phi-3.5-MoE
  194. 63.4 OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k
  195. 63.3 01-ai/Yi-34B-Chat
  196. 63.3 lucianosb/boto-9B
  197. 63.3 rhymes-ai/Aria-Base-64K
  198. 63.1 THUDM/GLM-4-9B-0414
  199. 63.0 Tulu 2 DPO 70B
  200. 63.0 NousResearch/Nous-Capybara-34B
  201. 63.0 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2
  202. 63.0 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3
  203. 62.9 Falcon3-10B-Instruct
  204. 62.7 speakleash/Bielik-11B-v2.2-Instruct
  205. 62.6 speakleash/Bielik-11B-v2.1-Instruct
  206. 62.5 GPT-3.5 Turbo
  207. 62.5 phi-3-medium 14B
  208. 62.5 microsoft/Phi-3-small-128k-instruct
  209. 62.5 cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b
  210. 62.3 PrunaAI/dbrx-base-bnb-4bit
  211. 62.3 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2
  212. 62.3 recoilme/recoilme-gemma-2-9B-v0.3
  213. 62.3 speakleash/Bielik-11B-v2.3-Instruct
  214. 62.2 chujiezheng/Smaug-34B-v0.1-ExPO
  215. 62.2 jpacifico/Chocolatine-14B-Instruct-4k-DPO
  216. 62.2 MarinaraSpaghetti/NemoReRemix-12B
  217. 62.0 Command R (03-2024)
  218. 62.0 PrunaAI/dbrx-instruct-bnb-4bit
  219. 62.0 OrionStarAI/OrionStar-Yi-34B-Chat
  220. 62.0 Weyaxi/Einstein-v7-Qwen2-7B
  221. 61.9 GLM-4-9B-Chat-1M
  222. 61.9 tiiuae/Falcon-H1-3B-Instruct
  223. 61.8 Mistral-Nemo-Base-2407
  224. 61.8 NLPark/AnFeng_v3.1-Avocet
  225. 61.8 MaziyarPanahi/calme-2.4-qwen2-7b
  226. 61.8 allknowingroger/Ph3della5-14B
  227. 61.6 macadeliccc/Samantha-Qwen-2-7B
  228. 61.5 phi-3-small 7.4B
  229. 61.5 Phi-3-medium-128k-instruct
  230. 61.5 mistralai/Mistral-Nemo-Instruct-2407
  231. 61.5 speakleash/Bielik-11B-v2.0-Instruct
  232. 61.3 Llama 2-70B
  233. 61.3 OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k
  234. 61.3 InternLM2.5-20B-Chat
  235. 61.3 Falcon3-7B-Instruct
  236. 61.2 informatiker/Qwen2-7B-Instruct-abliterated
  237. 61.2 MaziyarPanahi/calme-2.2-qwen2-7b
  238. 61.2 natong19/Mistral-Nemo-Instruct-2407-abliterated
  239. 61.1 Qwen2-7B
  240. 61.1 Qwen2-7B-Instruct
  241. 60.9 migtissera/Tess-v2.5-Phi-3-medium-128k-14B
  242. 60.9 arcee-ai/Arcee-Spark
  243. 60.8 Qwen1.5-14B-Chat
  244. 60.8 nicolasdec/CabraQwen14b
  245. 60.8 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium
  246. 60.8 lucianosb/boto-9B-it
  247. 60.8 axolotl-ai-co/romulus-mistral-nemo-12b-simpo
  248. 60.8 v000000/L3.1-Niitorm-8B-DPO-t0.0001
  249. 60.8 Qwen3-4B-Thinking-2507
  250. 60.6 BAAI/Infinity-Instruct-3M-0625-Qwen2-7B
  251. 60.6 Aria
  252. 60.6 byroneverson/Mistral-Small-Instruct-2409-abliterated
  253. 60.5 jaspionjader/f-9-8b
  254. 60.4 natong19/Qwen2-7B-Instruct-abliterated
  255. 60.4 meta-llama/Llama-3.2-11B-Vision
  256. 60.2 argilla/notux-8x7b-v1
  257. 60.2 CohereForAI/aya-23-35B
  258. 60.2 mlabonne/NeuralDaredevil-8B-abliterated
  259. 60.2 SeaLLMs/SeaLLMs-v3-7B-Chat
  260. 60.2 grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter
  261. 60.2 Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base
  262. 60.2 Sao10K/L3.1-8B-Niitama-v1.1
  263. 60.1 vicgalle/CarbonBeagle-11B-truthy
  264. 60.1 mlabonne/Daredevil-8B-abliterated
  265. 60.1 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25
  266. 60.1 nbeerbower/mistral-nemo-wissenschaft-12B
  267. 60.1 arcee-ai/Llama-3.1-SuperNova-Lite
  268. 60.1 tiiuae/Falcon3-7B-Base
  269. 59.9 Llama 3.1-8B
  270. 59.8 mistralai/Mixtral-8x7B-Instruct-v0.1
  271. 59.8 WizardLMTeam/WizardLM-70B-V1.0
  272. 59.8 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated
  273. 59.8 JJhooww/Qwen2-7B_reload_v1
  274. 59.8 THUDM/LongWriter-glm4-9b
  275. 59.8 meta-llama/Llama-3.1-8B-Instruct
  276. 59.7 ai21labs/Jamba-v0.1
  277. 59.5 cognitivecomputations/dolphin-2.9.2-qwen2-7b
  278. 59.4 Kukedlc/NeuralLLaMa-3-8b-DT-v0.1
  279. 59.4 bunnycore/HyperLlama-3.1-8B
  280. 59.3 failspy/Phi-3-medium-4k-instruct-abliterated-v3
  281. 59.3 MaziyarPanahi/Llama-3-8B-Instruct-v0.8
  282. 59.3 Llama 3.2 11B
  283. 59.3 princeton-nlp/gemma-2-9b-it-DPO
  284. 59.3 RDson/WomboCombo-R1-Coder-14B-Preview
  285. 59.1 rhaymison/Mistral-8x7b-portuguese-luana
  286. 59.1 mlabonne/ChimeraLlama-3-8B-v3
  287. 59.0 upstage/SOLAR-10.7B-v1.0
  288. 59.0 vicgalle/ConfigurableBeagle-11B
  289. 59.0 recogna-nlp/Bode-3.1-8B-Instruct-full
  290. 59.0 deepcogito/cogito-v1-preview-llama-8B
  291. 59.0 tiiuae/Falcon-H1-3B-Base
  292. 58.8 lightblue/suzume-llama-3-8B-multilingual
  293. 58.8 uygarkurt/llama-3-merged-linear
  294. 58.8 DeepMount00/Llama-3-8b-Ita
  295. 58.8 meta-llama/Meta-Llama-3.1-8B-Instruct
  296. 58.8 BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B
  297. 58.8 BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B
  298. 58.8 BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B
  299. 58.8 v000000/SwallowMaid-8B-L3-SPPO-abliterated
  300. 58.7 Gemini 1.0 Pro
  301. 58.7 OrionStarAI/Orion-14B-Base
  302. 58.7 recogna-nlp/internlm-chatbode-20b
  303. 58.7 internlm/internlm2_5-7b-chat-1m
  304. 58.7 vicgalle/Configurable-Llama-3.1-8B-Instruct
  305. 58.7 freewheelin/free-llama3-dpo-v0.2
  306. 58.7 Eurdem/Defne-llama3.1-8B
  307. 58.7 unsloth/Meta-Llama-3.1-70B-bnb-4bit
  308. 58.5 internlm/internlm2-20b
  309. 58.5 PrunaAI/Jamba-v0.1-bnb-4bit
  310. 58.5 VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct
  311. 58.5 shadowml/Mixolar-4x7b
  312. 58.5 OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k
  313. 58.5 speakleash/Bielik-11B-v2
  314. 58.4 invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp
  315. 58.4 VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct
  316. 58.4 MaziyarPanahi/Llama-3-8B-Instruct-v0.10
  317. 58.4 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule
  318. 58.3 SOLAR-10.7B-Instruct-v1.0
  319. 58.3 unsloth/llama-3-70b-bnb-4bit
  320. 58.3 Danielbrdz/Barcenas-Llama3-8b-ORPO
  321. 58.3 MaziyarPanahi/Llama-3-8B-Instruct-v0.9
  322. 58.3 princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2
  323. 58.3 princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2
  324. 58.3 princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2
  325. 58.3 princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2
  326. 58.1 kekmodel/StopCarbon-10.7B-v5
  327. 58.1 DeepMount00/Llama-3.1-8b-Ita
  328. 58.1 princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2
  329. 58.1 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2
  330. 58.0 jeonsworld/CarbonVillain-en-10.7B-v4
  331. 58.0 rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct
  332. 58.0 saltlux/luxia-21.4b-alignment-v1.0
  333. 58.0 failspy/Meta-Llama-3-8B-Instruct-abliterated-v3
  334. 58.0 saltlux/luxia-21.4b-alignment-v1.2
  335. 58.0 RLHFlow/LLaMA3-iterative-DPO-final
  336. 58.0 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3
  337. 58.0 dnhkng/RYS-Llama-3.1-8B-Instruct
  338. 57.9 internlm/internlm2-chat-20b
  339. 57.9 openchat/openchat-3.5-0106-gemma
  340. 57.9 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3
  341. 57.9 vicgalle/ConfigurableSOLAR-10.7B
  342. 57.9 Qwen2.5-Coder (7B)
  343. 57.7 01-ai/Yi-1.5-9B
  344. 57.7 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75
  345. 57.7 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2
  346. 57.7 Dampfinchen/Llama-3.1-8B-Ultra-Instruct
  347. 57.7 princeton-nlp/Llama-3-Instruct-8B-CPO
  348. 57.6 ibivibiv/llama-3-nectar-dpo-8B
  349. 57.6 princeton-nlp/Llama-3-Instruct-8B-KTO
  350. 57.6 anthracite-org/magnum-v2.5-12b-kto
  351. 57.6 Sao10K/L3-8B-Niitama-v1
  352. 57.4 VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct
  353. 57.4 migtissera/Trinity-2-Codestral-22B
  354. 57.4 princeton-nlp/Llama-3-Instruct-8B-RDPO
  355. 57.3 Llama 3-8B
  356. 57.3 internlm/internlm2-chat-20b-sft
  357. 57.3 mlabonne/Llama-3-8B-Instruct-abliterated-dpomix
  358. 57.3 princeton-nlp/Llama-3-Instruct-8B-SimPO
  359. 57.3 grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge
  360. 57.3 recogna-nlp/Bode-3.1-8B-Instruct-lora
  361. 57.3 EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection
  362. 57.3 princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2
  363. 57.3 princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2
  364. 57.3 princeton-nlp/Llama-3-Instruct-8B-RRHF
  365. 57.3 Granite-3.1-8B-Instruct
  366. 57.3 MagusCorp/grpo_lora_enem_llama3_7b
  367. 57.2 recogna-nlp/gembode-7b
  368. 57.2 unsloth/llama-3-8b-Instruct-bnb-4bit
  369. 57.2 vicgalle/Configurable-Llama-3-8B-v0.3
  370. 57.2 princeton-nlp/Llama-3-Instruct-8B-DPO
  371. 57.2 tiiuae/Falcon-H1-1.5B-Deep-Instruct
  372. 57.0 NousResearch/Hermes-2-Pro-Llama-3-8B
  373. 57.0 01-ai/Yi-1.5-9B-32K
  374. 57.0 NousResearch/Hermes-2-Theta-Llama-3-8B
  375. 57.0 arthrod/cicerollamatry8
  376. 57.0 maywell/Qwen2-7B-Multilingual-RP
  377. 56.9 botbot-ai/CabraLlama3-8b
  378. 56.9 jondurbin/bagel-8b-v1.0
  379. 56.9 vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B
  380. 56.9 BAAI/Infinity-Instruct-3M-0625-Llama3-8B
  381. 56.9 EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta
  382. 56.9 MaziyarPanahi/calme-2.7-qwen2-7b
  383. 56.9 Qwen/Qwen2.5-3B-Instruct
  384. 56.9 Phi-4-reasoning
  385. 56.8 qnguyen3/Master-Yi-9B
  386. 56.8 OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k
  387. 56.8 tobiaspires/command-r-p11-fn
  388. 56.8 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4
  389. 56.8 EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta
  390. 56.8 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta
  391. 56.8 grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge
  392. 56.6 01-ai/Yi-1.5-9B-Chat-16K
  393. 56.6 chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO
  394. 56.6 microsoft/Phi-3.5-mini-instruct
  395. 56.5 Gemma 7B
  396. 56.5 EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200
  397. 56.5 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule
  398. 56.3 rishiraj/CatPPT
  399. 56.3 VAGOsolutions/SauerkrautLM-Gemma-7b
  400. 56.3 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2
  401. 56.3 NousResearch/Hermes-3-Llama-3.1-8B
  402. 56.3 leafspark/Llama-3.1-8B-MultiReflection-Instruct
  403. 56.3 Qwen/Qwen2.5-Coder-7B-Instruct
  404. 56.2 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1
  405. 56.2 vicgalle/Configurable-Hermes-3-Llama-3.1-8B
  406. 56.2 MaziyarPanahi/calme-2.3-qwen2-7b
  407. 56.2 mistralai/Ministral-8B-Instruct-2410
  408. 56.2 cognitivecomputations/Dolphin3.0-R1-Mistral-24B
  409. 56.0 NousResearch/Nous-Hermes-2-SOLAR-10.7B
  410. 56.0 nicolasdec/CabraQwen7b
  411. 56.0 tiiuae/Falcon-H1-1.5B-Deep-Base
  412. 55.9 rishiraj/CatPPT-base
  413. 55.9 cognitivecomputations/dolphin-2.9.1-yi-1.5-9b
  414. 55.9 internlm/internlm2_5-7b-chat
  415. 55.9 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3
  416. 55.9 arcee-ai/Arcee-Scribe
  417. 55.9 princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2
  418. 55.9 EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos
  419. 55.9 Phi-4-Reasoning-plus
  420. 55.8 vicgalle/CarbonBeagle-11B
  421. 55.8 microsoft/MediPhi
  422. 55.6 Starling-LM-7B-alpha
  423. 55.6 SeaLLMs/SeaLLM-7B-v2.5
  424. 55.6 princeton-nlp/Llama-3-8B-ProLong-512k-Instruct
  425. 55.6 princeton-nlp/Llama-3-8B-ProLong-64k-Base
  426. 55.5 Qwen-14B
  427. 55.5 Sabiá-2 Small
  428. 55.5 lemon-mint/gemma-ko-7b-instruct-v0.62
  429. 55.5 wenbopan/Faro-Yi-9B
  430. 55.5 OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k
  431. 55.5 princeton-nlp/Llama-3-Instruct-8B-IPO
  432. 55.5 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF
  433. 55.4 LLaMA-65B
  434. 55.4 Nous-Hermes-2-Mixtral-8x7B-DPO
  435. 55.2 wenbopan/Faro-Yi-9B-DPO
  436. 55.2 Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1
  437. 55.2 terrycraddock/Reflection-Llama-3.1-8B
  438. 55.2 migtissera/Trinity-2-Codestral-22B-v0.2
  439. 55.2 MaziyarPanahi/calme-2.1-qwen2-7b
  440. 55.1 vicgalle/Configurable-Yi-1.5-9B-Chat
  441. 55.1 meraGPT/mera-mix-4x7B
  442. 55.1 BAAI/Infinity-Instruct-3M-0625-Mistral-7B
  443. 54.9 Yi-9B
  444. 54.9 FuseAI/FuseChat-7B-VaRM
  445. 54.9 unsloth/llama-3-8b-bnb-4bit
  446. 54.9 princeton-nlp/Llama-3-8B-ProLong-64k-Instruct
  447. 54.8 internlm/internlm2-base-20b
  448. 54.8 Yi-1.5-9B-Chat
  449. 54.8 ibivibiv/multimaster-7b-v6
  450. 54.8 MaziyarPanahi/Topxtral-4x7B-v0.1
  451. 54.8 Kukedlc/NeuralSynthesis-7B-v0.1
  452. 54.8 jsfs11/MixtureofMerges-MoE-4x7b-v5
  453. 54.8 mistralai/Codestral-22B-v0.1
  454. 54.8 cognitivecomputations/laserxtral
  455. 54.8 freewheelin/free-solar-evo-v0.1
  456. 54.7 FuseAI/OpenChat-3.5-7B-Solar
  457. 54.7 kevin009/llamaRAGdrama
  458. 54.7 cognitivecomputations/WestLake-7B-v2-laser
  459. 54.7 freewheelin/free-solar-evo-v0.13
  460. 54.7 princeton-nlp/Llama-3-Instruct-8B-ORPO
  461. 54.5 Kukedlc/NeuralSynthesis-7b-v0.4-slerp
  462. 54.5 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5
  463. 54.5 liminerity/M7-7b
  464. 54.5 freewheelin/free-solar-evo-v0.11
  465. 54.5 Magpie-Align/MagpieLM-8B-SFT-v0.1
  466. 54.5 rombodawg/rombos_Replete-Coder-Instruct-8b-Merged
  467. 54.4 paulml/OGNO-7B
  468. 54.4 MaziyarPanahi/Mistral-7B-Instruct-Aya-101
  469. 54.4 J-LAB/BRisa-7B-Instruct-v0.2
  470. 54.4 Kquant03/CognitiveFusion2-4x7B-BF16
  471. 54.4 NotAiLOL/Yi-1.5-dolphin-9B
  472. 54.4 01-ai/Yi-9B-200K
  473. 54.4 allknowingroger/MultiverseEx26-7B-slerp
  474. 54.4 EpistemeAI/Fireball-3.1-8B-ORPO
  475. 54.4 Aya Expanse 8B
  476. 54.2 bardsai/jaskier-7b-dpo-v5.6
  477. 54.2 teknium/OpenHermes-2-Mistral-7B
  478. 54.2 automerger/YamshadowExperiment28-7B
  479. 54.2 Kukedlc/NeuralSynthesis-7B-v0.3
  480. 54.2 TIGER-Lab/AceCodeRM-7B
  481. 54.1 Qwen1.5-32B
  482. 54.1 NousResearch/Nous-Hermes-2-Mistral-7B-DPO
  483. 54.1 stabilityai/stablelm-2-12b
  484. 54.1 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1
  485. 54.1 Phi-3-mini-128k-instruct
  486. 54.1 zhengr/MixTAO-7Bx2-MoE-v8.1
  487. 54.1 jsfs11/MixtureofMerges-MoE-4x7b-v4
  488. 54.1 J-LAB/FluxiIA-Small
  489. 54.0 JJhooww/Mistral-7B-v0.2-Base_ptbr
  490. 54.0 phi-3-mini 3.8B
  491. 54.0 princeton-nlp/Llama-3-Base-8B-SFT-ORPO
  492. 54.0 princeton-nlp/Llama-3-Base-8B-SFT-RDPO
  493. 54.0 EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic
  494. 53.8 Starling-LM-7B-beta
  495. 53.8 Walmart-the-bag/Misted-v2-7B
  496. 53.8 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2
  497. 53.8 internlm/internlm2-wqx-20b
  498. 53.8 princeton-nlp/Llama-3-Base-8B-SFT-RRHF
  499. 53.8 kurakurai/Luth-1.7B-Instruct
  500. 53.8 utter-project/EuroLLM-9B-Instruct
  501. 53.7 Walmart-the-bag/WordWoven-2x7B
  502. 53.7 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3
  503. 53.7 adalbertojunior/Llama-3-8B-Dolphin-Portuguese
  504. 53.7 abacusai/Slerp-CM-mist-dpo
  505. 53.7 ValiantLabs/Llama3.1-8B-Cobalt
  506. 53.7 princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF
  507. 53.7 HuggingFaceTB/SmolLM3-3B-Base
  508. 53.5 01-ai/Yi-9B-200k
  509. 53.5 eduagarcia/mistral-orpo-mix-21k
  510. 53.5 EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto
  511. 53.4 kaist-ai/mistral-orpo-capybara-7k
  512. 53.4 yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B
  513. 53.4 CultriX/NeuralMona_MoE-4x7B
  514. 53.4 Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R
  515. 53.4 RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2
  516. 53.4 Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3
  517. 53.4 mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated
  518. 53.4 princeton-nlp/Mistral-7B-Instruct-SimPO
  519. 53.4 princeton-nlp/Llama-3-Base-8B-SFT-DPO
  520. 53.3 BAAI/Infinity-Instruct-3M-0613-Mistral-7B
  521. 53.3 J-LAB/Nemo_RolePlay_PTBR_new
  522. 53.3 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2
  523. 53.3 byroneverson/Yi-1.5-9B-Chat-16K-abliterated
  524. 53.1 Mistral 7B v0.2
  525. 53.1 eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1
  526. 53.1 mistralai/Mistral-7B-Instruct-v0.3
  527. 53.1 MaziyarPanahi/Mistral-7B-Instruct-v0.3
  528. 53.1 yunconglong/MoE_13B_DPO
  529. 53.1 cognitivecomputations/openchat-3.5-0106-laser
  530. 53.1 Magpie-Align/Llama-3-8B-Magpie-Align-v0.3
  531. 53.0 leliuga/Phi-3-mini-4k-instruct-bnb-4bit
  532. 53.0 princeton-nlp/Llama-3-Base-8B-SFT-CPO
  533. 53.0 utter-project/EuroLLM-9B
  534. 52.9 teknium/OpenHermes-2.5-Mistral-7B
  535. 52.9 unsloth/Phi-3-mini-4k-instruct-bnb-4bit
  536. 52.9 DeepSeek-R1-Distill-Qwen-7B
  537. 52.9 tiiuae/Falcon-H1-1.5B-Instruct
  538. 52.7 openchat/openchat-3.5-0106
  539. 52.7 eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1
  540. 52.7 Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5
  541. 52.7 Magpie-Align/MagpieLM-8B-Chat-v0.1
  542. 52.7 princeton-nlp/Llama-3-Base-8B-SFT-IPO
  543. 52.7 princeton-nlp/Mistral-7B-Instruct-KTO
  544. 52.6 internlm-20b
  545. 52.6 mlabonne/Monarch-7B
  546. 52.6 JJhooww/Mistral_Relora_Step2k
  547. 52.6 princeton-nlp/Llama-3-Base-8B-SFT-SimPO
  548. 52.6 Qwen/Qwen2.5-1.5B-Instruct
  549. 52.6 utter-project/EuroLLM-22B-Instruct-Preview
  550. 52.4 internlm/internlm2-7b
  551. 52.4 argilla/CapybaraHermes-2.5-Mistral-7B
  552. 52.4 unsloth/gemma-7b-bnb-4bit
  553. 52.4 eduagarcia/mistral-orpo-capybara-3k
  554. 52.4 recogna-nlp/internlm-chatbode2-7b-beta
  555. 52.3 Mistral 7B v0.3
  556. 52.3 Qwen1.5-7B-Chat
  557. 52.3 yunconglong/DARE_TIES_13B
  558. 52.3 uukuguy/speechless-zephyr-code-functionary-7b
  559. 52.3 princeton-nlp/Llama-3-Base-8B-SFT
  560. 52.3 meta-llama/Llama-3.2-3B-Instruct
  561. 52.3 Gemma 3 4B
  562. 52.2 Mistral-7B-Instruct-v0.2
  563. 52.2 alvarobartt/Mistral-7B-v0.1-ORPO
  564. 52.2 tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1
  565. 52.2 princeton-nlp/Llama-3-Base-8B-SFT-KTO
  566. 52.0 Qwen/Qwen1.5-MoE-A2.7B-Chat
  567. 52.0 mlabonne/Beyonder-4x7B-v3
  568. 52.0 uukuguy/zephyr-7b-alpha-dare-0.85
  569. 52.0 01-ai/Yi-1.5-34B-Chat-16K
  570. 52.0 dzakwan/dzakwan-MoE-4x7b-Beta
  571. 52.0 Qwen2.5-7B
  572. 52.0 kaist-ai/janus-dpo-7b
  573. 51.9 huggyllama/llama-30b
  574. 51.9 eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1
  575. 51.9 princeton-nlp/Mistral-7B-Instruct-RRHF
  576. 51.9 BornSaint/Dare_Angel_8B
  577. 51.7 rhaymison/Llama3-portuguese-luana-8b-instruct
  578. 51.7 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4
  579. 51.7 SeaLLMs/SeaLLM-7B-v2
  580. 51.7 abacusai/bigstral-12b-32k
  581. 51.7 abacusai/bigyi-15b
  582. 51.7 byroneverson/Yi-1.5-9B-Chat-abliterated
  583. 51.6 internlm/internlm2-chat-7b-sft
  584. 51.6 eduagarcia/mistral-orpo-mix-7k
  585. 51.6 rombodawg/Everyone-Coder-4x7b-Base
  586. 51.5 recogna-nlp/internlm-chatbode-7b
  587. 51.5 vicgalle/Configurable-Mistral-7B
  588. 51.5 vicgalle/ConfigurableHermes-7B
  589. 51.5 princeton-nlp/Mistral-7B-Instruct-DPO
  590. 51.5 Qwen3-14B-Base
  591. 51.3 Yi 6B
  592. 51.3 Skywork/Skywork-13B-base
  593. 51.3 bartowski/internlm2-chat-7b-llama
  594. 51.3 uukuguy/speechless-code-mistral-7b-v1.0
  595. 51.2 unsloth/mistral-7b-v0.3-bnb-4bit
  596. 51.2 openchat/openchat-3.6-8b-20240522
  597. 51.2 shadowml/BeagSake-7B
  598. 51.2 rombodawg/rombos_Replete-Coder-Llama3-8B
  599. 51.0 Zephyr 7B Alpha
  600. 51.0 MagusCorp/legislinho
  601. 51.0 GritLM/GritLM-7B-KTO
  602. 51.0 beowolx/CodeNinja-1.0-OpenChat-7B
  603. 51.0 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3
  604. 51.0 princeton-nlp/Mistral-7B-Instruct-CPO
  605. 50.8 internlm/internlm2-chat-7b
  606. 50.8 gradientai/Llama-3-8B-Instruct-262k
  607. 50.6 AetherResearch/Cerebrum-1.0-7b
  608. 50.6 rhaymison/phi-3-portuguese-tom-cat-4k-instruct
  609. 50.6 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2
  610. 50.6 mlabonne/FineLlama-3.1-8B
  611. 50.6 princeton-nlp/Mistral-7B-Instruct-RDPO
  612. 50.5 argilla/notus-7b-v1
  613. 50.5 Llama 3.2 3B
  614. 50.5 princeton-nlp/Mistral-7B-Instruct-ORPO
  615. 50.5 Qwen/Qwen3-1.7B-Base
  616. 50.4 Intel/neural-chat-7b-v3-3
  617. 50.2 Mistral 7B v0.1
  618. 50.2 THUDM/chatglm3-6b-base
  619. 50.2 lmsys/vicuna-33b-v1.3
  620. 50.2 kaist-ai/janus-7b
  621. 50.2 Qwen3-30B-A3B-Base
  622. 50.1 Yi-6B-Chat
  623. 50.1 recogna-nlp/internlmbode-7b
  624. 50.1 mlabonne/NeuralMonarch-7B
  625. 50.1 UCLA-AGI/Mistral7B-PairRM-SPPO
  626. 50.1 princeton-nlp/Mistral-7B-Instruct-SLiC-HF
  627. 49.9 unsloth/mistral-7b-bnb-4bit
  628. 49.9 01-ai/Yi-1.5-6B
  629. 49.9 eldogbbhed/Peagle-9b
  630. 49.9 amazingvince/Not-WizardLM-2-7B
  631. 49.9 google/medgemma-4b-it
  632. 49.8 CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it
  633. 49.6 Falcon-40B
  634. 49.6 cognitivecomputations/dolphin-2.9-llama3-8b
  635. 49.6 alvarobartt/mistral-7b-orpo-alignment-handbook
  636. 49.6 cosmicvalor/mistral-orthogonalized
  637. 49.6 J-AI/Mistral_7b_ptbr_icatalogo
  638. 49.6 princeton-nlp/Mistral-7B-Instruct-IPO
  639. 49.6 deepcogito/cogito-v1-preview-llama-3B
  640. 49.5 chujiezheng/Mistral7B-PairRM-SPPO-ExPO
  641. 49.4 stabilityai/stablelm-2-12b-chat
  642. 49.4 lucianosb/boto-7B-v1.1
  643. 49.4 cognitivecomputations/dolphin-2.9.3-mistral-7B-32k
  644. 49.4 failspy/Codestral-22B-v0.1-abliterated-v3
  645. 49.4 kaist-ai/janus-orpo-7b
  646. 49.4 BSC-LT/salamandra-7b-instruct
  647. 49.4 microsoft/Phi-4-mini-instruct
  648. 49.2 rhaymison/Mistral-portuguese-luana-7b-chat
  649. 49.2 Walmart-the-bag/Quintellect-10.7B
  650. 49.2 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4
  651. 49.2 lucianosb/boto-7B-v1.2
  652. 49.2 GritLM/GritLM-7B
  653. 49.2 ValiantLabs/Llama3.1-8B-ShiningValiant2
  654. 49.1 mlabonne/AlphaMonarch-7B
  655. 49.0 alvarobartt/mistral-7b-orpo-capybara-reproduction
  656. 49.0 MAmmoTH2-7B-Plus
  657. 49.0 Xwin-LM/Xwin-LM-13B-V0.2
  658. 48.8 Qwen-7B
  659. 48.8 TencentARC/Mistral_Pro_8B_v0.1
  660. 48.8 lucianosb/boto-7B
  661. 48.8 Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0
  662. 48.8 princeton-nlp/Mistral-7B-Base-SFT-IPO
  663. 48.8 princeton-nlp/Mistral-7B-Base-SFT-KTO
  664. 48.7 cnmoro/Mistral-7B-Portuguese
  665. 48.7 princeton-nlp/Mistral-7B-Base-SFT-SimPO
  666. 48.7 recogna-nlp/internlm-chatbode2-7b-alpha
  667. 48.7 ghost-x/ghost-8b-beta-1608
  668. 48.7 allenai/OLMo-2-1124-7B
  669. 48.5 rhaymison/Mistral-portuguese-luana-7b-mental-health
  670. 48.5 alvarobartt/mistral-orpo-mix
  671. 48.5 princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF
  672. 48.5 HuggingFaceTB/SmolLM3-3B
  673. 48.4 cognitivecomputations/WizardLM-30B-Uncensored
  674. 48.4 Xwin-LM/Xwin-LM-13B-V0.1
  675. 48.4 CohereForAI/aya-23-8B
  676. 48.4 artificialguybr/OpenHermesV2-PTBR
  677. 48.4 princeton-nlp/Mistral-7B-Base-SFT-RDPO
  678. 48.3 Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0
  679. 48.3 amazon/MegaBeam-Mistral-7B-300k
  680. 48.3 allenai/OLMo-2-1124-7B-Instruct
  681. 48.1 allenai/tulu-2-dpo-13b
  682. 48.1 rhaymison/Qwen-portuguese-luana-7b
  683. 48.1 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half
  684. 48.1 eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1
  685. 48.1 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6
  686. 48.1 Gemma 2 2B IT
  687. 48.1 princeton-nlp/Mistral-7B-Base-SFT-CPO
  688. 48.1 tiiuae/Falcon-H1-1.5B-Base
  689. 48.0 Zephyr 7B Beta
  690. 48.0 Intel/neural-chat-7b-v3-1
  691. 48.0 JJhooww/MistralReloadBR_v2_ptbr
  692. 48.0 rhaymison/Mistral-portuguese-luana-7b
  693. 48.0 hkust-nlp/deita-7b-v1.0-sft
  694. 47.8 CohereForAI/aya-101
  695. 47.8 royallab/ZephRP-m7b
  696. 47.8 ValiantLabs/Llama3.1-8B-Fireplace2
  697. 47.7 maritaca-ai/sabia-7b
  698. 47.7 internlm/internlm2-base-7b
  699. 47.7 Gemma 1.1 7B IT
  700. 47.7 deepseek-ai/DeepSeek-V2-Lite-Chat
  701. 47.6 meta-llama/Llama-2-70b-chat-hf
  702. 47.6 Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged
  703. 47.6 kaitchup/Qwen1.5-7B-bnb-4bit
  704. 47.6 alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt
  705. 47.4 HuggingFaceH4/zephyr-7b-gemma-v0.1
  706. 47.4 Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO
  707. 47.3 Gemma 3n E2B
  708. 47.1 recogna-nlp/mistralbode_7b_qlora_ultraalpaca
  709. 47.1 heloisy/zephyr-7b-cosmosqa-ptbr_text
  710. 47.0 nicolasdec/Cabramistral7b
  711. 47.0 chargoddard/internlm2-base-7b-llama
  712. 47.0 tiiuae/falcon-11B
  713. 47.0 aws-prototyping/MegaBeam-Mistral-7B-512k
  714. 46.9 OpenLLM-France/Claire-Mistral-7B-0.1
  715. 46.9 nicolasdec/CabraMistral7b
  716. 46.9 maywell/Synatra-7B-v0.3-RP
  717. 46.9 matheusrdgsf/cesar-ptbr
  718. 46.9 TheBloke/zephyr-7B-beta-GPTQ
  719. 46.7 01-ai/Yi-6B-200K
  720. 46.6 Qwen1.5-4B-Chat
  721. 46.5 Falcon3-3B-Instruct
  722. 46.3 Yi-1.5-6B-Chat
  723. 46.2 Qwen/Qwen-7B-Chat
  724. 46.2 allenai/tulu-2-13b
  725. 46.2 Qwen2.5-3B
  726. 46.0 rhaymison/Mistral-portuguese-luana-7b-Mathematics
  727. 45.9 hkust-nlp/deita-7b-v1.0
  728. 45.8 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3
  729. 45.8 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3
  730. 45.6 Qwen1.5-14B
  731. 45.6 Weni/ZeroShot-Multilanguage-Zephyr-7B
  732. 45.6 meta-llama/Llama-2-13b-chat-hf
  733. 45.6 rhaymison/portuguese-tom-cat-13b
  734. 45.6 rfanucchi/Llama3-pt_br_cabrita
  735. 45.6 botbot-ai/CabraMistral-v3-7b-32k
  736. 45.6 DeepSeek-R1-Distill-Llama-70B
  737. 45.6 Motif-Technologies/Motif-2.6B
  738. 45.5 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2
  739. 45.5 nvidia/Llama-3.1-Nemotron-Nano-8B-v1
  740. 45.3 Qwen3-4B-Base
  741. 45.1 princeton-nlp/Mistral-7B-Base-SFT-DPO
  742. 44.9 recogna-nlp/zephyr_7b_beta_ultraalpaca
  743. 44.5 meta-llama/Llama-2-13b-hf
  744. 44.4 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft
  745. 44.2 lmsys/vicuna-13b-v1.5
  746. 44.2 allenai/tulu-2-7b
  747. 44.2 Motif-Technologies/Motif-2.6b-v1.1-LC
  748. 44.1 allenai/tulu-2-dpo-7b
  749. 44.1 SakanaAI/DiscoPOP-zephyr-7b-gemma
  750. 44.1 AIDC-AI/Marco-LLM-ES
  751. 43.8 BAAI/Aquila2-34B
  752. 43.7 OliveiraJLT/Sagui-7B-Instruct-v0.1
  753. 43.5 THUDM/chatglm3-6b-32k
  754. 43.4 Qwen3-0.6B
  755. 43.3 GuiCas/Phituguese_FP16
  756. 43.1 abacusai/Liberated-Qwen1.5-14B
  757. 42.8 google/medgemma-4b-pt
  758. 42.7 xverse/XVERSE-13B
  759. 42.6 rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct
  760. 42.6 01-ai/Yi-Coder-9B-Chat
  761. 42.3 LFM2-1.2B
  762. 42.3 kurakurai/Luth-0.6B-Instruct
  763. 42.0 Deci/DeciLM-7B
  764. 41.9 J-LAB/Brisa_v0.2_sft
  765. 41.7 google/gemma-2-2b
  766. 41.7 dfurman/Llama-3-8B-Orpo-v0.1
  767. 41.7 kurakurai/Luth-LFM2-1.2B
  768. 41.6 Mistral-7B-Instruct-v0.1
  769. 41.6 LiquidAI/LFM2-700M
  770. 41.5 Qwen/Qwen1.5-MoE-A2.7B
  771. 41.3 lmsys/vicuna-7b-v1.5
  772. 41.3 rfanucchi/Llama3-pt_br_cabrit_orca_qkvo
  773. 41.3 princeton-nlp/Mistral-7B-Base-SFT-RRHF
  774. 41.2 tiiuae/Falcon3-3B-Base
  775. 40.9 nicolasdec/cabra13b
  776. 40.8 recogna-nlp/phibode-3-mini-4k-ultraalpaca
  777. 40.8 TIGER-Lab/Qwen2.5-Math-7B-CFT
  778. 40.6 Xwin-LM/Xwin-LM-7B-V0.1
  779. 40.6 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full
  780. 40.5 X-D-Lab/XrayQwen
  781. 40.3 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct
  782. 40.1 baichuan-inc/Baichuan2-7B-Base
  783. 40.1 kurakurai/Luth-LFM2-700M
  784. 39.8 recogna-nlp/mistral-bode
  785. 39.8 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2
  786. 39.5 01-ai/Yi-Coder-9B
  787. 39.1 h2oai/h2o-danube3.1-4b-chat
  788. 38.9 migtissera/Tess-3-Mistral-Nemo-12B
  789. 38.8 xverse/XVERSE-65B-2
  790. 38.7 MPT-30B
  791. 38.5 AdaptLLM/finance-LLM-13B
  792. 38.4 deepseek-ai/deepseek-llm-7b-base
  793. 38.3 recogna-nlp/bode-13b-alpaca-pt-br
  794. 38.3 h2oai/h2o-danube3-4b-chat
  795. 38.3 J-LAB/FluxiIA-Small_Brisa
  796. 38.0 AdaptLLM/law-LLM-13B
  797. 38.0 deepseek-ai/deepseek-moe-16b-chat
  798. 37.8 xverse/XVERSE-65B
  799. 37.7 ghost-x/ghost-8b-beta
  800. 37.7 gpt-oss-20b
  801. 37.5 Qwen1.5-7B
  802. 37.5 AdaptLLM/medicine-LLM-13B
  803. 37.4 Xwin-LM/Xwin-LM-7B-V0.2
  804. 37.3 haoranxu/ALMA-13B-Pretrain
  805. 37.0 rfanucchi/Llama3-pt_br_orca
  806. 36.9 xverse/XVERSE-7B
  807. 36.7 THUDM/agentlm-7b
  808. 36.6 Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized
  809. 36.6 recogna-nlp/gembode-7b-it
  810. 36.4 h2oai/h2o-danube3-4b-base
  811. 36.4 tanliboy/lambda-qwen2.5-32b-dpo-test
  812. 36.3 NousResearch/Nous-Hermes-13b
  813. 36.2 Qwen/Qwen1.5-4B
  814. 36.0 eduagarcia/gemma-7b-it_no_chat_template
  815. 36.0 stabilityai/stablelm-zephyr-3b
  816. 36.0 Qwen3-8B-Base
  817. 35.6 ChatGLM3-6B
  818. 35.5 THUDM/chatglm3-6b-128k
  819. 35.5 Qwen/Qwen2.5-0.5B-Instruct
  820. 34.6 cnmoro/Qwen2.5-0.5B-Portuguese-v1
  821. 34.5 Qwen2-0.5B-Instruct
  822. 33.7 THUDM/LongAlign-7B-64k
  823. 33.5 internlm-7b
  824. 33.4 nicolasdec/Cabra
  825. 33.2 stabilityai/stablelm-2-1_6b-chat
  826. 33.2 cognitivecomputations/dolphin-2.9.3-llama-3-8b
  827. 33.0 Gemma 3 1B
  828. 32.8 LLaMA-13B
  829. 32.7 rhaymison/Llama-portuguese-13b-Luana-v0.2
  830. 32.7 cognitivecomputations/dolphin-2.9.1-mixtral-1x22b
  831. 32.7 BAAI/OPI-Llama-3.1-8B-Instruct
  832. 32.4 stabilityai/stablelm-2-zephyr-1_6b
  833. 32.3 internlm/internlm2-chat-1_8b
  834. 32.3 internlm/internlm2_5-1_8b
  835. 32.1 internlm/internlm2-chat-1_8b-sft
  836. 31.7 internlm/internlm2-1_8b
  837. 31.7 cognitivecomputations/WizardLM-13B-Uncensored
  838. 31.6 AdaptLLM/law-LLM
  839. 31.6 internlm/internlm2_5-1_8b-chat
  840. 31.6 Falcon3-1B-Instruct
  841. 31.4 haoranxu/ALMA-13B-R
  842. 31.4 google/recurrentgemma-2b-it
  843. 31.4 Oburaco/llama2-qlora-finetunined-ptbr
  844. 31.4 TinyPixel/Llama-2-7B-bf16-sharded
  845. 31.4 rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora
  846. 31.4 unsloth/Llama-3.2-1B-Instruct
  847. 31.4 cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning
  848. 31.3 meta-llama/Llama-2-7b-hf
  849. 31.3 AdaptLLM/medicine-LLM
  850. 31.0 kurakurai/Luth-LFM2-350M
  851. 30.7 recogna-nlp/internlm2-chat-1_8b-ultracabrita
  852. 30.6 Unbabel/TowerBase-7B-v0.1
  853. 30.6 tensoropera/Fox-1-1.6B-Instruct-v0.1
  854. 30.6 meta-llama/Llama-3.2-1B-Instruct
  855. 30.3 deepseek-ai/deepseek-moe-16b-base
  856. 30.3 google/gemma-7b-it
  857. 30.3 MAmmoTH2-8B-Plus
  858. 30.3 tiiuae/Falcon-H1-0.5B-Instruct
  859. 30.2 GeneZC/MiniMA-2-3B
  860. 29.9 chatglm2-6b
  861. 29.9 stabilityai/stablelm-3b-4e1t
  862. 29.8 dominguesm/canarim-7b
  863. 29.8 stabilityai/stablelm-base-alpha-7b-v2
  864. 29.8 Qwen/Qwen1.5-1.8B-Chat
  865. 29.6 NTQAI/Nxcode-CQ-7B-orpo
  866. 29.6 deepseek-ai/DeepSeek-R1-Distill-Llama-8B
  867. 29.5 LiquidAI/LFM2-350M
  868. 29.2 lrds-code/boana-7b-instruct
  869. 29.2 DeepSeek-R1-Distill-Qwen-32B
  870. 29.1 AdaptLLM/finance-LLM
  871. 29.1 semantixai/LloroV2
  872. 29.1 meta-llama/Llama-2-7b-chat-hf
  873. 29.1 rhaymison/gemma-portuguese-tom-cat-2b-it
  874. 28.9 recogna-nlp/bode-7b-alpaca-pt-br
  875. 28.9 langtech-languagemodeling/IberianLLM-7B-Instruct
  876. 28.8 Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT
  877. 28.8 Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT
  878. 28.8 GeneZC/MiniLoong-3B
  879. 28.4 Gemma 2B
  880. 28.4 h2oai/h2o-danube2-1.8b-base
  881. 28.4 nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1
  882. 28.2 baichuan-inc/Baichuan2-13B-Base
  883. 28.1 AI-Sweden-Models/gpt-sw3-40b
  884. 28.1 mosaicml/mpt-7b-8k
  885. 28.1 h2oai/h2o-danube2-1.8b-chat
  886. 28.0 BAAI/Aquila-7B
  887. 27.7 pfnet/plamo-13b
  888. 27.4 unsloth/gemma-2b-bnb-4bit
  889. 27.4 cognitivecomputations/dolphin-2.9.4-llama3.1-8b
  890. 27.1 BSC-LT/salamandra-7b
  891. 27.1 baidu/ERNIE-4.5-0.3B-Base-PT
  892. 27.0 Phi-2
  893. 26.8 nbeerbower/gemma2-gutenberg-27B
  894. 26.8 TucanoBR/Tucano-630m
  895. 26.8 cnmoro/Qwen2.5-0.5B-Portuguese-v2
  896. 26.6 DAMO-NLP-MT/polylm-1.7b
  897. 26.6 Oburaco/ptbr-falcon-7b
  898. 26.3 Baichuan2-13B-Chat
  899. 26.3 Qwen-1_8B
  900. 26.1 dominguesm/Canarim-7B-Instruct
  901. 26.1 google/recurrentgemma-2b
  902. 26.0 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora
  903. 26.0 tiiuae/Falcon3-1B-Base
  904. 26.0 BSC-LT/salamandra-2b
  905. 25.9 OpenLLM-France/Claire-7B-0.1
  906. 25.9 google/gemma-2b-it
  907. 25.9 recogna-nlp/gembode-2b-ultraalpaca
  908. 25.7 AI-Sweden-Models/gpt-sw3-6.7b
  909. 25.7 nicholasKluge/TeenyTinyLlama-460m
  910. 25.7 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca
  911. 25.6 OPT-66B
  912. 25.6 stabilityai/stablelm-2-1_6b
  913. 25.6 TucanoBR/Tucano-1b1
  914. 25.6 gpt-oss-120b
  915. 25.4 nicholasKluge/TeenyTinyLlama-460m-Chat
  916. 25.4 Qwen/Qwen1.5-0.5B-Chat
  917. 25.4 allenai/OLMo-2-0425-1B
  918. 25.3 cerebras/btlm-3b-8k-base
  919. 25.3 recogna-nlp/GemBode-2b-it
  920. 25.3 recogna-nlp/Phi-Bode
  921. 25.3 SmolLM-360M
  922. 25.3 GeneZC/MiniMA-3B
  923. 25.3 TheDrummer/Big-Tiger-Gemma-27B-v1
  924. 25.2 croissantllm/CroissantLLMBase
  925. 25.2 Qwen/Qwen1.5-1.8B
  926. 25.2 recogna-nlp/phi-bode-2-ultraalpaca
  927. 25.2 MulaBR/Mula-4x160-v0.1
  928. 25.2 anthracite-org/magnum-v4-9b
  929. 25.2 TucanoBR/Tucano-160m
  930. 25.0 RedPajama-INCITE-7B-Base
  931. 25.0 openlm-research/open_llama_7b_v2
  932. 25.0 TucanoBR/Tucano-2b4
  933. 24.9 microsoft/phi-1
  934. 24.9 Gemma 1.1 2B IT
  935. 24.9 rhaymison/gemma-portuguese-luana-2b
  936. 24.9 h2oai/h2o-danube2-1.8b-sft
  937. 24.9 OLMo 2 1B Instruct
  938. 24.8 openlm-research/open_llama_13b
  939. 24.8 TheBloke/wizardLM-7B-HF
  940. 24.6 togethercomputer/RedPajama-INCITE-Base-3B-v1
  941. 24.6 haoranxu/ALMA-7B-R
  942. 24.5 Bruno/Caramelo_7B
  943. 24.5 Weni/WeniGPT-Mistral-7B-instructBase-4bit
  944. 24.5 tensoropera/Fox-1-1.6B
  945. 24.3 Ramikan-BR/Qwen2-0.5B-v5
  946. 24.3 tiiuae/Falcon-H1-0.5B-Base
  947. 24.2 Cerebras-GPT-13B
  948. 24.2 facebook/galactica-30b
  949. 24.2 recogna-nlp/gembode-2b-base-ultraalpaca
  950. 24.2 yahma/llama-7b-hf
  951. 24.1 fernandosola/bluearara-7B-instruct
  952. 24.1 Ramikan-BR/Qwen2-0.5B-v9
  953. 24.1 TinyLlama/TinyLlama_v1.1
  954. 24.1 Emu3-Chat
  955. 23.9 LLaMA-7B
  956. 23.9 matsuo-lab/weblab-10b
  957. 23.9 Oburaco/ptbr-falcon-7b-v3
  958. 23.9 vilsonrodrigues/falcon-7b-instruct-sharded
  959. 23.6 GPT-J-6B
  960. 23.6 bigscience/bloom-7b1
  961. 23.6 EleutherAI/pythia-410m
  962. 23.6 allenai/OLMo-7B-Twin-2T
  963. 23.5 Phi-1.5
  964. 23.5 AI-Sweden-Models/gpt-sw3-6.7b-v2
  965. 23.5 Weni/WeniGPT-Mistral-7B-instructBase
  966. 23.5 M4-ai/tau-1.8B
  967. 23.5 cognitivecomputations/WizardLM-7B-Uncensored
  968. 23.5 RogerioPiazzon/alpaca-lora-ptbr-7b
  969. 23.4 projecte-aina/FLOR-760M
  970. 23.4 facebook/xglm-4.5B
  971. 23.4 Llama 3.2 1B
  972. 23.2 NucleusAI/nucleus-22B-token-500B
  973. 23.2 ericzzz/falcon-rw-1b-instruct-openorca
  974. 23.2 lucianosb/boto-27B
  975. 23.1 22h/cabrita_7b_pt_850000
  976. 23.1 nicholasKluge/TeenyTinyLlama-160m
  977. 22.9 openlm-research/open_llama_3b_v2
  978. 22.9 fernandosola/bluearara-7B
  979. 22.9 Oburaco/juridic-falcon-7b
  980. 22.8 GPT-NeoX-20B
  981. 22.8 TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T
  982. 22.8 TechxGenus/Jamba-v0.1-9B
  983. 22.8 SmolLM-1.7B
  984. 22.8 TucanoBR/Tucano-2b4-Instruct
  985. 22.8 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview
  986. 22.7 MPT-7B
  987. 22.7 stabilityai/stablelm-base-alpha-3b-v2
  988. 22.7 cerebras/Cerebras-GPT-590M
  989. 22.7 EleutherAI/pythia-12b
  990. 22.7 h2oai/h2o-danube-1.8b-base
  991. 22.5 AI-Sweden-Models/gpt-sw3-20b
  992. 22.5 EleutherAI/pythia-2.8b-deduped
  993. 22.5 unicamp-dl/ptt5-base-portuguese-vocab
  994. 22.5 unicamp-dl/ptt5-small-portuguese-vocab
  995. 22.5 state-spaces/mamba-790m-hf
  996. 22.5 Qwen2-0.5B
  997. 22.5 baidu/ERNIE-4.5-0.3B-PT
  998. 22.4 EleutherAI/pythia-2.8b
  999. 22.4 nicolasdec/CabraMistral7b-0.4
  1000. 22.4 proxectonos/FLOR-1.3B-GL
  1001. 22.4 utter-project/EuroLLM-1.7B
  1002. 22.3 openlm-research/open_llama_3b
  1003. 22.3 Gemma 3 1B PT
  1004. 22.1 EleutherAI/pythia-6.9b-deduped
  1005. 22.1 cerebras/Cerebras-GPT-6.7B
  1006. 22.1 Bruno/Caramelinho
  1007. 22.1 GeneZC/MiniMA-2-1B
  1008. 22.0 Falcon-7B
  1009. 22.0 open_llama_7b
  1010. 22.0 Ramikan-BR/TiamaPY-v31
  1011. 21.8 facebook/opt-30b
  1012. 21.8 Ramikan-BR/TiamaPY-v30
  1013. 21.8 fernandosola/bluearara-7B-instruct-v02
  1014. 21.7 GPT-Neo-2.7B
  1015. 21.7 LiteAI/Hare-1.1B-base
  1016. 21.6 projecte-aina/FLOR-6.3B
  1017. 21.6 facebook/galactica-6.7b
  1018. 21.6 TinyLlama/TinyLlama-1.1B-Chat-v1.0
  1019. 21.6 recogna-nlp/gembode-2b-ultraalpaca-qlora
  1020. 21.6 utter-project/EuroLLM-1.7B-Instruct
  1021. 21.4 bigscience/bloom-1b7
  1022. 21.4 openai-community/gpt2-xl
  1023. 21.4 pierreguillou/gpt2-small-portuguese
  1024. 21.3 openai-community/gpt2-large
  1025. 21.3 facebook/galactica-1.3b
  1026. 21.3 JosephusCheung/LL7M
  1027. 21.3 M4-ai/tau-0.5B-instruct-DPOP
  1028. 21.3 MulaBR/Mula-8x160-v0.1
  1029. 21.3 h2oai/h2o-danube-1.8b-sft
  1030. 21.3 rhaymison/portuguese-phi1_5-tom-cat
  1031. 21.1 22h/open-cabrita3b
  1032. 21.1 wandgibaut/periquito-3B
  1033. 21.0 allenai/OLMo-7B
  1034. 21.0 PORTULAN/gervasio-7b-portuguese-ptbr-decoder
  1035. 20.9 facebook/opt-2.7b
  1036. 20.9 EleutherAI/pythia-70m
  1037. 20.7 dynamofl/dynamo-8B-v0.1
  1038. 20.7 HuggingFaceTB/cosmo-1b
  1039. 20.7 pedrogengo/gemma-ptbr
  1040. 20.7 recogna-nlp/phibode_1_5_ultraalpaca
  1041. 20.7 BAAI/Emu3-Stage1
  1042. 20.6 bigscience/bloom-3b
  1043. 20.6 EleutherAI/pythia-1b-deduped
  1044. 20.6 openai-community/gpt2-medium
  1045. 20.6 nisten/Biggie-SmoLlm-0.15B-Base
  1046. 20.3 EleutherAI/pythia-6.9b
  1047. 20.3 state-spaces/mamba-1.4b-hf
  1048. 20.3 state-spaces/mamba-370m-hf
  1049. 20.3 recogna-nlp/gembode-2b-base-ultraalpaca-qlora
  1050. 20.2 baichuan-inc/Baichuan-7B
  1051. 20.2 EleutherAI/pythia-410m-deduped
  1052. 20.2 facebook/xglm-7.5B
  1053. 20.2 nicholasKluge/baseline
  1054. 20.0 LiteAI/Hare-1.1B-Chat
  1055. 20.0 Qwen2.5-Coder-32B
  1056. 20.0 proxectonos/Llama-3.1-Carballo
  1057. 19.9 facebook/xglm-1.7B
  1058. 19.9 state-spaces/mamba-2.8b-hf
  1059. 19.9 adalbertojunior/Mistral-7b-Portuguese-V0.1
  1060. 19.9 Delta-Vector/Odin-9B
  1061. 19.8 facebook/xglm-2.9B
  1062. 19.8 facebook/xglm-564M
  1063. 19.6 cerebras/Cerebras-GPT-2.7B
  1064. 19.5 stabilityai/stablelm-base-alpha-3b
  1065. 19.5 BAAI/Emu3-Gen
  1066. 19.3 gpt2
  1067. 19.3 h2oai/h2o-danube-1.8b-chat
  1068. 19.3 proxectonos/Cerebras-1.3B-GL
  1069. 19.2 OPT-1.3B
  1070. 19.2 EleutherAI/pythia-1b
  1071. 19.2 Nos-PT/Carvalho_pt-gl-1.3B
  1072. 19.2 SmolLM-135M
  1073. 19.1 facebook/opt-6.7b
  1074. 19.1 projecte-aina/aguila-7b
  1075. 19.1 EleutherAI/pythia-160m
  1076. 18.9 bigscience/bloom-560m
  1077. 18.9 stabilityai/stablelm-base-alpha-7b
  1078. 18.9 allenai/OLMo-1B
  1079. 18.9 Qwen/Qwen1.5-0.5B
  1080. 18.9 PORTULAN/gervasio-7b-portuguese-ptpt-decoder
  1081. 18.9 M4-ai/tau-0.5B
  1082. 18.9 h2oai/h2o-danube3-500m-base
  1083. 18.9 premai-io/prem-1B-chat
  1084. 18.9 Nos-PT/Llama-Carvalho-PT
  1085. 18.9 Nos-PT/Llama-Carvalho-PT-GL
  1086. 18.8 projecte-aina/FLOR-1.3B
  1087. 18.8 state-spaces/mamba-130m-hf
  1088. 18.6 Ramikan-BR/tinyllama-coder-py-4bit-v10
  1089. 18.6 h2oai/h2o-danube3-500m-chat
  1090. 18.5 EleutherAI/gpt-neo-125m
  1091. 18.5 HuggingFaceTB/SmolLM-1.7B-Instruct
  1092. 18.5 Gemma 3 270M
  1093. 18.4 EleutherAI/gpt-neo-1.3B
  1094. 18.4 EleutherAI/pythia-70m-deduped
  1095. 18.4 facebook/opt-125m
  1096. 18.4 josu/gpt-neo-pt-1.3B
  1097. 18.4 cerebras/Cerebras-GPT-256M
  1098. 18.2 facebook/opt-350m
  1099. 18.1 cerebras/Cerebras-GPT-111M
  1100. 17.9 EleutherAI/pythia-14m
  1101. 17.9 EleutherAI/pythia-160m-deduped
  1102. 17.7 josu/gpt-neo-pt-br
  1103. 17.1 nicholasKluge/Aira-2-portuguese-124M
  1104. 16.7 HuggingFaceTB/SmolLM-360M-Instruct
  1105. 16.4 artificialguybr/llama3-8b-alpacadata-ptbr
  1106. 16.3 HuggingFaceTB/SmolLM-135M-Instruct
  1107. 15.4 FluxiIA/Tucaninho_dpo
  1108. 15.3 FluxiIA/Tucaninho
  1109. 14.9 facebook/galactica-125m
  1110. 14.5 BAAI/Aquila2-7B
  1111. 14.5 deepseek-ai/DeepSeek-V2-Lite
  1112. 13.9 DeepSeek-R1-Distill-Qwen-1.5B
  1113. 13.5 T5-Large
  1114. 13.1 T5-Small
  1115. 12.9 pucpr/gpt2-bio-pt
  1116. 11.3 internlm/internlm2_5-7b
  1117. 10.7 Ramikan-BR/tinyllama-coder-py-v11
  1118. 10.6 dominguesm/mambarim-110m
  1119. 10.6 Qwen/Qwen3-0.6B-Base
  1120. 10.4 ai-forever/mGPT-13B
  1121. 10.3 google/mt5-base
  1122. 10.2 T5-Base
  1123. 9.60 NLPark/AnFeng_v3_Avocet
  1124. 8.07 lrds-code/samba-1.1B
  1125. 7.51 EleutherAI/polyglot-ko-12.8b
  1126. 6.68 Qwen2.5-0.5B
  1127. 6.12 adalbertojunior/NeuralDaredevil-Dolphin-Portuguese
  1128. 3.89 HeyLucasLeao/gpt-neo-small-portuguese
  1129. 3.48 JJhooww/Mistral_Reload_v4_Functions
  1130. 3.20 NOVA-vision-language/GlorIA-1.3B
  1131. 2.78 Ramikan-BR/tinyllama-coder-py-v12
  1132. 1.11 Qwen/Qwen-1_8B-Chat
  1133. 0.83 ssmits/Falcon2-5.5B-multilingual
  1134. 0.83 ssmits/Falcon2-5.5B-Portuguese
  1135. 0.70 monilouise/opt125M_portuguese
  1136. 0.70 Qwen/Qwen-72B-Chat
  1137. 0.70 MTSAIR/multi_verse_model
  1138. 0.70 internlm/internlm2_5-20b
  1139. 0.42 MaziyarPanahi/Calme-4x7B-MoE-v0.2
  1140. 0.28 nicholasKluge/Aira-2-portuguese-1B7
  1141. 0.28 MaziyarPanahi/Calme-4x7B-MoE-v0.1
  1142. 0.14 eduagarcia/gemma-7b-it_singleturn_chat_template
  1143. 0.14 google/mt5-small
  1144. 0.14 meta-llama/Meta-Llama-3-8B-Instruct
  1145. 0.14 abacusai/Llama-3-Smaug-8B
  1146. 0.14 Qwen2.5-1.5B
  1147. 0.14 gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES
  1148. 0.14 RLHFlow/ArmoRM-Llama3-8B-v0.1
  1149. 0.0 nicholasKluge/Aira-2-portuguese-560M
  1150. 0.0 openai-community/openai-gpt
  1151. 0.0 ai-forever/mGPT
  1152. 0.0 DAMO-NLP-MT/polylm-13b
  1153. 0.0 rhaymison/gemma-portuguese-2b-it
  1154. 0.0 Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO
  1155. 0.0 abhishek/autotrain-llama3-orpo-v2
  1156. 0.0 WizardLMTeam/WizardLM-13B-V1.0
  1157. 0.0 recogna-nlp/phibode_1_5_ultraalpaca_qlora
  1158. 0.0 cognitivess/bella-1-8b
  1159. 0.0 GeneZC/MiniChat-1.5-3B
  1160. 0.0 GeneZC/MiniChat-2-3B
  1161. 0.0 GeneZC/MiniChat-3B
  1162. 0.0 monsterapi/Llama-3_1-8B-Instruct-orca-ORPO
  1163. 0.0 kaist-ai/janus-rm-7b
  1164. 0.0 J-LAB/Qwen2.5_Thinik_base_v1.0
  1165. 0.0 J-LAB/Thinik
  1. 1 Gemini 2.5 Pro Mar 2025, Three-shot, text-only, reasoning, 2025-04-03 95%
  2. 2 GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
  3. 3 Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
  4. 4 Gemini 2.5 Flash Jun 2025, Three-shot, text-only, 2025-09-01 86.5%
  5. 5 Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
  6. 6 GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
  7. 7 Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
  8. 8 DeepSeek-V3 Mar 2025, Three-shot, text-only, 2025-04-03 84.1%
  9. 9 Gemini 2.5 Flash-Lite Jun 2025, Three-shot, text-only, reasoning: low, 2025-09-01 84%
  10. 10 Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
  11. 11 Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
  12. 12 Kimi K2 Jul 2025, Three-shot, text-only, 2025-09-01 82.8%
  13. 13 DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
  14. 14 Sabiá-3.1 (2025-05-08) Three-shot, text-only, 2025-09-01 81.8%
  15. 15 Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
  16. 16 Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
  17. 17 Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
  18. 18 Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
  19. 19 Gemini 2.0 Flash Feb 2025, Three-shot, text-only, 2025-04-03 80.4%
  20. 20 meta-llama/Llama-3.1-405B-Instruct (Vertex AI) Three-shot, text-only, 2024-08-20 80.1%
  21. 21 GPT-4o Aug 2024, Three-shot, text-only, 2025-04-09 79.7%
  22. 22 Sabiá-3 (2024-07-15) Three-shot, text-only, 2024-08-20 79%
  23. 23 Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
  24. 24 GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
  25. 25 Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
  26. 26 Sabiá-3 (2024-12-11) Three-shot, text-only, 2025-09-01 78.7%
  27. 27 huihui-ai/Qwen2.5-32B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-10-04 78.6%
  28. 28 rombodawg/Rombos-LLM-V2.5-Qwen-32b Three-shot, text-only, bfloat16, 2024-10-10 78.6%
  29. 29 Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B Three-shot, text-only, bfloat16, 2025-01-21 78.6%
  30. 30 Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B Three-shot, text-only, bfloat16, 2025-01-21 78.6%
  31. 31 maldv/Qwentile2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-12-21 78.4%
  32. 32 Qwen/Qwen2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-09-18 78.3%
  33. 33 AXCXEPT/EZO-Qwen2.5-32B-Instruct Three-shot, text-only, bfloat16, 2024-10-04 78.3%
  34. 34 Sakalti/Oxyge1-33B Three-shot, text-only, bfloat16, 2024-12-21 78.3%
  35. 35 Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
  36. 36 fblgit/TheBeagle-v2beta-32B-MGS Three-shot, text-only, bfloat16, 2024-12-12 78%
  37. 37 Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
  38. 38 tiiuae/Falcon-H1-34B-Base Three-shot, text-only, bfloat16, 2025-07-08 77.8%
  39. 39 huihui-ai/QwQ-32B-Coder-Fusion-9010 Three-shot, text-only, bfloat16, 2024-12-12 77.6%
  40. 40 Gemini 1.5 Pro Preview (0409) Three-shot, text-only, 2024-04-15 77.2%
  41. 41 Qwen3-30B-A3B-Instruct Jul 2025, Three-shot, text-only, bfloat16, 2025-08-30 76.9%
  42. 42 Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
  43. 43 QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
  44. 44 huihui-ai/QwQ-32B-Preview-abliterated Three-shot, text-only, bfloat16, 2024-12-12 76.5%
  45. 45 DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
  46. 46 OpenBuddy/openbuddy-qwq-32b-v24.1-200k Three-shot, text-only, bfloat16, 2025-01-22 76.5%
  47. 47 Gemini 1.5 Flash Sep 2024, Three-shot, text-only, 2025-04-03 76.1%
  48. 48 Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
  49. 49 Gemini 1.5 Flash May 2024, Three-shot, text-only, 2024-08-09 75.8%
  50. 50 Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
  51. 51 google/medgemma-27b-text-it Three-shot, text-only, bfloat16, 2025-07-15 75.4%
  52. 52 meta-llama/Meta-Llama-3.1-70B-Instruct Three-shot, text-only, bfloat16, 2024-07-23 75.1%
  53. 53 amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct Three-shot, text-only, float16, 2025-06-16 75.1%
  54. 54 Gemini 1.5 Flash Preview (0514) Three-shot, text-only, 2024-05-18 74.8%
  55. 55 nisten/franqwenstein-35b Three-shot, text-only, bfloat16, 2024-10-10 74.8%
  56. 56 meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI) Three-shot, text-only, 2025-04-03 74.8%
  57. 57 arcee-ai/Virtuoso-Small Three-shot, text-only, bfloat16, 2024-12-21 74.5%
  58. 58 prithivMLmods/Megatron-Opus-14B-Exp Three-shot, text-only, bfloat16, 2025-02-03 74.1%
  59. 59 sometimesanotion/Qwen2.5-14B-Vimarckoso-v3 Three-shot, text-only, bfloat16, 2025-01-21 74%
  60. 60 mistralai/Mistral-Small-24B-Base-2501 Three-shot, text-only, bfloat16, 2025-01-31 74%
  61. 61 google/gemma-3-27b-it (GoogleAI API) Three-shot, text-only, 2025-04-08 73.8%
  62. 62 Replete-AI/Replete-LLM-V2.5-Qwen-14b Three-shot, text-only, bfloat16, 2024-10-01 73.7%
  63. 63 rombodawg/Rombos-LLM-V2.6-Qwen-14b Three-shot, text-only, bfloat16, 2024-10-14 73.6%
  64. 64 hotmailuser/QwenSlerp2-14B Three-shot, text-only, bfloat16, 2025-01-21 73.6%
  65. 65 sometimesanotion/Lamarck-14B-v0.6 Three-shot, text-only, bfloat16, 2025-01-21 73.6%
  66. 66 sometimesanotion/Lamarck-14B-v0.7 Three-shot, text-only, bfloat16, 2025-02-02 73.6%
  67. 67 meta-llama/Meta-Llama-3-70B-Instruct Three-shot, text-only, bfloat16, 2024-04-18 73.4%
  68. 68 v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno Three-shot, text-only, bfloat16, 2024-09-28 73.4%
  69. 69 allknowingroger/Qwen2.5-slerp-14B Three-shot, text-only, bfloat16, 2024-11-01 73.4%
  70. 70 mistralai/Mistral-Small-24B-Instruct-2501 Three-shot, text-only, bfloat16, 2025-01-31 73.4%
  71. 71 Sabiázinho-3 (2025-02-06) Three-shot, text-only, 2025-09-01 73.4%
  72. 72 Qwen/Qwen2.5-14B-Instruct Three-shot, text-only, bfloat16, 2024-09-18 73.3%
  73. 73 Lambent/qwen2.5-reinstruct-alternate-lumen-14B Three-shot, text-only, bfloat16, 2024-09-28 73.3%
  74. 74 v000000/Qwen2.5-14B-Gutenberg-1e-Delta Three-shot, text-only, bfloat16, 2024-09-28 73.3%
  75. 75 CultriX/Qwen2.5-14B-Wernicke Three-shot, text-only, bfloat16, 2024-11-17 73.3%
  76. 76 allknowingroger/QwenSlerp6-14B Three-shot, text-only, bfloat16, 2024-12-21 73.3%
  77. 77 tanliboy/lambda-qwen2.5-14b-dpo-test Three-shot, text-only, bfloat16, 2024-09-28 73.2%
  78. 78 Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 Three-shot, text-only, bfloat16, 2024-11-01 73.2%
  79. 79 CultriX/SeQwence-14Bv1 Three-shot, text-only, bfloat16, 2024-12-21 72.5%
  80. 80 janhq/Jan-v1-4B Three-shot, text-only, bfloat16, 2025-08-30 72.3%
  81. 81 meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API) Three-shot, text-only, 2025-04-05 72.2%
  82. 82 arcee-ai/SuperNova-Medius Three-shot, text-only, bfloat16, 2024-10-20 72%
  83. 83 CultriX/Qwen2.5-14B-Wernicke-SFT Three-shot, text-only, bfloat16, 2024-11-17 72%
  84. 84 Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
  85. 85 Sabiá-2 Medium Three-shot, text-only, 2024-04-13 71.8%
  86. 86 Qwen/Qwen1.5-110B-Chat Three-shot, text-only, 4bit, 2024-05-23 71.8%
  87. 87 AALF/gemma-2-27b-it-SimPO-37K-100steps Three-shot, text-only, bfloat16, 2024-09-21 71.6%
  88. 88 Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
  89. 89 byroneverson/gemma-2-27b-it-abliterated Three-shot, text-only, bfloat16, 2024-09-05 71.1%
  90. 90 Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
  91. 91 Qwen-Turbo (2024-11-01) Three-shot, text-only, 2025-04-03 70.8%
  92. 92 google/gemma-2-27b-it Three-shot, text-only, bfloat16, 2024-07-02 70.5%
  93. 93 Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
  94. 94 THUDM/GLM-Z1-9B-0414 Three-shot, text-only, bfloat16, 2025-05-01 70.4%
  95. 95 Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
  96. 96 botbot-ai/CabraLlama3-70b Three-shot, text-only, bfloat16, 2024-06-21 70.1%
  97. 97 tiiuae/Falcon-H1-7B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 70.1%
  98. 98 abacusai/Smaug-Llama-3-70B-Instruct Three-shot, text-only, bfloat16, 2024-05-17 69.5%
  99. 99 DeepSeek-V2 Chat (API) Three-shot, text-only, 2024-05-18 69.5%
  100. 100 google/medgemma-27b-it Three-shot, text-only, bfloat16, 2025-07-15 69.3%
  101. 101 unsloth/llama-3-70b-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 68.8%
  102. 102 tiiuae/Falcon-H1-7B-Base Three-shot, text-only, bfloat16, 2025-07-08 68.7%
  103. 103 Qwen/Qwen-72B Three-shot, text-only, bfloat16, 2024-02-05 68.4%
  104. 104 GPT 4o Mini (2024-07-18) Three-shot, text-only, 2024-07-25 68.4%
  105. 105 abacusai/Smaug-72B-v0.1 Three-shot, text-only, bfloat16, 2024-02-28 68.3%
  106. 106 unsloth/Llama-3.3-70B-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-12-10 68.2%
  107. 107 Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
  108. 108 Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp Three-shot, text-only, bfloat16, 2024-06-16 68%
  109. 109 Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
  110. 110 huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-12-12 68%
  111. 111 Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
  112. 112 01-ai/Yi-1.5-34B-32K Three-shot, text-only, bfloat16, 2024-05-20 67.9%
  113. 113 cognitivecomputations/dolphin-2.9.1-llama-3-70b Three-shot, text-only, bfloat16, 2024-05-24 67.9%
  114. 114 Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
  115. 115 qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
  116. 116 Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
  117. 117 Weyaxi/Bagel-Hermes-34B-Slerp Three-shot, text-only, rev: 459676b, bfloat16, 2024-05-26 67.6%
  118. 118 botbot-ai/Cabra-72b Three-shot, text-only, bfloat16, 2024-04-06 67.5%
  119. 119 unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-08-13 67.3%
  120. 120 Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
  121. 121 mistral-community/Mixtral-8x22B-v0.1-4bit Three-shot, text-only, 4bit, 2024-04-12 67.2%
  122. 122 Azure99/blossom-v5.1-34b Three-shot, text-only, bfloat16, 2024-06-05 67.2%
  123. 123 VAGOsolutions/SauerkrautLM-Qwen-32b Three-shot, text-only, bfloat16, 2024-06-05 67.2%
  124. 124 jondurbin/bagel-dpo-34b-v0.2 Three-shot, text-only, bfloat16, 2024-05-16 66.9%
  125. 125 altomek/YiSM-34B-0rn Three-shot, text-only, float16, 2024-06-06 66.9%
  126. 126 jondurbin/bagel-dpo-34b-v0.5 Three-shot, text-only, bfloat16, 2024-05-16 66.8%
  127. 127 upstage/solar-pro-preview-instruct Three-shot, text-only, bfloat16, 2024-09-18 66.8%
  128. 128 Claude-3 Haiku (20240307) Three-shot, text-only, 2024-04-13 66.6%
  129. 129 Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
  130. 130 mistralai/Mixtral-8x22B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-20 66.6%
  131. 131 Orion-zhen/Qwen2.5-7B-Instruct-Uncensored Three-shot, text-only, bfloat16, 2024-10-19 66.6%
  132. 132 Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
  133. 133 Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
  134. 134 SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit Three-shot, text-only, 4bit, 2024-04-17 66.5%
  135. 135 01-ai/Yi-1.5-34B-Chat Three-shot, text-only, bfloat16, 2024-05-15 66.5%
  136. 136 Cran-May/T.E-8.1 Three-shot, text-only, bfloat16, 2024-09-30 66.5%
  137. 137 Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
  138. 138 Qwen/Qwen2.5-7B-Instruct-1M Three-shot, text-only, float16, 2025-09-01 66.5%
  139. 139 adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1 Three-shot, text-only, bfloat16, 2024-04-30 66.3%
  140. 140 CohereForAI/c4ai-command-r-plus-4bit Three-shot, text-only, 4bit, 2024-04-05 66.2%
  141. 141 mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit Three-shot, text-only, 4bit, 2024-04-20 66.2%
  142. 142 CombinHorizon/YiSM-blossom5.1-34B-SLERP Three-shot, text-only, bfloat16, 2024-08-27 66.2%
  143. 143 VAGOsolutions/SauerkrautLM-Phi-3-medium Three-shot, text-only, bfloat16, 2024-09-19 66.2%
  144. 144 CausalLM/34b-beta Three-shot, text-only, bfloat16, 2024-05-30 66.1%
  145. 145 Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
  146. 146 NousResearch/Nous-Hermes-2-Yi-34B Three-shot, text-only, bfloat16, 2024-02-27 65.8%
  147. 147 abacusai/Smaug-34B-v0.1 Three-shot, text-only, bfloat16, 2024-02-28 65.8%
  148. 148 WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
  149. 149 ConvexAI/Luminex-34B-v0.2 Three-shot, text-only, float16, 2024-05-30 65.8%
  150. 150 Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
  151. 151 wenbopan/Faro-Yi-34B-DPO Three-shot, text-only, bfloat16, 2024-06-14 65.8%
  152. 152 Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO Three-shot, text-only, float16, 2024-07-31 65.8%
  153. 153 Qwen/Qwen1.5-32B-Chat Three-shot, text-only, bfloat16, 2024-04-08 65.7%
  154. 154 recoilme/recoilme-gemma-2-9B-v0.4 Three-shot, text-only, rev: 2691f2c, bfloat16, 2024-09-29 65.7%
  155. 155 anthracite-org/magnum-v3-9b-customgemma2 Three-shot, text-only, bfloat16, 2024-09-18 65.5%
  156. 156 fblgit/UNA-SimpleSmaug-34b-v1beta Three-shot, text-only, bfloat16, 2024-05-15 65.4%
  157. 157 princeton-nlp/gemma-2-9b-it-SimPO Three-shot, text-only, bfloat16, 2024-08-10 65.4%
  158. 158 c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
  159. 159 Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
  160. 160 OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
  161. 161 baidu/ERNIE-4.5-21B-A3B-PT Three-shot, text-only, bfloat16, 2025-08-31 65.4%
  162. 162 Qwen/Qwen2-57B-A14B Three-shot, text-only, bfloat16, 2024-06-08 65.2%
  163. 163 Qwen/Qwen2-57B-A14B-Instruct Three-shot, text-only, float16, 2024-06-08 65.2%
  164. 164 anthracite-org/magnum-v3-9b-chatml Three-shot, text-only, bfloat16, 2024-09-18 65.2%
  165. 165 GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
  166. 166 01-ai/Yi-34B-200K Three-shot, text-only, bfloat16, 2024-02-05 64.8%
  167. 167 152334H/miqu-1-70b-sf Three-shot, text-only, float16, 2024-04-26 64.8%
  168. 168 migtissera/Tess-M-v1.3 Three-shot, text-only, float16, 2024-05-16 64.8%
  169. 169 ConvexAI/Luminex-34B-v0.1 Three-shot, text-only, float16, 2024-06-08 64.8%
  170. 170 wenbopan/Faro-Yi-34B Three-shot, text-only, bfloat16, 2024-06-14 64.8%
  171. 171 BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference Three-shot, text-only, bfloat16, 2024-09-02 64.8%
  172. 172 anthracite-org/magnum-v3-27b-kto Three-shot, text-only, bfloat16, 2024-09-15 64.7%
  173. 173 huihui-ai/Qwen2.5-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-21 64.7%
  174. 174 Gemini 1.5 Flash 8B (001) Three-shot, text-only, 2025-04-03 64.7%
  175. 175 GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
  176. 176 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-21 64.5%
  177. 177 Qwen/Qwen2.5-7B-Instruct Three-shot, text-only, rev: bb46c15, bfloat16, 2024-10-15 64.5%
  178. 178 tiiuae/Falcon3-10B-Base Three-shot, text-only, bfloat16, 2025-01-15 64.5%
  179. 179 Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
  180. 180 recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp Three-shot, text-only, bfloat16, 2024-09-16 64.3%
  181. 181 TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule Three-shot, text-only, bfloat16, 2025-03-07 64.3%
  182. 182 Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
  183. 183 botbot-ai/CabraMixtral-8x7b Three-shot, text-only, bfloat16, 2024-04-28 64.1%
  184. 184 Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
  185. 185 recoilme/recoilme-gemma-2-9B-v0.2 Three-shot, text-only, bfloat16, 2024-09-21 64%
  186. 186 arcee-ai/Virtuoso-Lite Three-shot, text-only, bfloat16, 2025-02-05 64%
  187. 187 Replete-AI/Replete-LLM-V2.5-Qwen-7b Three-shot, text-only, bfloat16, 2024-10-01 63.7%
  188. 188 sethuiyer/Qwen2.5-7B-Anvita Three-shot, text-only, bfloat16, 2024-11-01 63.7%
  189. 189 cognitivecomputations/dolphin-2.9.1-yi-1.5-34b Three-shot, text-only, bfloat16, 2024-05-25 63.6%
  190. 190 google/gemma-2-9b-it Three-shot, text-only, bfloat16, 2024-07-02 63.6%
  191. 191 TheDrummer/Gemmasutra-9B-v1 Three-shot, text-only, bfloat16, 2024-09-19 63.6%
  192. 192 huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2 Three-shot, text-only, bfloat16, 2024-10-01 63.6%
  193. 193 Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
  194. 194 OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k Three-shot, text-only, bfloat16, 2024-09-29 63.4%
  195. 195 01-ai/Yi-34B-Chat Three-shot, text-only, bfloat16, 2024-02-27 63.3%
  196. 196 lucianosb/boto-9B Three-shot, text-only, bfloat16, 2024-07-10 63.3%
  197. 197 rhymes-ai/Aria-Base-64K Three-shot, text-only, bfloat16, 2024-12-05 63.3%
  198. 198 THUDM/GLM-4-9B-0414 Three-shot, text-only, bfloat16, 2025-05-01 63.1%
  199. 199 Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
  200. 200 NousResearch/Nous-Capybara-34B Three-shot, text-only, bfloat16, 2024-04-26 63%
  201. 201 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 63%
  202. 202 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 63%
  203. 203 Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
  204. 204 speakleash/Bielik-11B-v2.2-Instruct Three-shot, text-only, bfloat16, 2024-10-17 62.7%
  205. 205 speakleash/Bielik-11B-v2.1-Instruct Three-shot, text-only, bfloat16, 2024-10-17 62.6%
  206. 206 GPT-3.5 Turbo Jan 2024, Three-shot, text-only, 2024-03-08 62.5%
  207. 207 phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
  208. 208 microsoft/Phi-3-small-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 62.5%
  209. 209 cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b Three-shot, text-only, bfloat16, 2024-07-25 62.5%
  210. 210 PrunaAI/dbrx-base-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 62.3%
  211. 211 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2 Three-shot, text-only, bfloat16, 2024-09-21 62.3%
  212. 212 recoilme/recoilme-gemma-2-9B-v0.3 Three-shot, text-only, rev: 772cab4, bfloat16, 2024-09-29 62.3%
  213. 213 speakleash/Bielik-11B-v2.3-Instruct Three-shot, text-only, float16, 2024-10-17 62.3%
  214. 214 chujiezheng/Smaug-34B-v0.1-ExPO Three-shot, text-only, bfloat16, 2024-05-30 62.2%
  215. 215 jpacifico/Chocolatine-14B-Instruct-4k-DPO Three-shot, text-only, float16, 2024-08-27 62.2%
  216. 216 MarinaraSpaghetti/NemoReRemix-12B Three-shot, text-only, bfloat16, 2024-09-17 62.2%
  217. 217 Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
  218. 218 PrunaAI/dbrx-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 62%
  219. 219 OrionStarAI/OrionStar-Yi-34B-Chat Three-shot, text-only, float16, 2024-06-09 62%
  220. 220 Weyaxi/Einstein-v7-Qwen2-7B Three-shot, text-only, bfloat16, 2024-07-16 62%
  221. 221 GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
  222. 222 tiiuae/Falcon-H1-3B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 61.9%
  223. 223 Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
  224. 224 NLPark/AnFeng_v3.1-Avocet Three-shot, text-only, float16, 2024-08-04 61.8%
  225. 225 MaziyarPanahi/calme-2.4-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 61.8%
  226. 226 allknowingroger/Ph3della5-14B Three-shot, text-only, float16, 2024-10-10 61.8%
  227. 227 macadeliccc/Samantha-Qwen-2-7B Three-shot, text-only, rev: 5905897, float16, 2024-07-17 61.6%
  228. 228 phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
  229. 229 Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
  230. 230 mistralai/Mistral-Nemo-Instruct-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.5%
  231. 231 speakleash/Bielik-11B-v2.0-Instruct Three-shot, text-only, bfloat16, 2024-10-17 61.5%
  232. 232 Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
  233. 233 OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k Three-shot, text-only, bfloat16, 2024-05-30 61.3%
  234. 234 InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
  235. 235 Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
  236. 236 informatiker/Qwen2-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-15 61.2%
  237. 237 MaziyarPanahi/calme-2.2-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 61.2%
  238. 238 natong19/Mistral-Nemo-Instruct-2407-abliterated Three-shot, text-only, bfloat16, 2024-09-21 61.2%
  239. 239 Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
  240. 240 Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
  241. 241 migtissera/Tess-v2.5-Phi-3-medium-128k-14B Three-shot, text-only, bfloat16, 2024-06-17 60.9%
  242. 242 arcee-ai/Arcee-Spark Three-shot, text-only, bfloat16, 2024-08-10 60.9%
  243. 243 Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
  244. 244 nicolasdec/CabraQwen14b Three-shot, text-only, bfloat16, 2024-04-02 60.8%
  245. 245 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium Three-shot, text-only, bfloat16, 2024-06-17 60.8%
  246. 246 lucianosb/boto-9B-it Three-shot, text-only, bfloat16, 2024-07-12 60.8%
  247. 247 axolotl-ai-co/romulus-mistral-nemo-12b-simpo Three-shot, text-only, rev: 19e2c43, bfloat16, 2024-09-21 60.8%
  248. 248 v000000/L3.1-Niitorm-8B-DPO-t0.0001 Three-shot, text-only, float16, 2024-09-30 60.8%
  249. 249 Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
  250. 250 BAAI/Infinity-Instruct-3M-0625-Qwen2-7B Three-shot, text-only, bfloat16, 2024-07-16 60.6%
  251. 251 Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
  252. 252 byroneverson/Mistral-Small-Instruct-2409-abliterated Three-shot, text-only, bfloat16, 2024-10-13 60.6%
  253. 253 jaspionjader/f-9-8b Three-shot, text-only, bfloat16, 2025-01-02 60.5%
  254. 254 natong19/Qwen2-7B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-06-19 60.4%
  255. 255 meta-llama/Llama-3.2-11B-Vision Three-shot, text-only, bfloat16, 2024-12-05 60.4%
  256. 256 argilla/notux-8x7b-v1 Three-shot, text-only, bfloat16, 2024-02-27 60.2%
  257. 257 CohereForAI/aya-23-35B Three-shot, text-only, float16, 2024-05-23 60.2%
  258. 258 mlabonne/NeuralDaredevil-8B-abliterated Three-shot, text-only, float16, 2024-05-28 60.2%
  259. 259 SeaLLMs/SeaLLMs-v3-7B-Chat Three-shot, text-only, bfloat16, 2024-07-28 60.2%
  260. 260 grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter Three-shot, text-only, bfloat16, 2024-09-17 60.2%
  261. 261 Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base Three-shot, text-only, bfloat16, 2024-10-04 60.2%
  262. 262 Sao10K/L3.1-8B-Niitama-v1.1 Three-shot, text-only, float16, 2024-11-08 60.2%
  263. 263 vicgalle/CarbonBeagle-11B-truthy Three-shot, text-only, float16, 2024-05-17 60.1%
  264. 264 mlabonne/Daredevil-8B-abliterated Three-shot, text-only, bfloat16, 2024-05-27 60.1%
  265. 265 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25 Three-shot, text-only, bfloat16, 2024-06-06 60.1%
  266. 266 nbeerbower/mistral-nemo-wissenschaft-12B Three-shot, text-only, bfloat16, 2024-08-30 60.1%
  267. 267 arcee-ai/Llama-3.1-SuperNova-Lite Three-shot, text-only, bfloat16, 2024-09-17 60.1%
  268. 268 tiiuae/Falcon3-7B-Base Three-shot, text-only, bfloat16, 2025-01-15 60.1%
  269. 269 Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
  270. 270 mistralai/Mixtral-8x7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-02-18 59.8%
  271. 271 WizardLMTeam/WizardLM-70B-V1.0 Three-shot, text-only, float16, 2024-05-22 59.8%
  272. 272 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated Three-shot, text-only, bfloat16, 2024-06-17 59.8%
  273. 273 JJhooww/Qwen2-7B_reload_v1 Three-shot, text-only, float16, 2024-06-17 59.8%
  274. 274 THUDM/LongWriter-glm4-9b Three-shot, text-only, bfloat16, 2024-09-18 59.8%
  275. 275 meta-llama/Llama-3.1-8B-Instruct Three-shot, text-only, float16, 2024-10-23 59.8%
  276. 276 ai21labs/Jamba-v0.1 Three-shot, text-only, bfloat16, 2024-04-07 59.7%
  277. 277 cognitivecomputations/dolphin-2.9.2-qwen2-7b Three-shot, text-only, bfloat16, 2024-06-10 59.5%
  278. 278 Kukedlc/NeuralLLaMa-3-8b-DT-v0.1 Three-shot, text-only, float16, 2024-05-17 59.4%
  279. 279 bunnycore/HyperLlama-3.1-8B Three-shot, text-only, bfloat16, 2024-09-05 59.4%
  280. 280 failspy/Phi-3-medium-4k-instruct-abliterated-v3 Three-shot, text-only, bfloat16, 2024-05-25 59.3%
  281. 281 MaziyarPanahi/Llama-3-8B-Instruct-v0.8 Three-shot, text-only, bfloat16, 2024-05-29 59.3%
  282. 282 Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
  283. 283 princeton-nlp/gemma-2-9b-it-DPO Three-shot, text-only, rev: 422941a, bfloat16, 2024-10-07 59.3%
  284. 284 RDson/WomboCombo-R1-Coder-14B-Preview Three-shot, text-only, bfloat16, 2025-02-06 59.3%
  285. 285 rhaymison/Mistral-8x7b-portuguese-luana Three-shot, text-only, float16, 2024-04-22 59.1%
  286. 286 mlabonne/ChimeraLlama-3-8B-v3 Three-shot, text-only, float16, 2024-08-06 59.1%
  287. 287 upstage/SOLAR-10.7B-v1.0 Three-shot, text-only, float16, 2024-02-05 59%
  288. 288 vicgalle/ConfigurableBeagle-11B Three-shot, text-only, rev: bbc16db, float16, 2024-06-14 59%
  289. 289 recogna-nlp/Bode-3.1-8B-Instruct-full Three-shot, text-only, rev: oldalpaca, float16, 2024-08-31 59%
  290. 290 deepcogito/cogito-v1-preview-llama-8B Three-shot, text-only, bfloat16, 2025-04-09 59%
  291. 291 tiiuae/Falcon-H1-3B-Base Three-shot, text-only, bfloat16, 2025-07-08 59%
  292. 292 lightblue/suzume-llama-3-8B-multilingual Three-shot, text-only, bfloat16, 2024-05-13 58.8%
  293. 293 uygarkurt/llama-3-merged-linear Three-shot, text-only, float16, 2024-05-13 58.8%
  294. 294 DeepMount00/Llama-3-8b-Ita Three-shot, text-only, bfloat16, 2024-05-17 58.8%
  295. 295 meta-llama/Meta-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-07-23 58.8%
  296. 296 BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B Three-shot, text-only, rev: a42c86c, bfloat16, 2024-08-01 58.8%
  297. 297 BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B Three-shot, text-only, bfloat16, 2024-08-05 58.8%
  298. 298 BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B Three-shot, text-only, bfloat16, 2024-08-22 58.8%
  299. 299 v000000/SwallowMaid-8B-L3-SPPO-abliterated Three-shot, text-only, bfloat16, 2024-09-21 58.8%
  300. 300 Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
  301. 301 OrionStarAI/Orion-14B-Base Three-shot, text-only, bfloat16, 2024-02-05 58.7%
  302. 302 recogna-nlp/internlm-chatbode-20b Three-shot, text-only, float16, 2024-05-07 58.7%
  303. 303 internlm/internlm2_5-7b-chat-1m Three-shot, text-only, bfloat16, 2024-07-05 58.7%
  304. 304 vicgalle/Configurable-Llama-3.1-8B-Instruct Three-shot, text-only, float16, 2024-08-03 58.7%
  305. 305 freewheelin/free-llama3-dpo-v0.2 Three-shot, text-only, bfloat16, 2024-08-07 58.7%
  306. 306 Eurdem/Defne-llama3.1-8B Three-shot, text-only, bfloat16, 2024-08-13 58.7%
  307. 307 unsloth/Meta-Llama-3.1-70B-bnb-4bit Three-shot, text-only, 4bit, 2024-08-13 58.7%
  308. 308 internlm/internlm2-20b Three-shot, text-only, bfloat16, 2024-04-21 58.5%
  309. 309 PrunaAI/Jamba-v0.1-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 58.5%
  310. 310 VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct Three-shot, text-only, bfloat16, 2024-05-17 58.5%
  311. 311 shadowml/Mixolar-4x7b Three-shot, text-only, float16, 2024-06-17 58.5%
  312. 312 OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k Three-shot, text-only, bfloat16, 2024-10-10 58.5%
  313. 313 speakleash/Bielik-11B-v2 Three-shot, text-only, bfloat16, 2024-10-16 58.5%
  314. 314 invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp Three-shot, text-only, float16, 2024-05-16 58.4%
  315. 315 VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct Three-shot, text-only, bfloat16, 2024-07-29 58.4%
  316. 316 MaziyarPanahi/Llama-3-8B-Instruct-v0.10 Three-shot, text-only, bfloat16, 2024-08-13 58.4%
  317. 317 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule Three-shot, text-only, bfloat16, 2025-03-07 58.4%
  318. 318 SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
  319. 319 unsloth/llama-3-70b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 58.3%
  320. 320 Danielbrdz/Barcenas-Llama3-8b-ORPO Three-shot, text-only, float16, 2024-05-13 58.3%
  321. 321 MaziyarPanahi/Llama-3-8B-Instruct-v0.9 Three-shot, text-only, bfloat16, 2024-08-13 58.3%
  322. 322 princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2 Three-shot, text-only, rev: 5ed8372, bfloat16, 2024-09-28 58.3%
  323. 323 princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2 Three-shot, text-only, rev: d06275e, bfloat16, 2024-09-28 58.3%
  324. 324 princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2 Three-shot, text-only, rev: 3ea5c54, bfloat16, 2024-09-28 58.3%
  325. 325 princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2 Three-shot, text-only, rev: 4e5bc97, bfloat16, 2024-10-07 58.3%
  326. 326 kekmodel/StopCarbon-10.7B-v5 Three-shot, text-only, float16, 2024-05-16 58.1%
  327. 327 DeepMount00/Llama-3.1-8b-Ita Three-shot, text-only, bfloat16, 2024-09-18 58.1%
  328. 328 princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2 Three-shot, text-only, rev: 81191fb, bfloat16, 2024-10-07 58.1%
  329. 329 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2 Three-shot, text-only, rev: 1821cc4, bfloat16, 2024-10-07 58.1%
  330. 330 jeonsworld/CarbonVillain-en-10.7B-v4 Three-shot, text-only, bfloat16, 2024-04-26 58%
  331. 331 rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct Three-shot, text-only, float16, 2024-04-30 58%
  332. 332 saltlux/luxia-21.4b-alignment-v1.0 Three-shot, text-only, float16, 2024-05-15 58%
  333. 333 failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 Three-shot, text-only, bfloat16, 2024-05-27 58%
  334. 334 saltlux/luxia-21.4b-alignment-v1.2 Three-shot, text-only, bfloat16, 2024-05-30 58%
  335. 335 RLHFlow/LLaMA3-iterative-DPO-final Three-shot, text-only, bfloat16, 2024-06-05 58%
  336. 336 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 58%
  337. 337 dnhkng/RYS-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-08-22 58%
  338. 338 internlm/internlm2-chat-20b Three-shot, text-only, bfloat16, 2024-04-18 57.9%
  339. 339 openchat/openchat-3.5-0106-gemma Three-shot, text-only, bfloat16, 2024-05-17 57.9%
  340. 340 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3 Three-shot, text-only, bfloat16, 2024-05-20 57.9%
  341. 341 vicgalle/ConfigurableSOLAR-10.7B Three-shot, text-only, rev: c5c844a, float16, 2024-08-25 57.9%
  342. 342 Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
  343. 343 01-ai/Yi-1.5-9B Three-shot, text-only, bfloat16, 2024-05-15 57.7%
  344. 344 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75 Three-shot, text-only, bfloat16, 2024-06-06 57.7%
  345. 345 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 57.7%
  346. 346 Dampfinchen/Llama-3.1-8B-Ultra-Instruct Three-shot, text-only, bfloat16, 2024-09-16 57.7%
  347. 347 princeton-nlp/Llama-3-Instruct-8B-CPO Three-shot, text-only, rev: d4645ae, bfloat16, 2024-09-28 57.7%
  348. 348 ibivibiv/llama-3-nectar-dpo-8B Three-shot, text-only, bfloat16, 2024-06-22 57.6%
  349. 349 princeton-nlp/Llama-3-Instruct-8B-KTO Three-shot, text-only, rev: e697908, bfloat16, 2024-09-28 57.6%
  350. 350 anthracite-org/magnum-v2.5-12b-kto Three-shot, text-only, rev: aee0374, float16, 2024-09-29 57.6%
  351. 351 Sao10K/L3-8B-Niitama-v1 Three-shot, text-only, float16, 2024-12-18 57.6%
  352. 352 VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct Three-shot, text-only, bfloat16, 2024-08-10 57.4%
  353. 353 migtissera/Trinity-2-Codestral-22B Three-shot, text-only, bfloat16, 2024-09-16 57.4%
  354. 354 princeton-nlp/Llama-3-Instruct-8B-RDPO Three-shot, text-only, rev: 9497ca2, bfloat16, 2024-09-28 57.4%
  355. 355 Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
  356. 356 internlm/internlm2-chat-20b-sft Three-shot, text-only, bfloat16, 2024-04-21 57.3%
  357. 357 mlabonne/Llama-3-8B-Instruct-abliterated-dpomix Three-shot, text-only, float16, 2024-05-27 57.3%
  358. 358 princeton-nlp/Llama-3-Instruct-8B-SimPO Three-shot, text-only, bfloat16, 2024-05-29 57.3%
  359. 359 grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge Three-shot, text-only, bfloat16, 2024-08-08 57.3%
  360. 360 recogna-nlp/Bode-3.1-8B-Instruct-lora Three-shot, text-only, float16, 2024-08-30 57.3%
  361. 361 EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection Three-shot, text-only, rev: 22257d3, float16, 2024-09-17 57.3%
  362. 362 princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2 Three-shot, text-only, rev: 477d33e, bfloat16, 2024-09-28 57.3%
  363. 363 princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2 Three-shot, text-only, rev: 24601cd, bfloat16, 2024-10-07 57.3%
  364. 364 princeton-nlp/Llama-3-Instruct-8B-RRHF Three-shot, text-only, rev: 73561d9, bfloat16, 2024-10-07 57.3%
  365. 365 Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
  366. 366 MagusCorp/grpo_lora_enem_llama3_7b Three-shot, text-only, float16, 2025-02-11 57.3%
  367. 367 recogna-nlp/gembode-7b Three-shot, text-only, float16, 2024-04-23 57.2%
  368. 368 unsloth/llama-3-8b-Instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 57.2%
  369. 369 vicgalle/Configurable-Llama-3-8B-v0.3 Three-shot, text-only, float16, 2024-06-17 57.2%
  370. 370 princeton-nlp/Llama-3-Instruct-8B-DPO Three-shot, text-only, rev: 0afbf4c, bfloat16, 2024-09-28 57.2%
  371. 371 tiiuae/Falcon-H1-1.5B-Deep-Instruct Three-shot, text-only, bfloat16, 2025-07-08 57.2%
  372. 372 NousResearch/Hermes-2-Pro-Llama-3-8B Three-shot, text-only, float16, 2024-05-06 57%
  373. 373 01-ai/Yi-1.5-9B-32K Three-shot, text-only, bfloat16, 2024-05-20 57%
  374. 374 NousResearch/Hermes-2-Theta-Llama-3-8B Three-shot, text-only, bfloat16, 2024-05-27 57%
  375. 375 arthrod/cicerollamatry8 Three-shot, text-only, float16, 2024-05-29 57%
  376. 376 maywell/Qwen2-7B-Multilingual-RP Three-shot, text-only, bfloat16, 2024-07-24 57%
  377. 377 botbot-ai/CabraLlama3-8b Three-shot, text-only, bfloat16, 2024-04-22 56.9%
  378. 378 jondurbin/bagel-8b-v1.0 Three-shot, text-only, bfloat16, 2024-05-18 56.9%
  379. 379 vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B Three-shot, text-only, float16, 2024-06-12 56.9%
  380. 380 BAAI/Infinity-Instruct-3M-0625-Llama3-8B Three-shot, text-only, bfloat16, 2024-07-18 56.9%
  381. 381 EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta Three-shot, text-only, rev: ef37828, float16, 2024-09-15 56.9%
  382. 382 MaziyarPanahi/calme-2.7-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 56.9%
  383. 383 Qwen/Qwen2.5-3B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 56.9%
  384. 384 Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
  385. 385 qnguyen3/Master-Yi-9B Three-shot, text-only, bfloat16, 2024-05-29 56.8%
  386. 386 OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k Three-shot, text-only, bfloat16, 2024-05-30 56.8%
  387. 387 tobiaspires/command-r-p11-fn Three-shot, text-only, bfloat16, 2024-06-05 56.8%
  388. 388 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4 Three-shot, text-only, bfloat16, 2024-07-12 56.8%
  389. 389 EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta Three-shot, text-only, rev: 010aaa1, float16, 2024-09-13 56.8%
  390. 390 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta Three-shot, text-only, float16, 2024-09-17 56.8%
  391. 391 grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge Three-shot, text-only, bfloat16, 2024-09-17 56.8%
  392. 392 01-ai/Yi-1.5-9B-Chat-16K Three-shot, text-only, bfloat16, 2024-05-20 56.6%
  393. 393 chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO Three-shot, text-only, bfloat16, 2024-05-29 56.6%
  394. 394 microsoft/Phi-3.5-mini-instruct Three-shot, text-only, bfloat16, 2024-12-03 56.6%
  395. 395 Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
  396. 396 EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200 Three-shot, text-only, float16, 2024-09-17 56.5%
  397. 397 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule Three-shot, text-only, bfloat16, 2025-03-07 56.5%
  398. 398 rishiraj/CatPPT Three-shot, text-only, bfloat16, 2024-02-25 56.3%
  399. 399 VAGOsolutions/SauerkrautLM-Gemma-7b Three-shot, text-only, bfloat16, 2024-05-17 56.3%
  400. 400 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2 Three-shot, text-only, bfloat16, 2024-07-12 56.3%
  401. 401 NousResearch/Hermes-3-Llama-3.1-8B Three-shot, text-only, bfloat16, 2024-08-30 56.3%
  402. 402 leafspark/Llama-3.1-8B-MultiReflection-Instruct Three-shot, text-only, float16, 2024-09-16 56.3%
  403. 403 Qwen/Qwen2.5-Coder-7B-Instruct Three-shot, text-only, bfloat16, 2024-10-13 56.3%
  404. 404 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-07-09 56.2%
  405. 405 vicgalle/Configurable-Hermes-3-Llama-3.1-8B Three-shot, text-only, float16, 2024-09-17 56.2%
  406. 406 MaziyarPanahi/calme-2.3-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 56.2%
  407. 407 mistralai/Ministral-8B-Instruct-2410 Three-shot, text-only, bfloat16, 2024-12-03 56.2%
  408. 408 cognitivecomputations/Dolphin3.0-R1-Mistral-24B Three-shot, text-only, bfloat16, 2025-02-11 56.2%
  409. 409 NousResearch/Nous-Hermes-2-SOLAR-10.7B Three-shot, text-only, bfloat16, 2024-02-27 56%
  410. 410 nicolasdec/CabraQwen7b Three-shot, text-only, bfloat16, 2024-04-02 56%
  411. 411 tiiuae/Falcon-H1-1.5B-Deep-Base Three-shot, text-only, bfloat16, 2025-07-08 56%
  412. 412 rishiraj/CatPPT-base Three-shot, text-only, float16, 2024-02-25 55.9%
  413. 413 cognitivecomputations/dolphin-2.9.1-yi-1.5-9b Three-shot, text-only, bfloat16, 2024-05-25 55.9%
  414. 414 internlm/internlm2_5-7b-chat Three-shot, text-only, bfloat16, 2024-07-05 55.9%
  415. 415 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3 Three-shot, text-only, bfloat16, 2024-07-12 55.9%
  416. 416 arcee-ai/Arcee-Scribe Three-shot, text-only, bfloat16, 2024-08-10 55.9%
  417. 417 princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2 Three-shot, text-only, bfloat16, 2024-08-10 55.9%
  418. 418 EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos Three-shot, text-only, float16, 2024-09-09 55.9%
  419. 419 Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
  420. 420 vicgalle/CarbonBeagle-11B Three-shot, text-only, float16, 2024-06-17 55.8%
  421. 421 microsoft/MediPhi Three-shot, text-only, bfloat16, 2025-08-30 55.8%
  422. 422 Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
  423. 423 SeaLLMs/SeaLLM-7B-v2.5 Three-shot, text-only, bfloat16, 2024-05-13 55.6%
  424. 424 princeton-nlp/Llama-3-8B-ProLong-512k-Instruct Three-shot, text-only, bfloat16, 2024-09-17 55.6%
  425. 425 princeton-nlp/Llama-3-8B-ProLong-64k-Base Three-shot, text-only, bfloat16, 2024-09-17 55.6%
  426. 426 Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
  427. 427 Sabiá-2 Small Three-shot, text-only, 2024-04-12 55.5%
  428. 428 lemon-mint/gemma-ko-7b-instruct-v0.62 Three-shot, text-only, bfloat16, 2024-05-17 55.5%
  429. 429 wenbopan/Faro-Yi-9B Three-shot, text-only, bfloat16, 2024-05-29 55.5%
  430. 430 OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k Three-shot, text-only, bfloat16, 2024-09-29 55.5%
  431. 431 princeton-nlp/Llama-3-Instruct-8B-IPO Three-shot, text-only, rev: fbe883f, bfloat16, 2024-10-07 55.5%
  432. 432 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF Three-shot, text-only, rev: 7e9001f, bfloat16, 2024-10-07 55.5%
  433. 433 LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
  434. 434 Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
  435. 435 wenbopan/Faro-Yi-9B-DPO Three-shot, text-only, rev: 58a4349, float16, 2024-06-14 55.2%
  436. 436 Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 Three-shot, text-only, bfloat16, 2024-08-06 55.2%
  437. 437 terrycraddock/Reflection-Llama-3.1-8B Three-shot, text-only, float16, 2024-09-15 55.2%
  438. 438 migtissera/Trinity-2-Codestral-22B-v0.2 Three-shot, text-only, bfloat16, 2024-09-16 55.2%
  439. 439 MaziyarPanahi/calme-2.1-qwen2-7b Three-shot, text-only, bfloat16, 2024-09-18 55.2%
  440. 440 vicgalle/Configurable-Yi-1.5-9B-Chat Three-shot, text-only, float16, 2024-05-29 55.1%
  441. 441 meraGPT/mera-mix-4x7B Three-shot, text-only, bfloat16, 2024-06-10 55.1%
  442. 442 BAAI/Infinity-Instruct-3M-0625-Mistral-7B Three-shot, text-only, bfloat16, 2024-07-18 55.1%
  443. 443 Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
  444. 444 FuseAI/FuseChat-7B-VaRM Three-shot, text-only, bfloat16, 2024-03-04 54.9%
  445. 445 unsloth/llama-3-8b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 54.9%
  446. 446 princeton-nlp/Llama-3-8B-ProLong-64k-Instruct Three-shot, text-only, bfloat16, 2024-09-17 54.9%
  447. 447 internlm/internlm2-base-20b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 54.8%
  448. 448 Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
  449. 449 ibivibiv/multimaster-7b-v6 Three-shot, text-only, bfloat16, 2024-06-08 54.8%
  450. 450 MaziyarPanahi/Topxtral-4x7B-v0.1 Three-shot, text-only, bfloat16, 2024-06-10 54.8%
  451. 451 Kukedlc/NeuralSynthesis-7B-v0.1 Three-shot, text-only, bfloat16, 2024-06-12 54.8%
  452. 452 jsfs11/MixtureofMerges-MoE-4x7b-v5 Three-shot, text-only, bfloat16, 2024-06-17 54.8%
  453. 453 mistralai/Codestral-22B-v0.1 Three-shot, text-only, bfloat16, 2024-07-02 54.8%
  454. 454 cognitivecomputations/laserxtral Three-shot, text-only, bfloat16, 2024-07-31 54.8%
  455. 455 freewheelin/free-solar-evo-v0.1 Three-shot, text-only, float16, 2024-08-07 54.8%
  456. 456 FuseAI/OpenChat-3.5-7B-Solar Three-shot, text-only, bfloat16, 2024-03-04 54.7%
  457. 457 kevin009/llamaRAGdrama Three-shot, text-only, float16, 2024-05-30 54.7%
  458. 458 cognitivecomputations/WestLake-7B-v2-laser Three-shot, text-only, bfloat16, 2024-07-31 54.7%
  459. 459 freewheelin/free-solar-evo-v0.13 Three-shot, text-only, float16, 2024-08-07 54.7%
  460. 460 princeton-nlp/Llama-3-Instruct-8B-ORPO Three-shot, text-only, rev: 4bb3ffc, bfloat16, 2024-09-28 54.7%
  461. 461 Kukedlc/NeuralSynthesis-7b-v0.4-slerp Three-shot, text-only, bfloat16, 2024-05-30 54.5%
  462. 462 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5 Three-shot, text-only, bfloat16, 2024-07-12 54.5%
  463. 463 liminerity/M7-7b Three-shot, text-only, bfloat16, 2024-07-13 54.5%
  464. 464 freewheelin/free-solar-evo-v0.11 Three-shot, text-only, float16, 2024-08-07 54.5%
  465. 465 Magpie-Align/MagpieLM-8B-SFT-v0.1 Three-shot, text-only, rev: b91f605, bfloat16, 2024-09-29 54.5%
  466. 466 rombodawg/rombos_Replete-Coder-Instruct-8b-Merged Three-shot, text-only, bfloat16, 2024-10-14 54.5%
  467. 467 paulml/OGNO-7B Three-shot, text-only, bfloat16, 2024-02-25 54.4%
  468. 468 MaziyarPanahi/Mistral-7B-Instruct-Aya-101 Three-shot, text-only, bfloat16, 2024-04-17 54.4%
  469. 469 J-LAB/BRisa-7B-Instruct-v0.2 Three-shot, text-only, float16, 2024-04-18 54.4%
  470. 470 Kquant03/CognitiveFusion2-4x7B-BF16 Three-shot, text-only, bfloat16, 2024-05-15 54.4%
  471. 471 NotAiLOL/Yi-1.5-dolphin-9B Three-shot, text-only, bfloat16, 2024-05-17 54.4%
  472. 472 01-ai/Yi-9B-200K Three-shot, text-only, rev: v20240318, bfloat16, 2024-05-20 54.4%
  473. 473 allknowingroger/MultiverseEx26-7B-slerp Three-shot, text-only, bfloat16, 2024-07-03 54.4%
  474. 474 EpistemeAI/Fireball-3.1-8B-ORPO Three-shot, text-only, bfloat16, 2024-08-26 54.4%
  475. 475 Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
  476. 476 bardsai/jaskier-7b-dpo-v5.6 Three-shot, text-only, bfloat16, 2024-02-25 54.2%
  477. 477 teknium/OpenHermes-2-Mistral-7B Three-shot, text-only, bfloat16, 2024-02-27 54.2%
  478. 478 automerger/YamshadowExperiment28-7B Three-shot, text-only, bfloat16, 2024-05-30 54.2%
  479. 479 Kukedlc/NeuralSynthesis-7B-v0.3 Three-shot, text-only, bfloat16, 2024-07-29 54.2%
  480. 480 TIGER-Lab/AceCodeRM-7B Three-shot, text-only, bfloat16, 2025-03-07 54.2%
  481. 481 Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
  482. 482 NousResearch/Nous-Hermes-2-Mistral-7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 54.1%
  483. 483 stabilityai/stablelm-2-12b Three-shot, text-only, bfloat16, 2024-04-08 54.1%
  484. 484 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1 Three-shot, text-only, bfloat16, 2024-04-20 54.1%
  485. 485 Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
  486. 486 zhengr/MixTAO-7Bx2-MoE-v8.1 Three-shot, text-only, bfloat16, 2024-05-13 54.1%
  487. 487 jsfs11/MixtureofMerges-MoE-4x7b-v4 Three-shot, text-only, bfloat16, 2024-05-15 54.1%
  488. 488 J-LAB/FluxiIA-Small Three-shot, text-only, float16, 2024-11-19 54.1%
  489. 489 JJhooww/Mistral-7B-v0.2-Base_ptbr Three-shot, text-only, float16, 2024-04-13 54%
  490. 490 phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
  491. 491 princeton-nlp/Llama-3-Base-8B-SFT-ORPO Three-shot, text-only, rev: 54d5840, bfloat16, 2024-09-28 54%
  492. 492 princeton-nlp/Llama-3-Base-8B-SFT-RDPO Three-shot, text-only, rev: b41a964, bfloat16, 2024-09-28 54%
  493. 493 EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic Three-shot, text-only, float16, 2024-12-13 54%
  494. 494 Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
  495. 495 Walmart-the-bag/Misted-v2-7B Three-shot, text-only, float16, 2024-04-18 53.8%
  496. 496 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2 Three-shot, text-only, bfloat16, 2024-04-30 53.8%
  497. 497 internlm/internlm2-wqx-20b Three-shot, text-only, bfloat16, 2024-06-05 53.8%
  498. 498 princeton-nlp/Llama-3-Base-8B-SFT-RRHF Three-shot, text-only, rev: aea8c04, bfloat16, 2024-10-07 53.8%
  499. 499 kurakurai/Luth-1.7B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 53.8%
  500. 500 utter-project/EuroLLM-9B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 53.8%
  501. 501 Walmart-the-bag/WordWoven-2x7B Three-shot, text-only, float16, 2024-04-18 53.7%
  502. 502 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3 Three-shot, text-only, bfloat16, 2024-04-23 53.7%
  503. 503 adalbertojunior/Llama-3-8B-Dolphin-Portuguese Three-shot, text-only, bfloat16, 2024-04-27 53.7%
  504. 504 abacusai/Slerp-CM-mist-dpo Three-shot, text-only, float16, 2024-09-05 53.7%
  505. 505 ValiantLabs/Llama3.1-8B-Cobalt Three-shot, text-only, bfloat16, 2024-10-04 53.7%
  506. 506 princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF Three-shot, text-only, rev: 325092c, bfloat16, 2024-10-07 53.7%
  507. 507 HuggingFaceTB/SmolLM3-3B-Base Three-shot, text-only, bfloat16, 2025-07-08 53.7%
  508. 508 01-ai/Yi-9B-200k Three-shot, text-only, bfloat16, 2024-04-13 53.5%
  509. 509 eduagarcia/mistral-orpo-mix-21k Three-shot, text-only, bfloat16, 2024-05-06 53.5%
  510. 510 EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto Three-shot, text-only, float16, 2024-11-04 53.5%
  511. 511 kaist-ai/mistral-orpo-capybara-7k Three-shot, text-only, bfloat16, 2024-04-28 53.4%
  512. 512 yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B Three-shot, text-only, bfloat16, 2024-05-13 53.4%
  513. 513 CultriX/NeuralMona_MoE-4x7B Three-shot, text-only, bfloat16, 2024-05-15 53.4%
  514. 514 Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R Three-shot, text-only, float16, 2024-05-15 53.4%
  515. 515 RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2 Three-shot, text-only, bfloat16, 2024-07-03 53.4%
  516. 516 Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3 Three-shot, text-only, bfloat16, 2024-08-06 53.4%
  517. 517 mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated Three-shot, text-only, bfloat16, 2024-09-10 53.4%
  518. 518 princeton-nlp/Mistral-7B-Instruct-SimPO Three-shot, text-only, rev: 03191ee, bfloat16, 2024-09-21 53.4%
  519. 519 princeton-nlp/Llama-3-Base-8B-SFT-DPO Three-shot, text-only, rev: 3f5ec47, bfloat16, 2024-09-28 53.4%
  520. 520 BAAI/Infinity-Instruct-3M-0613-Mistral-7B Three-shot, text-only, float16, 2024-06-22 53.3%
  521. 521 J-LAB/Nemo_RolePlay_PTBR_new Three-shot, text-only, float16, 2024-09-10 53.3%
  522. 522 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2 Three-shot, text-only, float16, 2024-09-14 53.3%
  523. 523 byroneverson/Yi-1.5-9B-Chat-16K-abliterated Three-shot, text-only, bfloat16, 2024-09-17 53.3%
  524. 524 Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
  525. 525 eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 53.1%
  526. 526 mistralai/Mistral-7B-Instruct-v0.3 Three-shot, text-only, bfloat16, 2024-05-22 53.1%
  527. 527 MaziyarPanahi/Mistral-7B-Instruct-v0.3 Three-shot, text-only, bfloat16, 2024-05-26 53.1%
  528. 528 yunconglong/MoE_13B_DPO Three-shot, text-only, bfloat16, 2024-07-03 53.1%
  529. 529 cognitivecomputations/openchat-3.5-0106-laser Three-shot, text-only, bfloat16, 2024-07-31 53.1%
  530. 530 Magpie-Align/Llama-3-8B-Magpie-Align-v0.3 Three-shot, text-only, bfloat16, 2024-08-06 53.1%
  531. 531 leliuga/Phi-3-mini-4k-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 53%
  532. 532 princeton-nlp/Llama-3-Base-8B-SFT-CPO Three-shot, text-only, rev: 536ce7e, bfloat16, 2024-09-28 53%
  533. 533 utter-project/EuroLLM-9B Three-shot, text-only, bfloat16, 2025-08-30 53%
  534. 534 teknium/OpenHermes-2.5-Mistral-7B Three-shot, text-only, bfloat16, 2024-02-27 52.9%
  535. 535 unsloth/Phi-3-mini-4k-instruct-bnb-4bit Three-shot, text-only, 4bit, 2024-04-23 52.9%
  536. 536 DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
  537. 537 tiiuae/Falcon-H1-1.5B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 52.9%
  538. 538 openchat/openchat-3.5-0106 Three-shot, text-only, bfloat16, 2024-02-05 52.7%
  539. 539 eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 52.7%
  540. 540 Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5 Three-shot, text-only, float16, 2024-07-27 52.7%
  541. 541 Magpie-Align/MagpieLM-8B-Chat-v0.1 Three-shot, text-only, rev: 0b30eab, bfloat16, 2024-09-29 52.7%
  542. 542 princeton-nlp/Llama-3-Base-8B-SFT-IPO Three-shot, text-only, rev: 85055cc, bfloat16, 2024-10-07 52.7%
  543. 543 princeton-nlp/Mistral-7B-Instruct-KTO Three-shot, text-only, rev: 834422e, bfloat16, 2024-10-07 52.7%
  544. 544 internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
  545. 545 mlabonne/Monarch-7B Three-shot, text-only, bfloat16, 2024-02-25 52.6%
  546. 546 JJhooww/Mistral_Relora_Step2k Three-shot, text-only, float16, 2024-03-08 52.6%
  547. 547 princeton-nlp/Llama-3-Base-8B-SFT-SimPO Three-shot, text-only, rev: 0a6e518, bfloat16, 2024-09-21 52.6%
  548. 548 Qwen/Qwen2.5-1.5B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 52.6%
  549. 549 utter-project/EuroLLM-22B-Instruct-Preview Three-shot, text-only, bfloat16, 2025-08-30 52.6%
  550. 550 internlm/internlm2-7b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 52.4%
  551. 551 argilla/CapybaraHermes-2.5-Mistral-7B Three-shot, text-only, float16, 2024-02-27 52.4%
  552. 552 unsloth/gemma-7b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 52.4%
  553. 553 eduagarcia/mistral-orpo-capybara-3k Three-shot, text-only, bfloat16, 2024-05-01 52.4%
  554. 554 recogna-nlp/internlm-chatbode2-7b-beta Three-shot, text-only, float16, 2024-06-14 52.4%
  555. 555 Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
  556. 556 Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
  557. 557 yunconglong/DARE_TIES_13B Three-shot, text-only, bfloat16, 2024-05-15 52.3%
  558. 558 uukuguy/speechless-zephyr-code-functionary-7b Three-shot, text-only, bfloat16, 2024-07-27 52.3%
  559. 559 princeton-nlp/Llama-3-Base-8B-SFT Three-shot, text-only, rev: b622b7d, bfloat16, 2024-10-07 52.3%
  560. 560 meta-llama/Llama-3.2-3B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 52.3%
  561. 561 Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
  562. 562 Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
  563. 563 alvarobartt/Mistral-7B-v0.1-ORPO Three-shot, text-only, bfloat16, 2024-04-28 52.2%
  564. 564 tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-09-12 52.2%
  565. 565 princeton-nlp/Llama-3-Base-8B-SFT-KTO Three-shot, text-only, rev: 49a8c2e, bfloat16, 2024-09-28 52.2%
  566. 566 Qwen/Qwen1.5-MoE-A2.7B-Chat Three-shot, text-only, bfloat16, 2024-04-12 52%
  567. 567 mlabonne/Beyonder-4x7B-v3 Three-shot, text-only, float16, 2024-05-15 52%
  568. 568 uukuguy/zephyr-7b-alpha-dare-0.85 Three-shot, text-only, float16, 2024-05-15 52%
  569. 569 01-ai/Yi-1.5-34B-Chat-16K Three-shot, text-only, bfloat16, 2024-05-20 52%
  570. 570 dzakwan/dzakwan-MoE-4x7b-Beta Three-shot, text-only, float16, 2024-06-10 52%
  571. 571 Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
  572. 572 kaist-ai/janus-dpo-7b Three-shot, text-only, bfloat16, 2024-10-09 52%
  573. 573 huggyllama/llama-30b Three-shot, text-only, float16, 2024-02-05 51.9%
  574. 574 eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1 Three-shot, text-only, bfloat16, 2024-04-28 51.9%
  575. 575 princeton-nlp/Mistral-7B-Instruct-RRHF Three-shot, text-only, rev: 493d3ce, bfloat16, 2024-10-07 51.9%
  576. 576 BornSaint/Dare_Angel_8B Three-shot, text-only, float16, 2025-05-22 51.9%
  577. 577 rhaymison/Llama3-portuguese-luana-8b-instruct Three-shot, text-only, float16, 2024-04-25 51.7%
  578. 578 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4 Three-shot, text-only, float16, 2024-06-15 51.7%
  579. 579 SeaLLMs/SeaLLM-7B-v2 Three-shot, text-only, bfloat16, 2024-08-06 51.7%
  580. 580 abacusai/bigstral-12b-32k Three-shot, text-only, float16, 2024-09-04 51.7%
  581. 581 abacusai/bigyi-15b Three-shot, text-only, float16, 2024-09-04 51.7%
  582. 582 byroneverson/Yi-1.5-9B-Chat-abliterated Three-shot, text-only, bfloat16, 2024-09-17 51.7%
  583. 583 internlm/internlm2-chat-7b-sft Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 51.6%
  584. 584 eduagarcia/mistral-orpo-mix-7k Three-shot, text-only, bfloat16, 2024-04-28 51.6%
  585. 585 rombodawg/Everyone-Coder-4x7b-Base Three-shot, text-only, float16, 2024-07-27 51.6%
  586. 586 recogna-nlp/internlm-chatbode-7b Three-shot, text-only, float16, 2024-05-07 51.5%
  587. 587 vicgalle/Configurable-Mistral-7B Three-shot, text-only, float16, 2024-06-12 51.5%
  588. 588 vicgalle/ConfigurableHermes-7B Three-shot, text-only, float16, 2024-06-17 51.5%
  589. 589 princeton-nlp/Mistral-7B-Instruct-DPO Three-shot, text-only, rev: 5e96cff, bfloat16, 2024-10-07 51.5%
  590. 590 Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
  591. 591 Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
  592. 592 Skywork/Skywork-13B-base Three-shot, text-only, bfloat16, 2024-02-05 51.3%
  593. 593 bartowski/internlm2-chat-7b-llama Three-shot, text-only, rev: refs/pr/2, float16, 2024-04-25 51.3%
  594. 594 uukuguy/speechless-code-mistral-7b-v1.0 Three-shot, text-only, float16, 2024-06-16 51.3%
  595. 595 unsloth/mistral-7b-v0.3-bnb-4bit Three-shot, text-only, 4bit, 2024-05-22 51.2%
  596. 596 openchat/openchat-3.6-8b-20240522 Three-shot, text-only, bfloat16, 2024-05-25 51.2%
  597. 597 shadowml/BeagSake-7B Three-shot, text-only, bfloat16, 2024-06-14 51.2%
  598. 598 rombodawg/rombos_Replete-Coder-Llama3-8B Three-shot, text-only, bfloat16, 2024-10-14 51.2%
  599. 599 Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
  600. 600 MagusCorp/legislinho Three-shot, text-only, float16, 2024-04-09 51%
  601. 601 GritLM/GritLM-7B-KTO Three-shot, text-only, bfloat16, 2024-06-14 51%
  602. 602 beowolx/CodeNinja-1.0-OpenChat-7B Three-shot, text-only, bfloat16, 2024-07-27 51%
  603. 603 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3 Three-shot, text-only, bfloat16, 2024-08-07 51%
  604. 604 princeton-nlp/Mistral-7B-Instruct-CPO Three-shot, text-only, rev: 32492f8, bfloat16, 2024-10-07 51%
  605. 605 internlm/internlm2-chat-7b Three-shot, text-only, rev: v1.0.0, float16, 2024-02-19 50.8%
  606. 606 gradientai/Llama-3-8B-Instruct-262k Three-shot, text-only, bfloat16, 2024-06-13 50.8%
  607. 607 AetherResearch/Cerebrum-1.0-7b Three-shot, text-only, float16, 2024-03-14 50.6%
  608. 608 rhaymison/phi-3-portuguese-tom-cat-4k-instruct Three-shot, text-only, float16, 2024-04-29 50.6%
  609. 609 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2 Three-shot, text-only, bfloat16, 2024-08-07 50.6%
  610. 610 mlabonne/FineLlama-3.1-8B Three-shot, text-only, bfloat16, 2024-08-30 50.6%
  611. 611 princeton-nlp/Mistral-7B-Instruct-RDPO Three-shot, text-only, rev: 23ec6ab, bfloat16, 2024-10-07 50.6%
  612. 612 argilla/notus-7b-v1 Three-shot, text-only, bfloat16, 2024-02-27 50.5%
  613. 613 Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
  614. 614 princeton-nlp/Mistral-7B-Instruct-ORPO Three-shot, text-only, rev: 69c0481, bfloat16, 2024-10-07 50.5%
  615. 615 Qwen/Qwen3-1.7B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.5%
  616. 616 Intel/neural-chat-7b-v3-3 Three-shot, text-only, float16, 2024-02-21 50.4%
  617. 617 Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
  618. 618 THUDM/chatglm3-6b-base Three-shot, text-only, float16, 2024-02-05 50.2%
  619. 619 lmsys/vicuna-33b-v1.3 Three-shot, text-only, float16, 2024-03-05 50.2%
  620. 620 kaist-ai/janus-7b Three-shot, text-only, bfloat16, 2024-10-09 50.2%
  621. 621 Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
  622. 622 Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
  623. 623 recogna-nlp/internlmbode-7b Three-shot, text-only, float16, 2024-04-05 50.1%
  624. 624 mlabonne/NeuralMonarch-7B Three-shot, text-only, float16, 2024-05-15 50.1%
  625. 625 UCLA-AGI/Mistral7B-PairRM-SPPO Three-shot, text-only, bfloat16, 2024-09-21 50.1%
  626. 626 princeton-nlp/Mistral-7B-Instruct-SLiC-HF Three-shot, text-only, rev: 3d08c8b, bfloat16, 2024-10-07 50.1%
  627. 627 unsloth/mistral-7b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-23 49.9%
  628. 628 01-ai/Yi-1.5-6B Three-shot, text-only, bfloat16, 2024-05-16 49.9%
  629. 629 eldogbbhed/Peagle-9b Three-shot, text-only, float16, 2024-05-17 49.9%
  630. 630 amazingvince/Not-WizardLM-2-7B Three-shot, text-only, bfloat16, 2024-05-22 49.9%
  631. 631 google/medgemma-4b-it Three-shot, text-only, bfloat16, 2025-07-15 49.9%
  632. 632 CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it Three-shot, text-only, bfloat16, 2025-07-08 49.8%
  633. 633 Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
  634. 634 cognitivecomputations/dolphin-2.9-llama3-8b Three-shot, text-only, float16, 2024-04-21 49.6%
  635. 635 alvarobartt/mistral-7b-orpo-alignment-handbook Three-shot, text-only, bfloat16, 2024-04-28 49.6%
  636. 636 cosmicvalor/mistral-orthogonalized Three-shot, text-only, float16, 2024-05-25 49.6%
  637. 637 J-AI/Mistral_7b_ptbr_icatalogo Three-shot, text-only, float16, 2024-05-27 49.6%
  638. 638 princeton-nlp/Mistral-7B-Instruct-IPO Three-shot, text-only, rev: 32ad99c, bfloat16, 2024-10-07 49.6%
  639. 639 deepcogito/cogito-v1-preview-llama-3B Three-shot, text-only, bfloat16, 2025-04-09 49.6%
  640. 640 chujiezheng/Mistral7B-PairRM-SPPO-ExPO Three-shot, text-only, bfloat16, 2024-09-21 49.5%
  641. 641 stabilityai/stablelm-2-12b-chat Three-shot, text-only, bfloat16, 2024-04-09 49.4%
  642. 642 lucianosb/boto-7B-v1.1 Three-shot, text-only, float16, 2024-04-22 49.4%
  643. 643 cognitivecomputations/dolphin-2.9.3-mistral-7B-32k Three-shot, text-only, bfloat16, 2024-06-30 49.4%
  644. 644 failspy/Codestral-22B-v0.1-abliterated-v3 Three-shot, text-only, bfloat16, 2024-07-02 49.4%
  645. 645 kaist-ai/janus-orpo-7b Three-shot, text-only, bfloat16, 2024-10-09 49.4%
  646. 646 BSC-LT/salamandra-7b-instruct Three-shot, text-only, bfloat16, 2025-04-04 49.4%
  647. 647 microsoft/Phi-4-mini-instruct Three-shot, text-only, bfloat16, 2025-05-01 49.4%
  648. 648 rhaymison/Mistral-portuguese-luana-7b-chat Three-shot, text-only, bfloat16, 2024-04-09 49.2%
  649. 649 Walmart-the-bag/Quintellect-10.7B Three-shot, text-only, float16, 2024-04-21 49.2%
  650. 650 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4 Three-shot, text-only, bfloat16, 2024-04-24 49.2%
  651. 651 lucianosb/boto-7B-v1.2 Three-shot, text-only, bfloat16, 2024-05-24 49.2%
  652. 652 GritLM/GritLM-7B Three-shot, text-only, bfloat16, 2024-06-05 49.2%
  653. 653 ValiantLabs/Llama3.1-8B-ShiningValiant2 Three-shot, text-only, bfloat16, 2024-08-10 49.2%
  654. 654 mlabonne/AlphaMonarch-7B Three-shot, text-only, float16, 2024-05-15 49.1%
  655. 655 alvarobartt/mistral-7b-orpo-capybara-reproduction Three-shot, text-only, bfloat16, 2024-04-28 49%
  656. 656 MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
  657. 657 Xwin-LM/Xwin-LM-13B-V0.2 Three-shot, text-only, float16, 2024-05-22 49%
  658. 658 Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
  659. 659 TencentARC/Mistral_Pro_8B_v0.1 Three-shot, text-only, bfloat16, 2024-02-24 48.8%
  660. 660 lucianosb/boto-7B Three-shot, text-only, float16, 2024-04-10 48.8%
  661. 661 Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0 Three-shot, text-only, bfloat16, 2024-07-13 48.8%
  662. 662 princeton-nlp/Mistral-7B-Base-SFT-IPO Three-shot, text-only, rev: eea7817, bfloat16, 2024-10-07 48.8%
  663. 663 princeton-nlp/Mistral-7B-Base-SFT-KTO Three-shot, text-only, rev: 02148bb, bfloat16, 2024-10-07 48.8%
  664. 664 cnmoro/Mistral-7B-Portuguese Three-shot, text-only, float16, 2024-03-04 48.7%
  665. 665 princeton-nlp/Mistral-7B-Base-SFT-SimPO Three-shot, text-only, bfloat16, 2024-05-29 48.7%
  666. 666 recogna-nlp/internlm-chatbode2-7b-alpha Three-shot, text-only, float16, 2024-06-12 48.7%
  667. 667 ghost-x/ghost-8b-beta-1608 Three-shot, text-only, bfloat16, 2024-08-18 48.7%
  668. 668 allenai/OLMo-2-1124-7B Three-shot, text-only, bfloat16, 2025-05-01 48.7%
  669. 669 rhaymison/Mistral-portuguese-luana-7b-mental-health Three-shot, text-only, bfloat16, 2024-04-18 48.5%
  670. 670 alvarobartt/mistral-orpo-mix Three-shot, text-only, bfloat16, 2024-04-28 48.5%
  671. 671 princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF Three-shot, text-only, rev: 65d2cc4, bfloat16, 2024-10-07 48.5%
  672. 672 HuggingFaceTB/SmolLM3-3B Three-shot, text-only, bfloat16, 2025-07-08 48.5%
  673. 673 cognitivecomputations/WizardLM-30B-Uncensored Three-shot, text-only, float16, 2024-05-22 48.4%
  674. 674 Xwin-LM/Xwin-LM-13B-V0.1 Three-shot, text-only, float16, 2024-05-22 48.4%
  675. 675 CohereForAI/aya-23-8B Three-shot, text-only, float16, 2024-05-23 48.4%
  676. 676 artificialguybr/OpenHermesV2-PTBR Three-shot, text-only, float16, 2024-05-27 48.4%
  677. 677 princeton-nlp/Mistral-7B-Base-SFT-RDPO Three-shot, text-only, rev: 2a63a6d, bfloat16, 2024-10-07 48.4%
  678. 678 Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0 Three-shot, text-only, float16, 2024-04-09 48.3%
  679. 679 amazon/MegaBeam-Mistral-7B-300k Three-shot, text-only, bfloat16, 2024-10-07 48.3%
  680. 680 allenai/OLMo-2-1124-7B-Instruct Three-shot, text-only, bfloat16, 2025-05-01 48.3%
  681. 681 allenai/tulu-2-dpo-13b Three-shot, text-only, bfloat16, 2024-03-05 48.1%
  682. 682 rhaymison/Qwen-portuguese-luana-7b Three-shot, text-only, bfloat16, 2024-04-18 48.1%
  683. 683 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half Three-shot, text-only, rev: b82150a, bfloat16, 2024-06-14 48.1%
  684. 684 eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1 Three-shot, text-only, bfloat16, 2024-07-09 48.1%
  685. 685 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6 Three-shot, text-only, bfloat16, 2024-07-12 48.1%
  686. 686 Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
  687. 687 princeton-nlp/Mistral-7B-Base-SFT-CPO Three-shot, text-only, rev: 7f67394, bfloat16, 2024-10-07 48.1%
  688. 688 tiiuae/Falcon-H1-1.5B-Base Three-shot, text-only, bfloat16, 2025-07-08 48.1%
  689. 689 Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
  690. 690 Intel/neural-chat-7b-v3-1 Three-shot, text-only, float16, 2024-02-21 48%
  691. 691 JJhooww/MistralReloadBR_v2_ptbr Three-shot, text-only, bfloat16, 2024-03-08 48%
  692. 692 rhaymison/Mistral-portuguese-luana-7b Three-shot, text-only, bfloat16, 2024-04-08 48%
  693. 693 hkust-nlp/deita-7b-v1.0-sft Three-shot, text-only, bfloat16, 2024-04-25 48%
  694. 694 CohereForAI/aya-101 Three-shot, text-only, float16, 2024-02-17 47.8%
  695. 695 royallab/ZephRP-m7b Three-shot, text-only, bfloat16, 2024-05-16 47.8%
  696. 696 ValiantLabs/Llama3.1-8B-Fireplace2 Three-shot, text-only, bfloat16, 2024-08-10 47.8%
  697. 697 maritaca-ai/sabia-7b Three-shot, text-only, float16, 2024-02-05 47.7%
  698. 698 internlm/internlm2-base-7b Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 47.7%
  699. 699 Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
  700. 700 deepseek-ai/DeepSeek-V2-Lite-Chat Three-shot, text-only, bfloat16, 2024-05-17 47.7%
  701. 701 meta-llama/Llama-2-70b-chat-hf Three-shot, text-only, float16, 2024-02-18 47.6%
  702. 702 Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged Three-shot, text-only, float16, 2024-04-09 47.6%
  703. 703 kaitchup/Qwen1.5-7B-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 47.6%
  704. 704 alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt Three-shot, text-only, bfloat16, 2024-04-28 47.6%
  705. 705 HuggingFaceH4/zephyr-7b-gemma-v0.1 Three-shot, text-only, bfloat16, 2024-03-02 47.4%
  706. 706 Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO Three-shot, text-only, float16, 2024-04-09 47.4%
  707. 707 Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
  708. 708 recogna-nlp/mistralbode_7b_qlora_ultraalpaca Three-shot, text-only, float16, 2024-04-23 47.1%
  709. 709 heloisy/zephyr-7b-cosmosqa-ptbr_text Three-shot, text-only, bfloat16, 2024-05-27 47.1%
  710. 710 nicolasdec/Cabramistral7b Three-shot, text-only, float16, 2024-03-18 47%
  711. 711 chargoddard/internlm2-base-7b-llama Three-shot, text-only, rev: refs/pr/2, bfloat16, 2024-04-25 47%
  712. 712 tiiuae/falcon-11B Three-shot, text-only, bfloat16, 2024-05-13 47%
  713. 713 aws-prototyping/MegaBeam-Mistral-7B-512k Three-shot, text-only, bfloat16, 2024-10-07 47%
  714. 714 OpenLLM-France/Claire-Mistral-7B-0.1 Three-shot, text-only, bfloat16, 2024-02-05 46.9%
  715. 715 nicolasdec/CabraMistral7b Three-shot, text-only, bfloat16, 2024-04-18 46.9%
  716. 716 maywell/Synatra-7B-v0.3-RP Three-shot, text-only, float16, 2024-05-13 46.9%
  717. 717 matheusrdgsf/cesar-ptbr Three-shot, text-only, GPTQ, 2024-05-27 46.9%
  718. 718 TheBloke/zephyr-7B-beta-GPTQ Three-shot, text-only, GPTQ, 2024-05-27 46.9%
  719. 719 01-ai/Yi-6B-200K Three-shot, text-only, bfloat16, 2024-02-05 46.7%
  720. 720 Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
  721. 721 Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
  722. 722 Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
  723. 723 Qwen/Qwen-7B-Chat Three-shot, text-only, float16, 2024-04-18 46.2%
  724. 724 allenai/tulu-2-13b Three-shot, text-only, bfloat16, 2024-05-22 46.2%
  725. 725 Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
  726. 726 rhaymison/Mistral-portuguese-luana-7b-Mathematics Three-shot, text-only, bfloat16, 2024-04-18 46%
  727. 727 hkust-nlp/deita-7b-v1.0 Three-shot, text-only, bfloat16, 2024-04-25 45.9%
  728. 728 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3 Three-shot, text-only, bfloat16, 2024-05-27 45.8%
  729. 729 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3 Three-shot, text-only, float16, 2024-05-28 45.8%
  730. 730 Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
  731. 731 Weni/ZeroShot-Multilanguage-Zephyr-7B Three-shot, text-only, float16, 2024-04-09 45.6%
  732. 732 meta-llama/Llama-2-13b-chat-hf Three-shot, text-only, bfloat16, 2024-04-19 45.6%
  733. 733 rhaymison/portuguese-tom-cat-13b Three-shot, text-only, bfloat16, 2024-05-20 45.6%
  734. 734 rfanucchi/Llama3-pt_br_cabrita Three-shot, text-only, bfloat16, 2024-05-21 45.6%
  735. 735 botbot-ai/CabraMistral-v3-7b-32k Three-shot, text-only, bfloat16, 2024-06-10 45.6%
  736. 736 DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
  737. 737 Motif-Technologies/Motif-2.6B Three-shot, text-only, bfloat16, 2025-08-30 45.6%
  738. 738 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2 Three-shot, text-only, bfloat16, 2024-05-27 45.5%
  739. 739 nvidia/Llama-3.1-Nemotron-Nano-8B-v1 Three-shot, text-only, bfloat16, 2025-08-30 45.5%
  740. 740 Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
  741. 741 princeton-nlp/Mistral-7B-Base-SFT-DPO Three-shot, text-only, rev: 17134fd, bfloat16, 2024-10-07 45.1%
  742. 742 recogna-nlp/zephyr_7b_beta_ultraalpaca Three-shot, text-only, float16, 2024-04-23 44.9%
  743. 743 meta-llama/Llama-2-13b-hf Three-shot, text-only, float16, 2024-02-05 44.5%
  744. 744 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft Three-shot, text-only, bfloat16, 2024-04-22 44.4%
  745. 745 lmsys/vicuna-13b-v1.5 Three-shot, text-only, float16, 2024-02-27 44.2%
  746. 746 allenai/tulu-2-7b Three-shot, text-only, bfloat16, 2024-05-22 44.2%
  747. 747 Motif-Technologies/Motif-2.6b-v1.1-LC Three-shot, text-only, bfloat16, 2025-08-30 44.2%
  748. 748 allenai/tulu-2-dpo-7b Three-shot, text-only, bfloat16, 2024-03-05 44.1%
  749. 749 SakanaAI/DiscoPOP-zephyr-7b-gemma Three-shot, text-only, bfloat16, 2024-06-17 44.1%
  750. 750 AIDC-AI/Marco-LLM-ES Three-shot, text-only, bfloat16, 2025-02-27 44.1%
  751. 751 BAAI/Aquila2-34B Three-shot, text-only, bfloat16, 2024-02-05 43.8%
  752. 752 OliveiraJLT/Sagui-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-07-18 43.7%
  753. 753 THUDM/chatglm3-6b-32k Three-shot, text-only, float16, 2024-04-05 43.5%
  754. 754 Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
  755. 755 GuiCas/Phituguese_FP16 Three-shot, text-only, float16, 2024-06-04 43.3%
  756. 756 abacusai/Liberated-Qwen1.5-14B Three-shot, text-only, float16, 2024-06-12 43.1%
  757. 757 google/medgemma-4b-pt Three-shot, text-only, bfloat16, 2025-07-15 42.8%
  758. 758 xverse/XVERSE-13B Three-shot, text-only, bfloat16, 2024-02-05 42.7%
  759. 759 rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct Three-shot, text-only, float16, 2024-05-23 42.6%
  760. 760 01-ai/Yi-Coder-9B-Chat Three-shot, text-only, bfloat16, 2024-09-21 42.6%
  761. 761 LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
  762. 762 kurakurai/Luth-0.6B-Instruct Three-shot, text-only, bfloat16, 2025-08-30 42.3%
  763. 763 Deci/DeciLM-7B Three-shot, text-only, bfloat16, 2024-02-05 42%
  764. 764 J-LAB/Brisa_v0.2_sft Three-shot, text-only, float16, 2024-10-26 41.9%
  765. 765 google/gemma-2-2b Three-shot, text-only, bfloat16, 2024-08-09 41.7%
  766. 766 dfurman/Llama-3-8B-Orpo-v0.1 Three-shot, text-only, float16, 2024-08-22 41.7%
  767. 767 kurakurai/Luth-LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 41.7%
  768. 768 Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
  769. 769 LiquidAI/LFM2-700M Three-shot, text-only, bfloat16, 2025-08-30 41.6%
  770. 770 Qwen/Qwen1.5-MoE-A2.7B Three-shot, text-only, bfloat16, 2024-04-12 41.5%
  771. 771 lmsys/vicuna-7b-v1.5 Three-shot, text-only, float16, 2024-02-27 41.3%
  772. 772 rfanucchi/Llama3-pt_br_cabrit_orca_qkvo Three-shot, text-only, bfloat16, 2024-06-04 41.3%
  773. 773 princeton-nlp/Mistral-7B-Base-SFT-RRHF Three-shot, text-only, rev: 0d58610, bfloat16, 2024-10-07 41.3%
  774. 774 tiiuae/Falcon3-3B-Base Three-shot, text-only, bfloat16, 2025-01-29 41.2%
  775. 775 nicolasdec/cabra13b Three-shot, text-only, float16, 2024-02-05 40.9%
  776. 776 recogna-nlp/phibode-3-mini-4k-ultraalpaca Three-shot, text-only, float16, 2024-05-05 40.8%
  777. 777 TIGER-Lab/Qwen2.5-Math-7B-CFT Three-shot, text-only, bfloat16, 2025-03-07 40.8%
  778. 778 Xwin-LM/Xwin-LM-7B-V0.1 Three-shot, text-only, float16, 2024-05-22 40.6%
  779. 779 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full Three-shot, text-only, bfloat16, 2024-06-06 40.6%
  780. 780 X-D-Lab/XrayQwen Three-shot, text-only, rev: 3f477a4, float16, 2024-09-18 40.5%
  781. 781 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct Three-shot, text-only, bfloat16, 2024-08-09 40.3%
  782. 782 baichuan-inc/Baichuan2-7B-Base Three-shot, text-only, bfloat16, 2024-02-05 40.1%
  783. 783 kurakurai/Luth-LFM2-700M Three-shot, text-only, bfloat16, 2025-08-30 40.1%
  784. 784 recogna-nlp/mistral-bode Three-shot, text-only, float16, 2024-04-04 39.8%
  785. 785 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2 Three-shot, text-only, bfloat16, 2024-04-22 39.8%
  786. 786 01-ai/Yi-Coder-9B Three-shot, text-only, bfloat16, 2024-09-21 39.5%
  787. 787 h2oai/h2o-danube3.1-4b-chat Three-shot, text-only, bfloat16, 2024-12-05 39.1%
  788. 788 migtissera/Tess-3-Mistral-Nemo-12B Three-shot, text-only, bfloat16, 2024-08-30 38.9%
  789. 789 xverse/XVERSE-65B-2 Three-shot, text-only, bfloat16, 2024-02-05 38.8%
  790. 790 MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
  791. 791 AdaptLLM/finance-LLM-13B Three-shot, text-only, float16, 2024-02-11 38.5%
  792. 792 deepseek-ai/deepseek-llm-7b-base Three-shot, text-only, bfloat16, 2024-02-05 38.4%
  793. 793 recogna-nlp/bode-13b-alpaca-pt-br Three-shot, text-only, float16, 2024-02-05 38.3%
  794. 794 h2oai/h2o-danube3-4b-chat Three-shot, text-only, bfloat16, 2024-07-22 38.3%
  795. 795 J-LAB/FluxiIA-Small_Brisa Three-shot, text-only, float16, 2024-11-16 38.3%
  796. 796 AdaptLLM/law-LLM-13B Three-shot, text-only, float16, 2024-02-11 38%
  797. 797 deepseek-ai/deepseek-moe-16b-chat Three-shot, text-only, bfloat16, 2024-04-13 38%
  798. 798 xverse/XVERSE-65B Three-shot, text-only, bfloat16, 2024-02-05 37.8%
  799. 799 ghost-x/ghost-8b-beta Three-shot, text-only, bfloat16, 2024-07-23 37.7%
  800. 800 gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
  801. 801 Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
  802. 802 AdaptLLM/medicine-LLM-13B Three-shot, text-only, float16, 2024-02-11 37.5%
  803. 803 Xwin-LM/Xwin-LM-7B-V0.2 Three-shot, text-only, float16, 2024-05-22 37.4%
  804. 804 haoranxu/ALMA-13B-Pretrain Three-shot, text-only, bfloat16, 2024-05-15 37.3%
  805. 805 rfanucchi/Llama3-pt_br_orca Three-shot, text-only, bfloat16, 2024-05-16 37%
  806. 806 xverse/XVERSE-7B Three-shot, text-only, bfloat16, 2024-02-05 36.9%
  807. 807 THUDM/agentlm-7b Three-shot, text-only, float16, 2024-04-05 36.7%
  808. 808 Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized Three-shot, text-only, float16, 2024-04-09 36.6%
  809. 809 recogna-nlp/gembode-7b-it Three-shot, text-only, float16, 2024-04-23 36.6%
  810. 810 h2oai/h2o-danube3-4b-base Three-shot, text-only, bfloat16, 2024-07-22 36.4%
  811. 811 tanliboy/lambda-qwen2.5-32b-dpo-test Three-shot, text-only, bfloat16, 2024-09-30 36.4%
  812. 812 NousResearch/Nous-Hermes-13b Three-shot, text-only, bfloat16, 2024-02-27 36.3%
  813. 813 Qwen/Qwen1.5-4B Three-shot, text-only, bfloat16, 2024-02-17 36.2%
  814. 814 eduagarcia/gemma-7b-it_no_chat_template Three-shot, text-only, bfloat16, 2024-02-23 36%
  815. 815 stabilityai/stablelm-zephyr-3b Three-shot, text-only, bfloat16, 2024-02-27 36%
  816. 816 Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
  817. 817 ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
  818. 818 THUDM/chatglm3-6b-128k Three-shot, text-only, float16, 2024-04-05 35.5%
  819. 819 Qwen/Qwen2.5-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 35.5%
  820. 820 cnmoro/Qwen2.5-0.5B-Portuguese-v1 Three-shot, text-only, float16, 2025-02-25 34.6%
  821. 821 Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
  822. 822 THUDM/LongAlign-7B-64k Three-shot, text-only, float16, 2024-04-05 33.7%
  823. 823 internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
  824. 824 nicolasdec/Cabra Three-shot, text-only, float16, 2024-02-05 33.4%
  825. 825 stabilityai/stablelm-2-1_6b-chat Three-shot, text-only, float16, 2024-04-09 33.2%
  826. 826 cognitivecomputations/dolphin-2.9.3-llama-3-8b Three-shot, text-only, bfloat16, 2024-07-02 33.2%
  827. 827 Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
  828. 828 LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
  829. 829 rhaymison/Llama-portuguese-13b-Luana-v0.2 Three-shot, text-only, bfloat16, 2024-04-08 32.7%
  830. 830 cognitivecomputations/dolphin-2.9.1-mixtral-1x22b Three-shot, text-only, bfloat16, 2024-05-24 32.7%
  831. 831 BAAI/OPI-Llama-3.1-8B-Instruct Three-shot, text-only, bfloat16, 2024-09-21 32.7%
  832. 832 stabilityai/stablelm-2-zephyr-1_6b Three-shot, text-only, float16, 2024-02-27 32.4%
  833. 833 internlm/internlm2-chat-1_8b Three-shot, text-only, bfloat16, 2024-04-18 32.3%
  834. 834 internlm/internlm2_5-1_8b Three-shot, text-only, bfloat16, 2024-08-09 32.3%
  835. 835 internlm/internlm2-chat-1_8b-sft Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 32.1%
  836. 836 internlm/internlm2-1_8b Three-shot, text-only, bfloat16, 2024-04-21 31.7%
  837. 837 cognitivecomputations/WizardLM-13B-Uncensored Three-shot, text-only, float16, 2024-05-22 31.7%
  838. 838 AdaptLLM/law-LLM Three-shot, text-only, float16, 2024-02-11 31.6%
  839. 839 internlm/internlm2_5-1_8b-chat Three-shot, text-only, bfloat16, 2024-08-09 31.6%
  840. 840 Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
  841. 841 haoranxu/ALMA-13B-R Three-shot, text-only, bfloat16, 2024-05-16 31.4%
  842. 842 google/recurrentgemma-2b-it Three-shot, text-only, bfloat16, 2024-05-17 31.4%
  843. 843 Oburaco/llama2-qlora-finetunined-ptbr Three-shot, text-only, bfloat16, 2024-05-27 31.4%
  844. 844 TinyPixel/Llama-2-7B-bf16-sharded Three-shot, text-only, bfloat16, 2024-05-27 31.4%
  845. 845 rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora Three-shot, text-only, 4bit, 2024-09-27 31.4%
  846. 846 unsloth/Llama-3.2-1B-Instruct Three-shot, text-only, float16, 2024-11-24 31.4%
  847. 847 cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning Three-shot, text-only, float16, 2025-03-08 31.4%
  848. 848 meta-llama/Llama-2-7b-hf Three-shot, text-only, float16, 2024-02-05 31.3%
  849. 849 AdaptLLM/medicine-LLM Three-shot, text-only, float16, 2024-02-11 31.3%
  850. 850 kurakurai/Luth-LFM2-350M Three-shot, text-only, bfloat16, 2025-08-30 31%
  851. 851 recogna-nlp/internlm2-chat-1_8b-ultracabrita Three-shot, text-only, float16, 2024-05-05 30.7%
  852. 852 Unbabel/TowerBase-7B-v0.1 Three-shot, text-only, bfloat16, 2024-02-05 30.6%
  853. 853 tensoropera/Fox-1-1.6B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-07-23 30.6%
  854. 854 meta-llama/Llama-3.2-1B-Instruct Three-shot, text-only, bfloat16, 2024-12-03 30.6%
  855. 855 deepseek-ai/deepseek-moe-16b-base Three-shot, text-only, bfloat16, 2024-02-05 30.3%
  856. 856 google/gemma-7b-it Three-shot, text-only, rev: float16, float16, 2024-02-23 30.3%
  857. 857 MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
  858. 858 tiiuae/Falcon-H1-0.5B-Instruct Three-shot, text-only, bfloat16, 2025-07-08 30.3%
  859. 859 GeneZC/MiniMA-2-3B Three-shot, text-only, float16, 2024-07-23 30.2%
  860. 860 chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
  861. 861 stabilityai/stablelm-3b-4e1t Three-shot, text-only, bfloat16, 2024-02-05 29.9%
  862. 862 dominguesm/canarim-7b Three-shot, text-only, float16, 2024-02-05 29.8%
  863. 863 stabilityai/stablelm-base-alpha-7b-v2 Three-shot, text-only, float16, 2024-02-05 29.8%
  864. 864 Qwen/Qwen1.5-1.8B-Chat Three-shot, text-only, bfloat16, 2024-02-22 29.8%
  865. 865 NTQAI/Nxcode-CQ-7B-orpo Three-shot, text-only, bfloat16, 2024-08-10 29.6%
  866. 866 deepseek-ai/DeepSeek-R1-Distill-Llama-8B Three-shot, text-only, bfloat16, 2025-01-29 29.6%
  867. 867 LiquidAI/LFM2-350M Three-shot, text-only, bfloat16, 2025-08-30 29.5%
  868. 868 lrds-code/boana-7b-instruct Three-shot, text-only, bfloat16, 2024-02-05 29.2%
  869. 869 DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
  870. 870 AdaptLLM/finance-LLM Three-shot, text-only, float16, 2024-02-11 29.1%
  871. 871 semantixai/LloroV2 Three-shot, text-only, bfloat16, 2024-03-13 29.1%
  872. 872 meta-llama/Llama-2-7b-chat-hf Three-shot, text-only, bfloat16, 2024-04-19 29.1%
  873. 873 rhaymison/gemma-portuguese-tom-cat-2b-it Three-shot, text-only, float16, 2024-04-29 29.1%
  874. 874 recogna-nlp/bode-7b-alpaca-pt-br Three-shot, text-only, float16, 2024-02-05 28.9%
  875. 875 langtech-languagemodeling/IberianLLM-7B-Instruct Three-shot, text-only, bfloat16, 2025-07-14 28.9%
  876. 876 Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT Three-shot, text-only, float16, 2024-04-09 28.8%
  877. 877 Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT Three-shot, text-only, float16, 2024-04-09 28.8%
  878. 878 GeneZC/MiniLoong-3B Three-shot, text-only, float16, 2024-07-23 28.8%
  879. 879 Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
  880. 880 h2oai/h2o-danube2-1.8b-base Three-shot, text-only, bfloat16, 2024-04-09 28.4%
  881. 881 nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 Three-shot, text-only, bfloat16, 2025-08-30 28.4%
  882. 882 baichuan-inc/Baichuan2-13B-Base Three-shot, text-only, bfloat16, 2024-02-05 28.2%
  883. 883 AI-Sweden-Models/gpt-sw3-40b Three-shot, text-only, float16, 2024-02-05 28.1%
  884. 884 mosaicml/mpt-7b-8k Three-shot, text-only, bfloat16, 2024-02-05 28.1%
  885. 885 h2oai/h2o-danube2-1.8b-chat Three-shot, text-only, bfloat16, 2024-04-09 28.1%
  886. 886 BAAI/Aquila-7B Three-shot, text-only, float16, 2024-02-05 28%
  887. 887 pfnet/plamo-13b Three-shot, text-only, bfloat16, 2024-04-18 27.7%
  888. 888 unsloth/gemma-2b-bnb-4bit Three-shot, text-only, 4bit, 2024-04-25 27.4%
  889. 889 cognitivecomputations/dolphin-2.9.4-llama3.1-8b Three-shot, text-only, bfloat16, 2024-08-25 27.4%
  890. 890 BSC-LT/salamandra-7b Three-shot, text-only, bfloat16, 2025-04-04 27.1%
  891. 891 baidu/ERNIE-4.5-0.3B-Base-PT Three-shot, text-only, bfloat16, 2025-08-31 27.1%
  892. 892 Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
  893. 893 nbeerbower/gemma2-gutenberg-27B Three-shot, text-only, bfloat16, 2024-09-15 26.8%
  894. 894 TucanoBR/Tucano-630m Three-shot, text-only, float16, 2024-12-03 26.8%
  895. 895 cnmoro/Qwen2.5-0.5B-Portuguese-v2 Three-shot, text-only, float16, 2025-03-08 26.8%
  896. 896 DAMO-NLP-MT/polylm-1.7b Three-shot, text-only, float16, 2024-02-11 26.6%
  897. 897 Oburaco/ptbr-falcon-7b Three-shot, text-only, bfloat16, 2024-05-27 26.6%
  898. 898 Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
  899. 899 Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
  900. 900 dominguesm/Canarim-7B-Instruct Three-shot, text-only, float16, 2024-02-23 26.1%
  901. 901 google/recurrentgemma-2b Three-shot, text-only, float16, 2024-05-17 26.1%
  902. 902 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora Three-shot, text-only, float16, 2024-04-23 26%
  903. 903 tiiuae/Falcon3-1B-Base Three-shot, text-only, bfloat16, 2025-01-29 26%
  904. 904 BSC-LT/salamandra-2b Three-shot, text-only, bfloat16, 2025-04-04 26%
  905. 905 OpenLLM-France/Claire-7B-0.1 Three-shot, text-only, bfloat16, 2024-02-05 25.9%
  906. 906 google/gemma-2b-it Three-shot, text-only, bfloat16, 2024-02-21 25.9%
  907. 907 recogna-nlp/gembode-2b-ultraalpaca Three-shot, text-only, float16, 2024-04-09 25.9%
  908. 908 AI-Sweden-Models/gpt-sw3-6.7b Three-shot, text-only, float16, 2024-02-05 25.7%
  909. 909 nicholasKluge/TeenyTinyLlama-460m Three-shot, text-only, bfloat16, 2024-02-22 25.7%
  910. 910 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca Three-shot, text-only, float16, 2024-04-22 25.7%
  911. 911 OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
  912. 912 stabilityai/stablelm-2-1_6b Three-shot, text-only, float16, 2024-04-18 25.6%
  913. 913 TucanoBR/Tucano-1b1 Three-shot, text-only, float16, 2024-12-03 25.6%
  914. 914 gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
  915. 915 nicholasKluge/TeenyTinyLlama-460m-Chat Three-shot, text-only, bfloat16, 2024-02-22 25.4%
  916. 916 Qwen/Qwen1.5-0.5B-Chat Three-shot, text-only, bfloat16, 2024-02-22 25.4%
  917. 917 allenai/OLMo-2-0425-1B Three-shot, text-only, bfloat16, 2025-05-01 25.4%
  918. 918 cerebras/btlm-3b-8k-base Three-shot, text-only, bfloat16, 2024-02-11 25.3%
  919. 919 recogna-nlp/GemBode-2b-it Three-shot, text-only, float16, 2024-03-14 25.3%
  920. 920 recogna-nlp/Phi-Bode Three-shot, text-only, float16, 2024-03-14 25.3%
  921. 921 SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
  922. 922 GeneZC/MiniMA-3B Three-shot, text-only, bfloat16, 2024-07-23 25.3%
  923. 923 TheDrummer/Big-Tiger-Gemma-27B-v1 Three-shot, text-only, rev: 892ca94, bfloat16, 2024-09-29 25.3%
  924. 924 croissantllm/CroissantLLMBase Three-shot, text-only, float16, 2024-02-17 25.2%
  925. 925 Qwen/Qwen1.5-1.8B Three-shot, text-only, bfloat16, 2024-02-17 25.2%
  926. 926 recogna-nlp/phi-bode-2-ultraalpaca Three-shot, text-only, float16, 2024-04-09 25.2%
  927. 927 MulaBR/Mula-4x160-v0.1 Three-shot, text-only, float16, 2024-04-21 25.2%
  928. 928 anthracite-org/magnum-v4-9b Three-shot, text-only, bfloat16, 2024-10-24 25.2%
  929. 929 TucanoBR/Tucano-160m Three-shot, text-only, float16, 2024-12-03 25.2%
  930. 930 RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
  931. 931 openlm-research/open_llama_7b_v2 Three-shot, text-only, float16, 2024-02-11 25%
  932. 932 TucanoBR/Tucano-2b4 Three-shot, text-only, float16, 2024-12-03 25%
  933. 933 microsoft/phi-1 Three-shot, text-only, float16, 2024-02-05 24.9%
  934. 934 Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
  935. 935 rhaymison/gemma-portuguese-luana-2b Three-shot, text-only, bfloat16, 2024-04-18 24.9%
  936. 936 h2oai/h2o-danube2-1.8b-sft Three-shot, text-only, bfloat16, 2024-05-21 24.9%
  937. 937 OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
  938. 938 openlm-research/open_llama_13b Three-shot, text-only, float16, 2024-02-11 24.8%
  939. 939 TheBloke/wizardLM-7B-HF Three-shot, text-only, float16, 2024-05-22 24.8%
  940. 940 togethercomputer/RedPajama-INCITE-Base-3B-v1 Three-shot, text-only, float16, 2024-02-05 24.6%
  941. 941 haoranxu/ALMA-7B-R Three-shot, text-only, bfloat16, 2024-07-29 24.6%
  942. 942 Bruno/Caramelo_7B Three-shot, text-only, bfloat16, 2024-02-24 24.5%
  943. 943 Weni/WeniGPT-Mistral-7B-instructBase-4bit Three-shot, text-only, float16, 2024-04-09 24.5%
  944. 944 tensoropera/Fox-1-1.6B Three-shot, text-only, bfloat16, 2024-07-23 24.5%
  945. 945 Ramikan-BR/Qwen2-0.5B-v5 Three-shot, text-only, rev: ce92f05, float16, 2024-07-22 24.3%
  946. 946 tiiuae/Falcon-H1-0.5B-Base Three-shot, text-only, bfloat16, 2025-07-08 24.3%
  947. 947 Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
  948. 948 facebook/galactica-30b Three-shot, text-only, float16, 2024-02-11 24.2%
  949. 949 recogna-nlp/gembode-2b-base-ultraalpaca Three-shot, text-only, float16, 2024-04-22 24.2%
  950. 950 yahma/llama-7b-hf Three-shot, text-only, float16, 2024-05-27 24.2%
  951. 951 fernandosola/bluearara-7B-instruct Three-shot, text-only, bfloat16, 2024-03-08 24.1%
  952. 952 Ramikan-BR/Qwen2-0.5B-v9 Three-shot, text-only, rev: 51d076f, float16, 2024-07-22 24.1%
  953. 953 TinyLlama/TinyLlama_v1.1 Three-shot, text-only, float16, 2024-07-25 24.1%
  954. 954 Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
  955. 955 LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
  956. 956 matsuo-lab/weblab-10b Three-shot, text-only, float16, 2024-02-05 23.9%
  957. 957 Oburaco/ptbr-falcon-7b-v3 Three-shot, text-only, bfloat16, 2024-05-27 23.9%
  958. 958 vilsonrodrigues/falcon-7b-instruct-sharded Three-shot, text-only, bfloat16, 2024-05-27 23.9%
  959. 959 GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
  960. 960 bigscience/bloom-7b1 Three-shot, text-only, float16, 2024-02-05 23.6%
  961. 961 EleutherAI/pythia-410m Three-shot, text-only, float16, 2024-02-11 23.6%
  962. 962 allenai/OLMo-7B-Twin-2T Three-shot, text-only, float16, 2024-02-17 23.6%
  963. 963 Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
  964. 964 AI-Sweden-Models/gpt-sw3-6.7b-v2 Three-shot, text-only, float16, 2024-02-05 23.5%
  965. 965 Weni/WeniGPT-Mistral-7B-instructBase Three-shot, text-only, float16, 2024-04-09 23.5%
  966. 966 M4-ai/tau-1.8B Three-shot, text-only, bfloat16, 2024-04-21 23.5%
  967. 967 cognitivecomputations/WizardLM-7B-Uncensored Three-shot, text-only, float16, 2024-05-22 23.5%
  968. 968 RogerioPiazzon/alpaca-lora-ptbr-7b Three-shot, text-only, float16, 2024-05-27 23.5%
  969. 969 projecte-aina/FLOR-760M Three-shot, text-only, float16, 2024-02-05 23.4%
  970. 970 facebook/xglm-4.5B Three-shot, text-only, float16, 2024-02-11 23.4%
  971. 971 Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
  972. 972 NucleusAI/nucleus-22B-token-500B Three-shot, text-only, float16, 2024-02-05 23.2%
  973. 973 ericzzz/falcon-rw-1b-instruct-openorca Three-shot, text-only, bfloat16, 2024-04-21 23.2%
  974. 974 lucianosb/boto-27B Three-shot, text-only, bfloat16, 2024-07-12 23.2%
  975. 975 22h/cabrita_7b_pt_850000 Three-shot, text-only, float16, 2024-02-11 23.1%
  976. 976 nicholasKluge/TeenyTinyLlama-160m Three-shot, text-only, bfloat16, 2024-02-22 23.1%
  977. 977 openlm-research/open_llama_3b_v2 Three-shot, text-only, float16, 2024-02-11 22.9%
  978. 978 fernandosola/bluearara-7B Three-shot, text-only, bfloat16, 2024-02-17 22.9%
  979. 979 Oburaco/juridic-falcon-7b Three-shot, text-only, bfloat16, 2024-05-27 22.9%
  980. 980 GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
  981. 981 TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T Three-shot, text-only, float16, 2024-02-05 22.8%
  982. 982 TechxGenus/Jamba-v0.1-9B Three-shot, text-only, bfloat16, 2024-05-29 22.8%
  983. 983 SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
  984. 984 TucanoBR/Tucano-2b4-Instruct Three-shot, text-only, float16, 2024-12-03 22.8%
  985. 985 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview Three-shot, text-only, bfloat16, 2025-08-30 22.8%
  986. 986 MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
  987. 987 stabilityai/stablelm-base-alpha-3b-v2 Three-shot, text-only, float16, 2024-02-05 22.7%
  988. 988 cerebras/Cerebras-GPT-590M Three-shot, text-only, float16, 2024-02-11 22.7%
  989. 989 EleutherAI/pythia-12b Three-shot, text-only, float16, 2024-02-11 22.7%
  990. 990 h2oai/h2o-danube-1.8b-base Three-shot, text-only, bfloat16, 2024-04-09 22.7%
  991. 991 AI-Sweden-Models/gpt-sw3-20b Three-shot, text-only, float16, 2024-02-05 22.5%
  992. 992 EleutherAI/pythia-2.8b-deduped Three-shot, text-only, float16, 2024-02-05 22.5%
  993. 993 unicamp-dl/ptt5-base-portuguese-vocab Three-shot, text-only, float16, 2024-02-11 22.5%
  994. 994 unicamp-dl/ptt5-small-portuguese-vocab Three-shot, text-only, float16, 2024-02-11 22.5%
  995. 995 state-spaces/mamba-790m-hf Three-shot, text-only, float16, 2024-04-07 22.5%
  996. 996 Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
  997. 997 baidu/ERNIE-4.5-0.3B-PT Three-shot, text-only, bfloat16, 2025-08-31 22.5%
  998. 998 EleutherAI/pythia-2.8b Three-shot, text-only, float16, 2024-02-11 22.4%
  999. 999 nicolasdec/CabraMistral7b-0.4 Three-shot, text-only, float16, 2024-02-22 22.4%
  1000. 1000 proxectonos/FLOR-1.3B-GL Three-shot, text-only, float16, 2024-04-25 22.4%
  1001. 1001 utter-project/EuroLLM-1.7B Three-shot, text-only, bfloat16, 2025-08-30 22.4%
  1002. 1002 openlm-research/open_llama_3b Three-shot, text-only, float16, 2024-02-11 22.3%
  1003. 1003 Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
  1004. 1004 EleutherAI/pythia-6.9b-deduped Three-shot, text-only, float16, 2024-02-05 22.1%
  1005. 1005 cerebras/Cerebras-GPT-6.7B Three-shot, text-only, float16, 2024-02-11 22.1%
  1006. 1006 Bruno/Caramelinho Three-shot, text-only, bfloat16, 2024-02-24 22.1%
  1007. 1007 GeneZC/MiniMA-2-1B Three-shot, text-only, float16, 2024-07-23 22.1%
  1008. 1008 Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
  1009. 1009 open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
  1010. 1010 Ramikan-BR/TiamaPY-v31 Three-shot, text-only, rev: d4612a5, float16, 2024-06-20 22%
  1011. 1011 facebook/opt-30b Three-shot, text-only, float16, 2024-02-05 21.8%
  1012. 1012 Ramikan-BR/TiamaPY-v30 Three-shot, text-only, rev: 300C415, float16, 2024-06-19 21.8%
  1013. 1013 fernandosola/bluearara-7B-instruct-v02 Three-shot, text-only, bfloat16, 2024-12-30 21.8%
  1014. 1014 GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
  1015. 1015 LiteAI/Hare-1.1B-base Three-shot, text-only, float16, 2024-07-23 21.7%
  1016. 1016 projecte-aina/FLOR-6.3B Three-shot, text-only, float16, 2024-02-05 21.6%
  1017. 1017 facebook/galactica-6.7b Three-shot, text-only, float16, 2024-02-11 21.6%
  1018. 1018 TinyLlama/TinyLlama-1.1B-Chat-v1.0 Three-shot, text-only, bfloat16, 2024-02-22 21.6%
  1019. 1019 recogna-nlp/gembode-2b-ultraalpaca-qlora Three-shot, text-only, float16, 2024-04-23 21.6%
  1020. 1020 utter-project/EuroLLM-1.7B-Instruct Three-shot, text-only, float16, 2025-02-21 21.6%
  1021. 1021 bigscience/bloom-1b7 Three-shot, text-only, float16, 2024-02-05 21.4%
  1022. 1022 openai-community/gpt2-xl Three-shot, text-only, float16, 2024-02-05 21.4%
  1023. 1023 pierreguillou/gpt2-small-portuguese Three-shot, text-only, float16, 2024-02-05 21.4%
  1024. 1024 openai-community/gpt2-large Three-shot, text-only, float16, 2024-02-05 21.3%
  1025. 1025 facebook/galactica-1.3b Three-shot, text-only, float16, 2024-02-11 21.3%
  1026. 1026 JosephusCheung/LL7M Three-shot, text-only, float16, 2024-04-21 21.3%
  1027. 1027 M4-ai/tau-0.5B-instruct-DPOP Three-shot, text-only, float16, 2024-04-21 21.3%
  1028. 1028 MulaBR/Mula-8x160-v0.1 Three-shot, text-only, float16, 2024-05-08 21.3%
  1029. 1029 h2oai/h2o-danube-1.8b-sft Three-shot, text-only, bfloat16, 2024-05-21 21.3%
  1030. 1030 rhaymison/portuguese-phi1_5-tom-cat Three-shot, text-only, bfloat16, 2024-05-21 21.3%
  1031. 1031 22h/open-cabrita3b Three-shot, text-only, float16, 2024-02-11 21.1%
  1032. 1032 wandgibaut/periquito-3B Three-shot, text-only, float16, 2024-02-11 21.1%
  1033. 1033 allenai/OLMo-7B Three-shot, text-only, float16, 2024-02-17 21%
  1034. 1034 PORTULAN/gervasio-7b-portuguese-ptbr-decoder Three-shot, text-only, bfloat16, 2024-03-07 21%
  1035. 1035 facebook/opt-2.7b Three-shot, text-only, float16, 2024-02-05 20.9%
  1036. 1036 EleutherAI/pythia-70m Three-shot, text-only, float16, 2024-02-11 20.9%
  1037. 1037 dynamofl/dynamo-8B-v0.1 Three-shot, text-only, bfloat16, 2024-02-05 20.7%
  1038. 1038 HuggingFaceTB/cosmo-1b Three-shot, text-only, float16, 2024-02-24 20.7%
  1039. 1039 pedrogengo/gemma-ptbr Three-shot, text-only, float16, 2024-03-28 20.7%
  1040. 1040 recogna-nlp/phibode_1_5_ultraalpaca Three-shot, text-only, float16, 2024-05-12 20.7%
  1041. 1041 BAAI/Emu3-Stage1 Three-shot, text-only, bfloat16, 2024-10-21 20.7%
  1042. 1042 bigscience/bloom-3b Three-shot, text-only, float16, 2024-02-05 20.6%
  1043. 1043 EleutherAI/pythia-1b-deduped Three-shot, text-only, float16, 2024-02-05 20.6%
  1044. 1044 openai-community/gpt2-medium Three-shot, text-only, float16, 2024-02-05 20.6%
  1045. 1045 nisten/Biggie-SmoLlm-0.15B-Base Three-shot, text-only, bfloat16, 2024-08-09 20.6%
  1046. 1046 EleutherAI/pythia-6.9b Three-shot, text-only, float16, 2024-02-11 20.3%
  1047. 1047 state-spaces/mamba-1.4b-hf Three-shot, text-only, float16, 2024-04-07 20.3%
  1048. 1048 state-spaces/mamba-370m-hf Three-shot, text-only, float16, 2024-04-07 20.3%
  1049. 1049 recogna-nlp/gembode-2b-base-ultraalpaca-qlora Three-shot, text-only, float16, 2024-04-23 20.3%
  1050. 1050 baichuan-inc/Baichuan-7B Three-shot, text-only, float16, 2024-02-05 20.2%
  1051. 1051 EleutherAI/pythia-410m-deduped Three-shot, text-only, float16, 2024-02-05 20.2%
  1052. 1052 facebook/xglm-7.5B Three-shot, text-only, float16, 2024-02-11 20.2%
  1053. 1053 nicholasKluge/baseline Three-shot, text-only, float16, 2024-05-06 20.2%
  1054. 1054 LiteAI/Hare-1.1B-Chat Three-shot, text-only, bfloat16, 2024-07-23 20%
  1055. 1055 Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
  1056. 1056 proxectonos/Llama-3.1-Carballo Three-shot, text-only, float16, 2025-04-01 20%
  1057. 1057 facebook/xglm-1.7B Three-shot, text-only, float16, 2024-02-11 19.9%
  1058. 1058 state-spaces/mamba-2.8b-hf Three-shot, text-only, float16, 2024-04-07 19.9%
  1059. 1059 adalbertojunior/Mistral-7b-Portuguese-V0.1 Three-shot, text-only, bfloat16, 2024-04-25 19.9%
  1060. 1060 Delta-Vector/Odin-9B Three-shot, text-only, bfloat16, 2024-10-29 19.9%
  1061. 1061 facebook/xglm-2.9B Three-shot, text-only, float16, 2024-02-11 19.8%
  1062. 1062 facebook/xglm-564M Three-shot, text-only, float16, 2024-02-11 19.8%
  1063. 1063 cerebras/Cerebras-GPT-2.7B Three-shot, text-only, float16, 2024-02-11 19.6%
  1064. 1064 stabilityai/stablelm-base-alpha-3b Three-shot, text-only, float16, 2024-02-05 19.5%
  1065. 1065 BAAI/Emu3-Gen Three-shot, text-only, bfloat16, 2024-10-21 19.5%
  1066. 1066 gpt2 Three-shot, text-only, float16, 2024-02-05 19.3%
  1067. 1067 h2oai/h2o-danube-1.8b-chat Three-shot, text-only, bfloat16, 2024-04-09 19.3%
  1068. 1068 proxectonos/Cerebras-1.3B-GL Three-shot, text-only, bfloat16, 2024-04-24 19.3%
  1069. 1069 OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
  1070. 1070 EleutherAI/pythia-1b Three-shot, text-only, float16, 2024-02-11 19.2%
  1071. 1071 Nos-PT/Carvalho_pt-gl-1.3B Three-shot, text-only, float16, 2024-06-26 19.2%
  1072. 1072 SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
  1073. 1073 facebook/opt-6.7b Three-shot, text-only, float16, 2024-02-05 19.1%
  1074. 1074 projecte-aina/aguila-7b Three-shot, text-only, float16, 2024-02-05 19.1%
  1075. 1075 EleutherAI/pythia-160m Three-shot, text-only, float16, 2024-02-11 19.1%
  1076. 1076 bigscience/bloom-560m Three-shot, text-only, float16, 2024-02-05 18.9%
  1077. 1077 stabilityai/stablelm-base-alpha-7b Three-shot, text-only, float16, 2024-02-05 18.9%
  1078. 1078 allenai/OLMo-1B Three-shot, text-only, float16, 2024-02-17 18.9%
  1079. 1079 Qwen/Qwen1.5-0.5B Three-shot, text-only, bfloat16, 2024-02-17 18.9%
  1080. 1080 PORTULAN/gervasio-7b-portuguese-ptpt-decoder Three-shot, text-only, bfloat16, 2024-03-07 18.9%
  1081. 1081 M4-ai/tau-0.5B Three-shot, text-only, float16, 2024-04-21 18.9%
  1082. 1082 h2oai/h2o-danube3-500m-base Three-shot, text-only, bfloat16, 2024-07-22 18.9%
  1083. 1083 premai-io/prem-1B-chat Three-shot, text-only, bfloat16, 2024-07-23 18.9%
  1084. 1084 Nos-PT/Llama-Carvalho-PT Three-shot, text-only, float16, 2025-04-01 18.9%
  1085. 1085 Nos-PT/Llama-Carvalho-PT-GL Three-shot, text-only, float16, 2025-04-01 18.9%
  1086. 1086 projecte-aina/FLOR-1.3B Three-shot, text-only, float16, 2024-02-05 18.8%
  1087. 1087 state-spaces/mamba-130m-hf Three-shot, text-only, float16, 2024-04-07 18.8%
  1088. 1088 Ramikan-BR/tinyllama-coder-py-4bit-v10 Three-shot, text-only, rev: da5637d, float16, 2024-05-28 18.6%
  1089. 1089 h2oai/h2o-danube3-500m-chat Three-shot, text-only, bfloat16, 2024-07-22 18.6%
  1090. 1090 EleutherAI/gpt-neo-125m Three-shot, text-only, float16, 2024-02-05 18.5%
  1091. 1091 HuggingFaceTB/SmolLM-1.7B-Instruct Three-shot, text-only, bfloat16, 2024-07-22 18.5%
  1092. 1092 Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
  1093. 1093 EleutherAI/gpt-neo-1.3B Three-shot, text-only, float16, 2024-02-05 18.4%
  1094. 1094 EleutherAI/pythia-70m-deduped Three-shot, text-only, float16, 2024-02-05 18.4%
  1095. 1095 facebook/opt-125m Three-shot, text-only, float16, 2024-02-05 18.4%
  1096. 1096 josu/gpt-neo-pt-1.3B Three-shot, text-only, float16, 2024-02-05 18.4%
  1097. 1097 cerebras/Cerebras-GPT-256M Three-shot, text-only, float16, 2024-02-11 18.4%
  1098. 1098 facebook/opt-350m Three-shot, text-only, float16, 2024-02-05 18.2%
  1099. 1099 cerebras/Cerebras-GPT-111M Three-shot, text-only, float16, 2024-02-11 18.1%
  1100. 1100 EleutherAI/pythia-14m Three-shot, text-only, float16, 2024-02-05 17.9%
  1101. 1101 EleutherAI/pythia-160m-deduped Three-shot, text-only, float16, 2024-02-05 17.9%
  1102. 1102 josu/gpt-neo-pt-br Three-shot, text-only, float16, 2024-02-05 17.7%
  1103. 1103 nicholasKluge/Aira-2-portuguese-124M Three-shot, text-only, float16, 2024-02-05 17.1%
  1104. 1104 HuggingFaceTB/SmolLM-360M-Instruct Three-shot, text-only, bfloat16, 2024-07-22 16.7%
  1105. 1105 artificialguybr/llama3-8b-alpacadata-ptbr Three-shot, text-only, bfloat16, 2024-05-27 16.4%
  1106. 1106 HuggingFaceTB/SmolLM-135M-Instruct Three-shot, text-only, bfloat16, 2024-07-22 16.3%
  1107. 1107 FluxiIA/Tucaninho_dpo Three-shot, text-only, float16, 2025-03-24 15.4%
  1108. 1108 FluxiIA/Tucaninho Three-shot, text-only, float16, 2025-02-27 15.3%
  1109. 1109 facebook/galactica-125m Three-shot, text-only, float16, 2024-02-11 14.9%
  1110. 1110 BAAI/Aquila2-7B Three-shot, text-only, float16, 2024-02-05 14.5%
  1111. 1111 deepseek-ai/DeepSeek-V2-Lite Three-shot, text-only, bfloat16, 2024-05-17 14.5%
  1112. 1112 DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
  1113. 1113 T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
  1114. 1114 T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
  1115. 1115 pucpr/gpt2-bio-pt Three-shot, text-only, float16, 2024-02-05 12.9%
  1116. 1116 internlm/internlm2_5-7b Three-shot, text-only, bfloat16, 2024-07-05 11.3%
  1117. 1117 Ramikan-BR/tinyllama-coder-py-v11 Three-shot, text-only, rev: f1b5e2e, float16, 2024-05-28 10.7%
  1118. 1118 dominguesm/mambarim-110m Three-shot, text-only, float16, 2024-04-15 10.6%
  1119. 1119 Qwen/Qwen3-0.6B-Base Three-shot, text-only, bfloat16, 2025-05-01 10.6%
  1120. 1120 ai-forever/mGPT-13B Three-shot, text-only, float16, 2024-02-11 10.4%
  1121. 1121 google/mt5-base Three-shot, text-only, float16, 2024-04-18 10.3%
  1122. 1122 T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
  1123. 1123 NLPark/AnFeng_v3_Avocet Three-shot, text-only, bfloat16, 2024-05-22 9.60%
  1124. 1124 lrds-code/samba-1.1B Three-shot, text-only, bfloat16, 2024-02-05 8.07%
  1125. 1125 EleutherAI/polyglot-ko-12.8b Three-shot, text-only, float16, 2024-02-05 7.51%
  1126. 1126 Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
  1127. 1127 adalbertojunior/NeuralDaredevil-Dolphin-Portuguese Three-shot, text-only, bfloat16, 2024-06-04 6.12%
  1128. 1128 HeyLucasLeao/gpt-neo-small-portuguese Three-shot, text-only, float16, 2024-02-05 3.89%
  1129. 1129 JJhooww/Mistral_Reload_v4_Functions Three-shot, text-only, float16, 2024-06-15 3.48%
  1130. 1130 NOVA-vision-language/GlorIA-1.3B Three-shot, text-only, float16, 2024-03-07 3.20%
  1131. 1131 Ramikan-BR/tinyllama-coder-py-v12 Three-shot, text-only, rev: abd0469, float16, 2024-05-28 2.78%
  1132. 1132 Qwen/Qwen-1_8B-Chat Three-shot, text-only, bfloat16, 2024-02-22 1.11%
  1133. 1133 ssmits/Falcon2-5.5B-multilingual Three-shot, text-only, bfloat16, 2024-05-27 0.83%
  1134. 1134 ssmits/Falcon2-5.5B-Portuguese Three-shot, text-only, bfloat16, 2024-05-27 0.83%
  1135. 1135 monilouise/opt125M_portuguese Three-shot, text-only, float16, 2024-02-05 0.70%
  1136. 1136 Qwen/Qwen-72B-Chat Three-shot, text-only, bfloat16, 2024-02-24 0.70%
  1137. 1137 MTSAIR/multi_verse_model Three-shot, text-only, bfloat16, 2024-05-25 0.70%
  1138. 1138 internlm/internlm2_5-20b Three-shot, text-only, bfloat16, 2024-08-09 0.70%
  1139. 1139 MaziyarPanahi/Calme-4x7B-MoE-v0.2 Three-shot, text-only, bfloat16, 2024-06-17 0.42%
  1140. 1140 nicholasKluge/Aira-2-portuguese-1B7 Three-shot, text-only, float16, 2024-02-05 0.28%
  1141. 1141 MaziyarPanahi/Calme-4x7B-MoE-v0.1 Three-shot, text-only, bfloat16, 2024-06-16 0.28%
  1142. 1142 eduagarcia/gemma-7b-it_singleturn_chat_template Three-shot, text-only, bfloat16, 2024-02-23 0.14%
  1143. 1143 google/mt5-small Three-shot, text-only, float16, 2024-04-18 0.14%
  1144. 1144 meta-llama/Meta-Llama-3-8B-Instruct Three-shot, text-only, bfloat16, 2024-04-18 0.14%
  1145. 1145 abacusai/Llama-3-Smaug-8B Three-shot, text-only, bfloat16, 2024-05-13 0.14%
  1146. 1146 Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%
  1147. 1147 gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES Three-shot, text-only, float16, 2024-09-19 0.14%
  1148. 1148 RLHFlow/ArmoRM-Llama3-8B-v0.1 Three-shot, text-only, bfloat16, 2024-10-08 0.14%
  1149. 1149 nicholasKluge/Aira-2-portuguese-560M Three-shot, text-only, float16, 2024-02-05 0%
  1150. 1150 openai-community/openai-gpt Three-shot, text-only, float16, 2024-02-05 0%
  1151. 1151 ai-forever/mGPT Three-shot, text-only, float16, 2024-02-11 0%
  1152. 1152 DAMO-NLP-MT/polylm-13b Three-shot, text-only, float16, 2024-02-11 0%
  1153. 1153 rhaymison/gemma-portuguese-2b-it Three-shot, text-only, bfloat16, 2024-04-08 0%
  1154. 1154 Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO Three-shot, text-only, bfloat16, 2024-04-09 0%
  1155. 1155 abhishek/autotrain-llama3-orpo-v2 Three-shot, text-only, bfloat16, 2024-04-25 0%
  1156. 1156 WizardLMTeam/WizardLM-13B-V1.0 Three-shot, text-only, float16, 2024-05-22 0%
  1157. 1157 recogna-nlp/phibode_1_5_ultraalpaca_qlora Three-shot, text-only, float16, 2024-05-31 0%
  1158. 1158 cognitivess/bella-1-8b Three-shot, text-only, float16, 2024-06-24 0%
  1159. 1159 GeneZC/MiniChat-1.5-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
  1160. 1160 GeneZC/MiniChat-2-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
  1161. 1161 GeneZC/MiniChat-3B Three-shot, text-only, bfloat16, 2024-07-23 0%
  1162. 1162 monsterapi/Llama-3_1-8B-Instruct-orca-ORPO Three-shot, text-only, bfloat16, 2024-08-30 0%
  1163. 1163 kaist-ai/janus-rm-7b Three-shot, text-only, bfloat16, 2024-10-09 0%
  1164. 1164 J-LAB/Qwen2.5_Thinik_base_v1.0 Three-shot, text-only, float16, 2024-10-15 0%
  1165. 1165 J-LAB/Thinik Three-shot, text-only, float16, 2024-10-15 0%

Source: Open Portuguese LLM Leaderboard’s leaderboard

177 models. Scroll sideways for the rest.

  1. 95.0 Gemini 2.5 Pro
  2. 91.4 GPT-5 mini
  3. 89.8 Grok-3 mini
  4. 86.5 Gemini 2.5 Flash
  5. 85.8 Qwen3-32B
  6. 85.3 GPT-5 nano
  7. 84.6 Claude 3.7 Sonnet
  8. 84.1 DeepSeek-V3
  9. 84.0 Gemini 2.5 Flash-Lite
  10. 83.3 Qwen3-14B
  11. 83.0 Qwen3-30B-A3B
  12. 82.8 Kimi K2
  13. 81.8 DeepSeek-V3.1
  14. 81.2 Llama 4 Maverick
  15. 80.7 Qwen3-8B
  16. 80.5 Qwen2.5-VL-72B
  17. 80.5 Qwen2.5-VL-32B
  18. 80.4 Gemini 2.0 Flash
  19. 79.7 GPT-4o
  20. 79.0 Qwen2.5-72B
  21. 78.9 GPT-5
  22. 78.7 Gemini 2.0 Flash-Lite
  23. 78.3 Falcon-H1-34B
  24. 78.0 Qwen3-4B
  25. 76.9 Qwen3-30B-A3B-Instruct
  26. 76.8 Qwen2.5-32B
  27. 76.6 QwQ-32B-Preview
  28. 76.5 DeepSeek-R1-Distill-Qwen-14B
  29. 76.1 Gemini 1.5 Flash
  30. 75.9 Llama 3.3 70B Instruct
  31. 75.8 Gemini 1.5 Flash
  32. 75.4 Qwen2-72B
  33. 72.0 Qwen2.5-14B-Instruct-1M
  34. 71.2 Llama 3.1-70B
  35. 71.1 Llama 3.2 90B
  36. 70.4 Llama 3-70B
  37. 70.2 Phi-4
  38. 68.2 Gemma 3 12B PT
  39. 68.0 Gemma 2 27B
  40. 67.9 Qwen1.5-110B
  41. 67.9 Qwen2.5-Coder-14B
  42. 67.7 qwen3-4b-instruct-2507
  43. 67.6 Qwen1.5-72B
  44. 67.3 Qwen2.5-Coder-32B-Instruct
  45. 66.6 Yi-1.5-34B
  46. 66.6 Gemma 3 12B
  47. 66.5 Yi-34B
  48. 66.5 Qwen2.5-Coder-14B-Instruct
  49. 65.9 Keye-VL-1.5-8B
  50. 65.8 WizardLM-2 8x22B
  51. 65.8 Nemotron-4-340B-Instruct
  52. 65.4 c4ai-command-r-08-2024
  53. 65.4 Aya Expanse 32B
  54. 65.4 OLMo 2 32B Instruct
  55. 65.0 GLM-4-9B-Chat
  56. 64.5 GLM-4-9B
  57. 64.3 Mixtral 8x7B
  58. 64.3 Qwen3-1.7B
  59. 64.0 Gemma 2 9B
  60. 63.4 Phi-3.5-MoE
  61. 63.0 Tulu 2 DPO 70B
  62. 62.9 Falcon3-10B-Instruct
  63. 62.5 GPT-3.5 Turbo
  64. 62.5 phi-3-medium 14B
  65. 62.0 Command R (03-2024)
  66. 61.9 GLM-4-9B-Chat-1M
  67. 61.8 Mistral-Nemo-Base-2407
  68. 61.5 phi-3-small 7.4B
  69. 61.5 Phi-3-medium-128k-instruct
  70. 61.3 Llama 2-70B
  71. 61.3 InternLM2.5-20B-Chat
  72. 61.3 Falcon3-7B-Instruct
  73. 61.1 Qwen2-7B
  74. 61.1 Qwen2-7B-Instruct
  75. 60.8 Qwen1.5-14B-Chat
  76. 60.8 Qwen3-4B-Thinking-2507
  77. 60.6 Aria
  78. 59.9 Llama 3.1-8B
  79. 59.3 Llama 3.2 11B
  80. 58.7 Gemini 1.0 Pro
  81. 58.3 SOLAR-10.7B-Instruct-v1.0
  82. 57.9 Qwen2.5-Coder (7B)
  83. 57.3 Llama 3-8B
  84. 57.3 Granite-3.1-8B-Instruct
  85. 56.9 Phi-4-reasoning
  86. 56.5 Gemma 7B
  87. 55.9 Phi-4-Reasoning-plus
  88. 55.6 Starling-LM-7B-alpha
  89. 55.5 Qwen-14B
  90. 55.4 LLaMA-65B
  91. 55.4 Nous-Hermes-2-Mixtral-8x7B-DPO
  92. 54.9 Yi-9B
  93. 54.8 Yi-1.5-9B-Chat
  94. 54.4 Aya Expanse 8B
  95. 54.1 Qwen1.5-32B
  96. 54.1 Phi-3-mini-128k-instruct
  97. 54.0 phi-3-mini 3.8B
  98. 53.8 Starling-LM-7B-beta
  99. 53.1 Mistral 7B v0.2
  100. 52.9 DeepSeek-R1-Distill-Qwen-7B
  101. 52.6 internlm-20b
  102. 52.3 Mistral 7B v0.3
  103. 52.3 Qwen1.5-7B-Chat
  104. 52.3 Gemma 3 4B
  105. 52.2 Mistral-7B-Instruct-v0.2
  106. 52.0 Qwen2.5-7B
  107. 51.5 Qwen3-14B-Base
  108. 51.3 Yi 6B
  109. 51.0 Zephyr 7B Alpha
  110. 50.5 Llama 3.2 3B
  111. 50.2 Mistral 7B v0.1
  112. 50.2 Qwen3-30B-A3B-Base
  113. 50.1 Yi-6B-Chat
  114. 49.6 Falcon-40B
  115. 49.0 MAmmoTH2-7B-Plus
  116. 48.8 Qwen-7B
  117. 48.1 Gemma 2 2B IT
  118. 48.0 Zephyr 7B Beta
  119. 47.7 Gemma 1.1 7B IT
  120. 47.3 Gemma 3n E2B
  121. 46.6 Qwen1.5-4B-Chat
  122. 46.5 Falcon3-3B-Instruct
  123. 46.3 Yi-1.5-6B-Chat
  124. 46.2 Qwen2.5-3B
  125. 45.6 Qwen1.5-14B
  126. 45.6 DeepSeek-R1-Distill-Llama-70B
  127. 45.3 Qwen3-4B-Base
  128. 43.4 Qwen3-0.6B
  129. 42.3 LFM2-1.2B
  130. 41.6 Mistral-7B-Instruct-v0.1
  131. 38.7 MPT-30B
  132. 37.7 gpt-oss-20b
  133. 37.5 Qwen1.5-7B
  134. 36.0 Qwen3-8B-Base
  135. 35.6 ChatGLM3-6B
  136. 34.5 Qwen2-0.5B-Instruct
  137. 33.5 internlm-7b
  138. 33.0 Gemma 3 1B
  139. 32.8 LLaMA-13B
  140. 31.6 Falcon3-1B-Instruct
  141. 30.3 MAmmoTH2-8B-Plus
  142. 29.9 chatglm2-6b
  143. 29.2 DeepSeek-R1-Distill-Qwen-32B
  144. 28.4 Gemma 2B
  145. 27.0 Phi-2
  146. 26.3 Baichuan2-13B-Chat
  147. 26.3 Qwen-1_8B
  148. 25.6 OPT-66B
  149. 25.6 gpt-oss-120b
  150. 25.3 SmolLM-360M
  151. 25.0 RedPajama-INCITE-7B-Base
  152. 24.9 Gemma 1.1 2B IT
  153. 24.9 OLMo 2 1B Instruct
  154. 24.2 Cerebras-GPT-13B
  155. 24.1 Emu3-Chat
  156. 23.9 LLaMA-7B
  157. 23.6 GPT-J-6B
  158. 23.5 Phi-1.5
  159. 23.4 Llama 3.2 1B
  160. 22.8 GPT-NeoX-20B
  161. 22.8 SmolLM-1.7B
  162. 22.7 MPT-7B
  163. 22.5 Qwen2-0.5B
  164. 22.3 Gemma 3 1B PT
  165. 22.0 Falcon-7B
  166. 22.0 open_llama_7b
  167. 21.7 GPT-Neo-2.7B
  168. 20.0 Qwen2.5-Coder-32B
  169. 19.2 OPT-1.3B
  170. 19.2 SmolLM-135M
  171. 18.5 Gemma 3 270M
  172. 13.9 DeepSeek-R1-Distill-Qwen-1.5B
  173. 13.5 T5-Large
  174. 13.1 T5-Small
  175. 10.2 T5-Base
  176. 6.68 Qwen2.5-0.5B
  177. 0.14 Qwen2.5-1.5B
  1. 1 Gemini 2.5 Pro Mar 2025, Three-shot, text-only, reasoning, 2025-04-03 95%
  2. 2 GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
  3. 3 Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
  4. 4 Gemini 2.5 Flash Jun 2025, Three-shot, text-only, 2025-09-01 86.5%
  5. 5 Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
  6. 6 GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
  7. 7 Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
  8. 8 DeepSeek-V3 Mar 2025, Three-shot, text-only, 2025-04-03 84.1%
  9. 9 Gemini 2.5 Flash-Lite Jun 2025, Three-shot, text-only, reasoning: low, 2025-09-01 84%
  10. 10 Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
  11. 11 Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
  12. 12 Kimi K2 Jul 2025, Three-shot, text-only, 2025-09-01 82.8%
  13. 13 DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
  14. 14 Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
  15. 15 Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
  16. 16 Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
  17. 17 Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
  18. 18 Gemini 2.0 Flash Feb 2025, Three-shot, text-only, 2025-04-03 80.4%
  19. 19 GPT-4o Aug 2024, Three-shot, text-only, 2025-04-09 79.7%
  20. 20 Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
  21. 21 GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
  22. 22 Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
  23. 23 Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
  24. 24 Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
  25. 25 Qwen3-30B-A3B-Instruct Jul 2025, Three-shot, text-only, bfloat16, 2025-08-30 76.9%
  26. 26 Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
  27. 27 QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
  28. 28 DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
  29. 29 Gemini 1.5 Flash Sep 2024, Three-shot, text-only, 2025-04-03 76.1%
  30. 30 Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
  31. 31 Gemini 1.5 Flash May 2024, Three-shot, text-only, 2024-08-09 75.8%
  32. 32 Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
  33. 33 Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
  34. 34 Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
  35. 35 Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
  36. 36 Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
  37. 37 Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
  38. 38 Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
  39. 39 Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
  40. 40 Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
  41. 41 Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
  42. 42 qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
  43. 43 Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
  44. 44 Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
  45. 45 Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
  46. 46 Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
  47. 47 Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
  48. 48 Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
  49. 49 Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
  50. 50 WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
  51. 51 Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
  52. 52 c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
  53. 53 Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
  54. 54 OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
  55. 55 GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
  56. 56 GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
  57. 57 Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
  58. 58 Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
  59. 59 Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
  60. 60 Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
  61. 61 Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
  62. 62 Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
  63. 63 GPT-3.5 Turbo Jan 2024, Three-shot, text-only, 2024-03-08 62.5%
  64. 64 phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
  65. 65 Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
  66. 66 GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
  67. 67 Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
  68. 68 phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
  69. 69 Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
  70. 70 Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
  71. 71 InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
  72. 72 Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
  73. 73 Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
  74. 74 Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
  75. 75 Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
  76. 76 Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
  77. 77 Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
  78. 78 Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
  79. 79 Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
  80. 80 Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
  81. 81 SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
  82. 82 Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
  83. 83 Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
  84. 84 Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
  85. 85 Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
  86. 86 Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
  87. 87 Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
  88. 88 Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
  89. 89 Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
  90. 90 LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
  91. 91 Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
  92. 92 Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
  93. 93 Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
  94. 94 Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
  95. 95 Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
  96. 96 Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
  97. 97 phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
  98. 98 Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
  99. 99 Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
  100. 100 DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
  101. 101 internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
  102. 102 Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
  103. 103 Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
  104. 104 Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
  105. 105 Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
  106. 106 Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
  107. 107 Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
  108. 108 Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
  109. 109 Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
  110. 110 Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
  111. 111 Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
  112. 112 Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
  113. 113 Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
  114. 114 Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
  115. 115 MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
  116. 116 Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
  117. 117 Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
  118. 118 Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
  119. 119 Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
  120. 120 Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
  121. 121 Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
  122. 122 Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
  123. 123 Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
  124. 124 Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
  125. 125 Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
  126. 126 DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
  127. 127 Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
  128. 128 Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
  129. 129 LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
  130. 130 Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
  131. 131 MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
  132. 132 gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
  133. 133 Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
  134. 134 Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
  135. 135 ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
  136. 136 Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
  137. 137 internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
  138. 138 Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
  139. 139 LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
  140. 140 Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
  141. 141 MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
  142. 142 chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
  143. 143 DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
  144. 144 Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
  145. 145 Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
  146. 146 Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
  147. 147 Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
  148. 148 OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
  149. 149 gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
  150. 150 SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
  151. 151 RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
  152. 152 Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
  153. 153 OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
  154. 154 Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
  155. 155 Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
  156. 156 LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
  157. 157 GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
  158. 158 Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
  159. 159 Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
  160. 160 GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
  161. 161 SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
  162. 162 MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
  163. 163 Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
  164. 164 Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
  165. 165 Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
  166. 166 open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
  167. 167 GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
  168. 168 Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
  169. 169 OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
  170. 170 SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
  171. 171 Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
  172. 172 DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
  173. 173 T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
  174. 174 T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
  175. 175 T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
  176. 176 Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
  177. 177 Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%

Source: Open Portuguese LLM Leaderboard’s leaderboard

#EntryScoreSettingReleasedRun onLinkSource
1 Gemini 2.5 Pro Mar 2025 95% Three-shot, text-only, reasoning, 2025-04-03 Mar 2025 Apr 2025 aistudio.google.com Official leaderboard
2 GPT-5 mini 91.4% Three-shot, text-only, reasoning, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
3 Grok-3 mini 89.8% Three-shot, text-only, reasoning, 2025-09-01 Apr 2025 Sep 2025 x.ai Official leaderboard
4 Gemini 2.5 Flash Jun 2025 86.5% Three-shot, text-only, 2025-09-01 Jun 2025 Sep 2025 aistudio.google.com Official leaderboard
5 Qwen3-32B 85.8% Three-shot, text-only, 4bit, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
6 GPT-5 nano 85.3% Three-shot, text-only, reasoning, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
7 Claude 3.7 Sonnet 84.6% Three-shot, text-only, 2025-04-04 Feb 2025 Apr 2025 anthropic.com Official leaderboard
8 DeepSeek-V3 Mar 2025 84.1% Three-shot, text-only, 2025-04-03 Mar 2025 Apr 2025 huggingface.co Official leaderboard
9 Gemini 2.5 Flash-Lite Jun 2025 84% Three-shot, text-only, reasoning: low, 2025-09-01 Jun 2025 Sep 2025 aistudio.google.com Official leaderboard
10 Qwen3-14B 83.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
11 Qwen3-30B-A3B 83% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
12 Kimi K2 Jul 2025 82.8% Three-shot, text-only, 2025-09-01 Jul 2025 Sep 2025 huggingface.co Official leaderboard
13 DeepSeek-V3.1 81.8% Three-shot, text-only, 2025-09-01 Aug 2025 Sep 2025 huggingface.co Official leaderboard
14 Sabiá-3.1 (2025-05-08) 81.8% Three-shot, text-only, 2025-09-01 Sep 2025 maritaca.ai Official leaderboard
15 Llama 4 Maverick 81.2% Three-shot, text-only, 2025-04-05 Apr 2025 Apr 2025 huggingface.co Official leaderboard
16 Qwen3-8B 80.7% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
17 Qwen2.5-VL-72B 80.5% Three-shot, text-only, 2025-04-03 Jan 2025 Apr 2025 huggingface.co Official leaderboard
18 Qwen2.5-VL-32B 80.5% Three-shot, text-only, 2025-04-03 Mar 2025 Apr 2025 huggingface.co Official leaderboard
19 Gemini 2.0 Flash Feb 2025 80.4% Three-shot, text-only, 2025-04-03 Feb 2025 Apr 2025 cloud.google.com Official leaderboard
20 meta-llama/Llama-3.1-405B-Instruct (Vertex AI) 406B 80.1% Three-shot, text-only, 2024-08-20 Aug 2024 huggingface.co Official leaderboard
21 GPT-4o Aug 2024 79.7% Three-shot, text-only, 2025-04-09 Aug 2024 Apr 2025 openai.com Official leaderboard
22 Sabiá-3 (2024-07-15) 79% Three-shot, text-only, 2024-08-20 Aug 2024 maritaca.ai Official leaderboard
23 Qwen2.5-72B 79% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 Sep 2024 huggingface.co Official leaderboard
24 GPT-5 78.9% Three-shot, text-only, reasoning: minimal, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
25 Gemini 2.0 Flash-Lite 78.7% Three-shot, text-only, 2025-04-03 Feb 2025 Apr 2025 cloud.google.com Official leaderboard
26 Sabiá-3 (2024-12-11) 78.7% Three-shot, text-only, 2025-09-01 Sep 2025 maritaca.ai Official leaderboard
27 huihui-ai/Qwen2.5-32B-Instruct-abliterated 32.8B 78.6% Three-shot, text-only, bfloat16, 2024-10-04 Oct 2024 huggingface.co Official leaderboard
28 rombodawg/Rombos-LLM-V2.5-Qwen-32b 32.8B 78.6% Three-shot, text-only, bfloat16, 2024-10-10 Oct 2024 huggingface.co Official leaderboard
29 Saxo/Linkbricks-Horizon-AI-Avengers-V4-32B 32.8B 78.6% Three-shot, text-only, bfloat16, 2025-01-21 Jan 2025 huggingface.co Official leaderboard
30 Saxo/Linkbricks-Horizon-AI-Avengers-V5-32B 32.8B 78.6% Three-shot, text-only, bfloat16, 2025-01-21 Jan 2025 huggingface.co Official leaderboard
31 maldv/Qwentile2.5-32B-Instruct 32.8B 78.4% Three-shot, text-only, bfloat16, 2024-12-21 Dec 2024 huggingface.co Official leaderboard
32 Qwen/Qwen2.5-32B-Instruct 32.8B 78.3% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
33 AXCXEPT/EZO-Qwen2.5-32B-Instruct 32.8B 78.3% Three-shot, text-only, bfloat16, 2024-10-04 Oct 2024 huggingface.co Official leaderboard
34 Sakalti/Oxyge1-33B 32.8B 78.3% Three-shot, text-only, bfloat16, 2024-12-21 Dec 2024 huggingface.co Official leaderboard
35 Falcon-H1-34B 78.3% Three-shot, text-only, bfloat16, 2025-07-08 May 2025 Jul 2025 huggingface.co Official leaderboard
36 fblgit/TheBeagle-v2beta-32B-MGS 32.8B 78% Three-shot, text-only, bfloat16, 2024-12-12 Dec 2024 huggingface.co Official leaderboard
37 Qwen3-4B 78% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
38 tiiuae/Falcon-H1-34B-Base 33.6B 77.8% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
39 huihui-ai/QwQ-32B-Coder-Fusion-9010 32.8B 77.6% Three-shot, text-only, bfloat16, 2024-12-12 Dec 2024 huggingface.co Official leaderboard
40 Gemini 1.5 Pro Preview (0409) 77.2% Three-shot, text-only, 2024-04-15 Apr 2024 cloud.google.com Official leaderboard
41 Qwen3-30B-A3B-Instruct Jul 2025 76.9% Three-shot, text-only, bfloat16, 2025-08-30 Jul 2025 Aug 2025 huggingface.co Official leaderboard
42 Qwen2.5-32B 76.8% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 Sep 2024 huggingface.co Official leaderboard
43 QwQ-32B-Preview 76.6% Three-shot, text-only, bfloat16, 2024-12-03 Nov 2024 Dec 2024 huggingface.co Official leaderboard
44 huihui-ai/QwQ-32B-Preview-abliterated 32.8B 76.5% Three-shot, text-only, bfloat16, 2024-12-12 Dec 2024 huggingface.co Official leaderboard
45 DeepSeek-R1-Distill-Qwen-14B 76.5% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
46 OpenBuddy/openbuddy-qwq-32b-v24.1-200k 32.8B 76.5% Three-shot, text-only, bfloat16, 2025-01-22 Jan 2025 huggingface.co Official leaderboard
47 Gemini 1.5 Flash Sep 2024 76.1% Three-shot, text-only, 2025-04-03 Aug 2024 Apr 2025 cloud.google.com Official leaderboard
48 Llama 3.3 70B Instruct 75.9% Three-shot, text-only, 2025-04-03 Dec 2024 Apr 2025 huggingface.co Official leaderboard
49 Gemini 1.5 Flash May 2024 75.8% Three-shot, text-only, 2024-08-09 May 2024 Aug 2024 cloud.google.com Official leaderboard
50 Qwen2-72B 75.4% Three-shot, text-only, bfloat16, 2024-06-08 Jun 2024 Jun 2024 huggingface.co Official leaderboard
51 google/medgemma-27b-text-it 27B 75.4% Three-shot, text-only, bfloat16, 2025-07-15 Jul 2025 huggingface.co Official leaderboard
52 meta-llama/Meta-Llama-3.1-70B-Instruct 70.6B 75.1% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
53 amadeusai/Amadeus-Verbo-FI-Qwen2.5-72B-PT-BR-Instruct 72.7B 75.1% Three-shot, text-only, float16, 2025-06-16 Jun 2025 huggingface.co Official leaderboard
54 Gemini 1.5 Flash Preview (0514) 74.8% Three-shot, text-only, 2024-05-18 May 2024 cloud.google.com Official leaderboard
55 nisten/franqwenstein-35b 34.7B 74.8% Three-shot, text-only, bfloat16, 2024-10-10 Oct 2024 huggingface.co Official leaderboard
56 meta-llama/Llama-3.2-90B-Vision-Instruct (Vertex AI) 88.6B 74.8% Three-shot, text-only, 2025-04-03 Apr 2025 huggingface.co Official leaderboard
57 arcee-ai/Virtuoso-Small 14.8B 74.5% Three-shot, text-only, bfloat16, 2024-12-21 Dec 2024 huggingface.co Official leaderboard
58 prithivMLmods/Megatron-Opus-14B-Exp 14.8B 74.1% Three-shot, text-only, bfloat16, 2025-02-03 Feb 2025 huggingface.co Official leaderboard
59 sometimesanotion/Qwen2.5-14B-Vimarckoso-v3 14.8B 74% Three-shot, text-only, bfloat16, 2025-01-21 Jan 2025 huggingface.co Official leaderboard
60 mistralai/Mistral-Small-24B-Base-2501 23.6B 74% Three-shot, text-only, bfloat16, 2025-01-31 Jan 2025 huggingface.co Official leaderboard
61 google/gemma-3-27b-it (GoogleAI API) 27.4B 73.8% Three-shot, text-only, 2025-04-08 Apr 2025 huggingface.co Official leaderboard
62 Replete-AI/Replete-LLM-V2.5-Qwen-14b 14.8B 73.7% Three-shot, text-only, bfloat16, 2024-10-01 Oct 2024 huggingface.co Official leaderboard
63 rombodawg/Rombos-LLM-V2.6-Qwen-14b 14.8B 73.6% Three-shot, text-only, bfloat16, 2024-10-14 Oct 2024 huggingface.co Official leaderboard
64 hotmailuser/QwenSlerp2-14B 14.8B 73.6% Three-shot, text-only, bfloat16, 2025-01-21 Jan 2025 huggingface.co Official leaderboard
65 sometimesanotion/Lamarck-14B-v0.6 14.8B 73.6% Three-shot, text-only, bfloat16, 2025-01-21 Jan 2025 huggingface.co Official leaderboard
66 sometimesanotion/Lamarck-14B-v0.7 14.8B 73.6% Three-shot, text-only, bfloat16, 2025-02-02 Feb 2025 huggingface.co Official leaderboard
67 meta-llama/Meta-Llama-3-70B-Instruct 70.6B 73.4% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
68 v000000/Qwen2.5-14B-Gutenberg-Instruct-Slerpeno 14.8B 73.4% Three-shot, text-only, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
69 allknowingroger/Qwen2.5-slerp-14B 14.8B 73.4% Three-shot, text-only, bfloat16, 2024-11-01 Nov 2024 huggingface.co Official leaderboard
70 mistralai/Mistral-Small-24B-Instruct-2501 23.6B 73.4% Three-shot, text-only, bfloat16, 2025-01-31 Jan 2025 huggingface.co Official leaderboard
71 Sabiázinho-3 (2025-02-06) 73.4% Three-shot, text-only, 2025-09-01 Sep 2025 maritaca.ai Official leaderboard
72 Qwen/Qwen2.5-14B-Instruct 14.8B 73.3% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
73 Lambent/qwen2.5-reinstruct-alternate-lumen-14B 14.8B 73.3% Three-shot, text-only, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
74 v000000/Qwen2.5-14B-Gutenberg-1e-Delta 14.8B 73.3% Three-shot, text-only, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
75 CultriX/Qwen2.5-14B-Wernicke 14.8B 73.3% Three-shot, text-only, bfloat16, 2024-11-17 Nov 2024 huggingface.co Official leaderboard
76 allknowingroger/QwenSlerp6-14B 14.8B 73.3% Three-shot, text-only, bfloat16, 2024-12-21 Dec 2024 huggingface.co Official leaderboard
77 tanliboy/lambda-qwen2.5-14b-dpo-test 14.8B 73.2% Three-shot, text-only, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
78 Goekdeniz-Guelmez/Josiefied-Qwen2.5-14B-Instruct-abliterated-v4 14.8B 73.2% Three-shot, text-only, bfloat16, 2024-11-01 Nov 2024 huggingface.co Official leaderboard
79 CultriX/SeQwence-14Bv1 14.8B 72.5% Three-shot, text-only, bfloat16, 2024-12-21 Dec 2024 huggingface.co Official leaderboard
80 janhq/Jan-v1-4B 4B 72.3% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
81 meta-llama/Llama-4-Scout-17B-16E-Instruct (Groq API) 109B 72.2% Three-shot, text-only, 2025-04-05 Apr 2025 huggingface.co Official leaderboard
82 arcee-ai/SuperNova-Medius 14.8B 72% Three-shot, text-only, bfloat16, 2024-10-20 Oct 2024 huggingface.co Official leaderboard
83 CultriX/Qwen2.5-14B-Wernicke-SFT 14.8B 72% Three-shot, text-only, bfloat16, 2024-11-17 Nov 2024 huggingface.co Official leaderboard
84 Qwen2.5-14B-Instruct-1M 72% Three-shot, text-only, bfloat16, 2025-01-31 Jan 2025 Jan 2025 huggingface.co Official leaderboard
85 Sabiá-2 Medium 71.8% Three-shot, text-only, 2024-04-13 Apr 2024 maritaca.ai Official leaderboard
86 Qwen/Qwen1.5-110B-Chat 111.2B 71.8% Three-shot, text-only, 4bit, 2024-05-23 May 2024 huggingface.co Official leaderboard
87 AALF/gemma-2-27b-it-SimPO-37K-100steps 27.2B 71.6% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
88 Llama 3.1-70B 71.2% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 Jul 2024 huggingface.co Official leaderboard
89 byroneverson/gemma-2-27b-it-abliterated 27.2B 71.1% Three-shot, text-only, bfloat16, 2024-09-05 Sep 2024 huggingface.co Official leaderboard
90 Llama 3.2 90B 71.1% Three-shot, text-only, 4bit, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
91 Qwen-Turbo (2024-11-01) 70.8% Three-shot, text-only, 2025-04-03 Apr 2025 alibabacloud.com Official leaderboard
92 google/gemma-2-27b-it 27.2B 70.5% Three-shot, text-only, bfloat16, 2024-07-02 Jul 2024 huggingface.co Official leaderboard
93 Llama 3-70B 70.4% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 Apr 2024 huggingface.co Official leaderboard
94 THUDM/GLM-Z1-9B-0414 9.4B 70.4% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
95 Phi-4 70.2% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
96 botbot-ai/CabraLlama3-70b 70.6B 70.1% Three-shot, text-only, bfloat16, 2024-06-21 Jun 2024 huggingface.co Official leaderboard
97 tiiuae/Falcon-H1-7B-Instruct 7.6B 70.1% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
98 abacusai/Smaug-Llama-3-70B-Instruct 70.6B 69.5% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
99 DeepSeek-V2 Chat (API) 69.5% Three-shot, text-only, 2024-05-18 May 2024 deepseek.com Official leaderboard
100 google/medgemma-27b-it 27.4B 69.3% Three-shot, text-only, bfloat16, 2025-07-15 Jul 2025 huggingface.co Official leaderboard
101 unsloth/llama-3-70b-Instruct-bnb-4bit 70.6B 68.8% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
102 tiiuae/Falcon-H1-7B-Base 7.6B 68.7% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
103 Qwen/Qwen-72B 72.3B 68.4% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
104 GPT 4o Mini (2024-07-18) 68.4% Three-shot, text-only, 2024-07-25 Jul 2024 openai.com Official leaderboard
105 abacusai/Smaug-72B-v0.1 72.3B 68.3% Three-shot, text-only, bfloat16, 2024-02-28 Feb 2024 huggingface.co Official leaderboard
106 unsloth/Llama-3.3-70B-Instruct-bnb-4bit 70.6B 68.2% Three-shot, text-only, 4bit, 2024-12-10 Dec 2024 huggingface.co Official leaderboard
107 Gemma 3 12B PT 68.2% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
108 Weyaxi/Nous-Hermes-2-SUS-Chat-34B-Slerp 34.4B 68% Three-shot, text-only, bfloat16, 2024-06-16 Jun 2024 huggingface.co Official leaderboard
109 Gemma 2 27B 68% Three-shot, text-only, bfloat16, 2024-07-02 Jun 2024 Jul 2024 huggingface.co Official leaderboard
110 huihui-ai/Qwen2.5-Coder-32B-Instruct-abliterated 32.8B 68% Three-shot, text-only, bfloat16, 2024-12-12 Dec 2024 huggingface.co Official leaderboard
111 Qwen1.5-110B 67.9% Three-shot, text-only, 4bit, 2024-05-23 Apr 2024 May 2024 huggingface.co Official leaderboard
112 01-ai/Yi-1.5-34B-32K 34.4B 67.9% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
113 cognitivecomputations/dolphin-2.9.1-llama-3-70b 70.6B 67.9% Three-shot, text-only, bfloat16, 2024-05-24 May 2024 huggingface.co Official leaderboard
114 Qwen2.5-Coder-14B 67.9% Three-shot, text-only, bfloat16, 2024-11-12 Sep 2024 Nov 2024 huggingface.co Official leaderboard
115 qwen3-4b-instruct-2507 67.7% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
116 Qwen1.5-72B 67.6% Three-shot, text-only, bfloat16, 2024-02-18 Feb 2024 Feb 2024 huggingface.co Official leaderboard
117 Weyaxi/Bagel-Hermes-34B-Slerp 34.4B 67.6% Three-shot, text-only, rev: 459676b, bfloat16, 2024-05-26 May 2024 huggingface.co Official leaderboard
118 botbot-ai/Cabra-72b 72.3B 67.5% Three-shot, text-only, bfloat16, 2024-04-06 Apr 2024 huggingface.co Official leaderboard
119 unsloth/Meta-Llama-3.1-70B-Instruct-bnb-4bit 70.6B 67.3% Three-shot, text-only, 4bit, 2024-08-13 Aug 2024 huggingface.co Official leaderboard
120 Qwen2.5-Coder-32B-Instruct 67.3% Three-shot, text-only, bfloat16, 2024-11-12 Nov 2024 Nov 2024 huggingface.co Official leaderboard
121 mistral-community/Mixtral-8x22B-v0.1-4bit 140.6B 67.2% Three-shot, text-only, 4bit, 2024-04-12 Apr 2024 huggingface.co Official leaderboard
122 Azure99/blossom-v5.1-34b 34.4B 67.2% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
123 VAGOsolutions/SauerkrautLM-Qwen-32b 32.5B 67.2% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
124 jondurbin/bagel-dpo-34b-v0.2 34.4B 66.9% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
125 altomek/YiSM-34B-0rn 34.4B 66.9% Three-shot, text-only, float16, 2024-06-06 Jun 2024 huggingface.co Official leaderboard
126 jondurbin/bagel-dpo-34b-v0.5 34.4B 66.8% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
127 upstage/solar-pro-preview-instruct 22.1B 66.8% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
128 Claude-3 Haiku (20240307) 66.6% Three-shot, text-only, 2024-04-13 Apr 2024 claude.ai Official leaderboard
129 Yi-1.5-34B 66.6% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 May 2024 huggingface.co Official leaderboard
130 mistralai/Mixtral-8x22B-Instruct-v0.1 140.6B 66.6% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
131 Orion-zhen/Qwen2.5-7B-Instruct-Uncensored 7.6B 66.6% Three-shot, text-only, bfloat16, 2024-10-19 Oct 2024 huggingface.co Official leaderboard
132 Gemma 3 12B 66.6% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
133 Yi-34B 66.5% Three-shot, text-only, bfloat16, 2024-02-05 Nov 2023 Feb 2024 huggingface.co Official leaderboard
134 SinclairSchneider/zephyr-orpo-141b-A35b-v0.1-bnb-4bit 140.6B 66.5% Three-shot, text-only, 4bit, 2024-04-17 Apr 2024 huggingface.co Official leaderboard
135 01-ai/Yi-1.5-34B-Chat 34.4B 66.5% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
136 Cran-May/T.E-8.1 7.6B 66.5% Three-shot, text-only, bfloat16, 2024-09-30 Sep 2024 huggingface.co Official leaderboard
137 Qwen2.5-Coder-14B-Instruct 66.5% Three-shot, text-only, bfloat16, 2024-11-12 Nov 2024 Nov 2024 huggingface.co Official leaderboard
138 Qwen/Qwen2.5-7B-Instruct-1M 7.6B 66.5% Three-shot, text-only, float16, 2025-09-01 Sep 2025 huggingface.co Official leaderboard
139 adalbertojunior/Qwen1.5-32B-Dolphin-Portuguese-v0.1 32.5B 66.3% Three-shot, text-only, bfloat16, 2024-04-30 Apr 2024 huggingface.co Official leaderboard
140 CohereForAI/c4ai-command-r-plus-4bit 103.8B 66.2% Three-shot, text-only, 4bit, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
141 mistral-community/Mixtral-8x22B-Instruct-v0.1-4bit 140.6B 66.2% Three-shot, text-only, 4bit, 2024-04-20 Apr 2024 huggingface.co Official leaderboard
142 CombinHorizon/YiSM-blossom5.1-34B-SLERP 34.4B 66.2% Three-shot, text-only, bfloat16, 2024-08-27 Aug 2024 huggingface.co Official leaderboard
143 VAGOsolutions/SauerkrautLM-Phi-3-medium 14B 66.2% Three-shot, text-only, bfloat16, 2024-09-19 Sep 2024 huggingface.co Official leaderboard
144 CausalLM/34b-beta 34.4B 66.1% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
145 Keye-VL-1.5-8B 65.9% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
146 NousResearch/Nous-Hermes-2-Yi-34B 34.4B 65.8% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
147 abacusai/Smaug-34B-v0.1 34.4B 65.8% Three-shot, text-only, bfloat16, 2024-02-28 Feb 2024 huggingface.co Official leaderboard
148 WizardLM-2 8x22B 65.8% Three-shot, text-only, bfloat16, 2024-05-22 Apr 2024 May 2024 huggingface.co Official leaderboard
149 ConvexAI/Luminex-34B-v0.2 34.4B 65.8% Three-shot, text-only, float16, 2024-05-30 May 2024 huggingface.co Official leaderboard
150 Nemotron-4-340B-Instruct 65.8% Three-shot, text-only, 2024-06-30 Jun 2024 Jun 2024 huggingface.co Official leaderboard
151 wenbopan/Faro-Yi-34B-DPO 34.4B 65.8% Three-shot, text-only, bfloat16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
152 Danielbrdz/Barcenas-14b-Phi-3-medium-ORPO 14B 65.8% Three-shot, text-only, float16, 2024-07-31 Jul 2024 huggingface.co Official leaderboard
153 Qwen/Qwen1.5-32B-Chat 32.5B 65.7% Three-shot, text-only, bfloat16, 2024-04-08 Apr 2024 huggingface.co Official leaderboard
154 recoilme/recoilme-gemma-2-9B-v0.4 10.2B 65.7% Three-shot, text-only, rev: 2691f2c, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
155 anthracite-org/magnum-v3-9b-customgemma2 9.2B 65.5% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
156 fblgit/UNA-SimpleSmaug-34b-v1beta 34.4B 65.4% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
157 princeton-nlp/gemma-2-9b-it-SimPO 9.2B 65.4% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
158 c4ai-command-r-08-2024 65.4% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2024 Aug 2025 huggingface.co Official leaderboard
159 Aya Expanse 32B 65.4% Three-shot, text-only, float16, 2024-10-27 Oct 2024 Oct 2024 huggingface.co Official leaderboard
160 OLMo 2 32B Instruct 65.4% Three-shot, text-only, bfloat16, 2025-05-01 Mar 2025 May 2025 huggingface.co Official leaderboard
161 baidu/ERNIE-4.5-21B-A3B-PT 22B 65.4% Three-shot, text-only, bfloat16, 2025-08-31 Aug 2025 huggingface.co Official leaderboard
162 Qwen/Qwen2-57B-A14B 57.4B 65.2% Three-shot, text-only, bfloat16, 2024-06-08 Jun 2024 huggingface.co Official leaderboard
163 Qwen/Qwen2-57B-A14B-Instruct 57.4B 65.2% Three-shot, text-only, float16, 2024-06-08 Jun 2024 huggingface.co Official leaderboard
164 anthracite-org/magnum-v3-9b-chatml 9.2B 65.2% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
165 GLM-4-9B-Chat 65% Three-shot, text-only, float16, 2024-06-09 Jun 2024 Jun 2024 huggingface.co Official leaderboard
166 01-ai/Yi-34B-200K 34.4B 64.8% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
167 152334H/miqu-1-70b-sf 69B 64.8% Three-shot, text-only, float16, 2024-04-26 Apr 2024 huggingface.co Official leaderboard
168 migtissera/Tess-M-v1.3 34.4B 64.8% Three-shot, text-only, float16, 2024-05-16 May 2024 huggingface.co Official leaderboard
169 ConvexAI/Luminex-34B-v0.1 34.4B 64.8% Three-shot, text-only, float16, 2024-06-08 Jun 2024 huggingface.co Official leaderboard
170 wenbopan/Faro-Yi-34B 34.4B 64.8% Three-shot, text-only, bfloat16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
171 BAAI/Gemma2-9B-IT-Simpo-Infinity-Preference 9.2B 64.8% Three-shot, text-only, bfloat16, 2024-09-02 Sep 2024 huggingface.co Official leaderboard
172 anthracite-org/magnum-v3-27b-kto 27.2B 64.7% Three-shot, text-only, bfloat16, 2024-09-15 Sep 2024 huggingface.co Official leaderboard
173 huihui-ai/Qwen2.5-7B-Instruct-abliterated 7.6B 64.7% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
174 Gemini 1.5 Flash 8B (001) 64.7% Three-shot, text-only, 2025-04-03 Apr 2025 aistudio.google.com Official leaderboard
175 GLM-4-9B 64.5% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 Jun 2024 huggingface.co Official leaderboard
176 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated 7.6B 64.5% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
177 Qwen/Qwen2.5-7B-Instruct 7.6B 64.5% Three-shot, text-only, rev: bb46c15, bfloat16, 2024-10-15 Oct 2024 huggingface.co Official leaderboard
178 tiiuae/Falcon3-10B-Base 10.3B 64.5% Three-shot, text-only, bfloat16, 2025-01-15 Jan 2025 huggingface.co Official leaderboard
179 Mixtral 8x7B 64.3% Three-shot, text-only, bfloat16, 2024-02-05 Dec 2023 Feb 2024 huggingface.co Official leaderboard
180 recoilme/Gemma-2-Ataraxy-Gemmasutra-9B-slerp 10.2B 64.3% Three-shot, text-only, bfloat16, 2024-09-16 Sep 2024 huggingface.co Official leaderboard
181 TIGER-Lab/AceCoder-Qwen2.5-7B-Ins-Rule 7.6B 64.3% Three-shot, text-only, bfloat16, 2025-03-07 Mar 2025 huggingface.co Official leaderboard
182 Qwen3-1.7B 64.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
183 botbot-ai/CabraMixtral-8x7b 46.7B 64.1% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
184 Gemma 2 9B 64% Three-shot, text-only, bfloat16, 2024-07-02 Jun 2024 Jul 2024 huggingface.co Official leaderboard
185 recoilme/recoilme-gemma-2-9B-v0.2 10.2B 64% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
186 arcee-ai/Virtuoso-Lite 10.3B 64% Three-shot, text-only, bfloat16, 2025-02-05 Feb 2025 huggingface.co Official leaderboard
187 Replete-AI/Replete-LLM-V2.5-Qwen-7b 7.6B 63.7% Three-shot, text-only, bfloat16, 2024-10-01 Oct 2024 huggingface.co Official leaderboard
188 sethuiyer/Qwen2.5-7B-Anvita 7.6B 63.7% Three-shot, text-only, bfloat16, 2024-11-01 Nov 2024 huggingface.co Official leaderboard
189 cognitivecomputations/dolphin-2.9.1-yi-1.5-34b 34.4B 63.6% Three-shot, text-only, bfloat16, 2024-05-25 May 2024 huggingface.co Official leaderboard
190 google/gemma-2-9b-it 9.2B 63.6% Three-shot, text-only, bfloat16, 2024-07-02 Jul 2024 huggingface.co Official leaderboard
191 TheDrummer/Gemmasutra-9B-v1 10.2B 63.6% Three-shot, text-only, bfloat16, 2024-09-19 Sep 2024 huggingface.co Official leaderboard
192 huihui-ai/Qwen2.5-7B-Instruct-abliterated-v2 7.6B 63.6% Three-shot, text-only, bfloat16, 2024-10-01 Oct 2024 huggingface.co Official leaderboard
193 Phi-3.5-MoE 63.4% Three-shot, text-only, 4bit, 2024-12-05 Aug 2024 Dec 2024 huggingface.co Official leaderboard
194 OpenBuddy/openbuddy-qwen2.5llamaify-14b-v23.1-200k 14.8B 63.4% Three-shot, text-only, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
195 01-ai/Yi-34B-Chat 34.4B 63.3% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
196 lucianosb/boto-9B 9.2B 63.3% Three-shot, text-only, bfloat16, 2024-07-10 Jul 2024 huggingface.co Official leaderboard
197 rhymes-ai/Aria-Base-64K 25.3B 63.3% Three-shot, text-only, bfloat16, 2024-12-05 Dec 2024 huggingface.co Official leaderboard
198 THUDM/GLM-4-9B-0414 9.4B 63.1% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
199 Tulu 2 DPO 70B 63% Three-shot, text-only, bfloat16, 2024-03-05 Nov 2023 Mar 2024 huggingface.co Official leaderboard
200 NousResearch/Nous-Capybara-34B 34.4B 63% Three-shot, text-only, bfloat16, 2024-04-26 Apr 2024 huggingface.co Official leaderboard
201 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter2 9.2B 63% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
202 UCLA-AGI/Gemma-2-9B-It-SPPO-Iter3 9.2B 63% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
203 Falcon3-10B-Instruct 62.9% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
204 speakleash/Bielik-11B-v2.2-Instruct 11.2B 62.7% Three-shot, text-only, bfloat16, 2024-10-17 Oct 2024 huggingface.co Official leaderboard
205 speakleash/Bielik-11B-v2.1-Instruct 11.2B 62.6% Three-shot, text-only, bfloat16, 2024-10-17 Oct 2024 huggingface.co Official leaderboard
206 GPT-3.5 Turbo Jan 2024 62.5% Three-shot, text-only, 2024-03-08 Jan 2024 Mar 2024 openai.com Official leaderboard
207 phi-3-medium 14B 62.5% Three-shot, text-only, bfloat16, 2024-05-21 Apr 2024 May 2024 huggingface.co Official leaderboard
208 microsoft/Phi-3-small-128k-instruct 7.4B 62.5% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 huggingface.co Official leaderboard
209 cognitivecomputations/dolphin-2.9.3-mistral-nemo-12b 12.3B 62.5% Three-shot, text-only, bfloat16, 2024-07-25 Jul 2024 huggingface.co Official leaderboard
210 PrunaAI/dbrx-base-bnb-4bit 131.6B 62.3% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
211 Isaak-Carter/Josiefied-Qwen2.5-7B-Instruct-abliterated-v2 7.6B 62.3% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
212 recoilme/recoilme-gemma-2-9B-v0.3 10.2B 62.3% Three-shot, text-only, rev: 772cab4, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
213 speakleash/Bielik-11B-v2.3-Instruct 11.2B 62.3% Three-shot, text-only, float16, 2024-10-17 Oct 2024 huggingface.co Official leaderboard
214 chujiezheng/Smaug-34B-v0.1-ExPO 34.4B 62.2% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
215 jpacifico/Chocolatine-14B-Instruct-4k-DPO 14B 62.2% Three-shot, text-only, float16, 2024-08-27 Aug 2024 huggingface.co Official leaderboard
216 MarinaraSpaghetti/NemoReRemix-12B 12.3B 62.2% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
217 Command R (03-2024) 62% Three-shot, text-only, float16, 2024-04-05 Mar 2024 Apr 2024 huggingface.co Official leaderboard
218 PrunaAI/dbrx-instruct-bnb-4bit 131.6B 62% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
219 OrionStarAI/OrionStar-Yi-34B-Chat 34.4B 62% Three-shot, text-only, float16, 2024-06-09 Jun 2024 huggingface.co Official leaderboard
220 Weyaxi/Einstein-v7-Qwen2-7B 7.6B 62% Three-shot, text-only, bfloat16, 2024-07-16 Jul 2024 huggingface.co Official leaderboard
221 GLM-4-9B-Chat-1M 61.9% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 Jun 2024 huggingface.co Official leaderboard
222 tiiuae/Falcon-H1-3B-Instruct 3.2B 61.9% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
223 Mistral-Nemo-Base-2407 61.8% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
224 NLPark/AnFeng_v3.1-Avocet 34.4B 61.8% Three-shot, text-only, float16, 2024-08-04 Aug 2024 huggingface.co Official leaderboard
225 MaziyarPanahi/calme-2.4-qwen2-7b 7.6B 61.8% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
226 allknowingroger/Ph3della5-14B 14B 61.8% Three-shot, text-only, float16, 2024-10-10 Oct 2024 huggingface.co Official leaderboard
227 macadeliccc/Samantha-Qwen-2-7B 7.6B 61.6% Three-shot, text-only, rev: 5905897, float16, 2024-07-17 Jul 2024 huggingface.co Official leaderboard
228 phi-3-small 7.4B 61.5% Three-shot, text-only, bfloat16, 2024-05-21 Apr 2024 May 2024 huggingface.co Official leaderboard
229 Phi-3-medium-128k-instruct 61.5% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 May 2024 huggingface.co Official leaderboard
230 mistralai/Mistral-Nemo-Instruct-2407 12.3B 61.5% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
231 speakleash/Bielik-11B-v2.0-Instruct 11.2B 61.5% Three-shot, text-only, bfloat16, 2024-10-17 Oct 2024 huggingface.co Official leaderboard
232 Llama 2-70B 61.3% Three-shot, text-only, float16, 2024-02-05 Jul 2023 Feb 2024 huggingface.co Official leaderboard
233 OpenBuddy/openbuddy-qwen1.5-32b-v21.2-32k 32.5B 61.3% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
234 InternLM2.5-20B-Chat 61.3% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 Aug 2024 huggingface.co Official leaderboard
235 Falcon3-7B-Instruct 61.3% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
236 informatiker/Qwen2-7B-Instruct-abliterated 7.6B 61.2% Three-shot, text-only, bfloat16, 2024-09-15 Sep 2024 huggingface.co Official leaderboard
237 MaziyarPanahi/calme-2.2-qwen2-7b 7.6B 61.2% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
238 natong19/Mistral-Nemo-Instruct-2407-abliterated 12.3B 61.2% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
239 Qwen2-7B 61.1% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 Jun 2024 huggingface.co Official leaderboard
240 Qwen2-7B-Instruct 61.1% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 Jun 2024 huggingface.co Official leaderboard
241 migtissera/Tess-v2.5-Phi-3-medium-128k-14B 14B 60.9% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
242 arcee-ai/Arcee-Spark 7.6B 60.9% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
243 Qwen1.5-14B-Chat 60.8% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 Feb 2024 huggingface.co Official leaderboard
244 nicolasdec/CabraQwen14b 14.2B 60.8% Three-shot, text-only, bfloat16, 2024-04-02 Apr 2024 huggingface.co Official leaderboard
245 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium 14B 60.8% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
246 lucianosb/boto-9B-it 9.2B 60.8% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
247 axolotl-ai-co/romulus-mistral-nemo-12b-simpo 12.3B 60.8% Three-shot, text-only, rev: 19e2c43, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
248 v000000/L3.1-Niitorm-8B-DPO-t0.0001 8B 60.8% Three-shot, text-only, float16, 2024-09-30 Sep 2024 huggingface.co Official leaderboard
249 Qwen3-4B-Thinking-2507 60.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
250 BAAI/Infinity-Instruct-3M-0625-Qwen2-7B 7.6B 60.6% Three-shot, text-only, bfloat16, 2024-07-16 Jul 2024 huggingface.co Official leaderboard
251 Aria 60.6% Three-shot, text-only, bfloat16, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
252 byroneverson/Mistral-Small-Instruct-2409-abliterated 22.3B 60.6% Three-shot, text-only, bfloat16, 2024-10-13 Oct 2024 huggingface.co Official leaderboard
253 jaspionjader/f-9-8b 8B 60.5% Three-shot, text-only, bfloat16, 2025-01-02 Jan 2025 huggingface.co Official leaderboard
254 natong19/Qwen2-7B-Instruct-abliterated 7.6B 60.4% Three-shot, text-only, bfloat16, 2024-06-19 Jun 2024 huggingface.co Official leaderboard
255 meta-llama/Llama-3.2-11B-Vision 10.6B 60.4% Three-shot, text-only, bfloat16, 2024-12-05 Dec 2024 huggingface.co Official leaderboard
256 argilla/notux-8x7b-v1 46.7B 60.2% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
257 CohereForAI/aya-23-35B 35B 60.2% Three-shot, text-only, float16, 2024-05-23 May 2024 huggingface.co Official leaderboard
258 mlabonne/NeuralDaredevil-8B-abliterated 8B 60.2% Three-shot, text-only, float16, 2024-05-28 May 2024 huggingface.co Official leaderboard
259 SeaLLMs/SeaLLMs-v3-7B-Chat 7.6B 60.2% Three-shot, text-only, bfloat16, 2024-07-28 Jul 2024 huggingface.co Official leaderboard
260 grimjim/Llama-3.1-8B-Instruct-abliterated_via_adapter 8B 60.2% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
261 Joseph717171/Llama-3.1-SuperNova-8B-Lite_TIES_with_Base 8B 60.2% Three-shot, text-only, bfloat16, 2024-10-04 Oct 2024 huggingface.co Official leaderboard
262 Sao10K/L3.1-8B-Niitama-v1.1 8B 60.2% Three-shot, text-only, float16, 2024-11-08 Nov 2024 huggingface.co Official leaderboard
263 vicgalle/CarbonBeagle-11B-truthy 10.7B 60.1% Three-shot, text-only, float16, 2024-05-17 May 2024 huggingface.co Official leaderboard
264 mlabonne/Daredevil-8B-abliterated 8B 60.1% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
265 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top25 8B 60.1% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 huggingface.co Official leaderboard
266 nbeerbower/mistral-nemo-wissenschaft-12B 12.3B 60.1% Three-shot, text-only, bfloat16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
267 arcee-ai/Llama-3.1-SuperNova-Lite 8B 60.1% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
268 tiiuae/Falcon3-7B-Base 7.5B 60.1% Three-shot, text-only, bfloat16, 2025-01-15 Jan 2025 huggingface.co Official leaderboard
269 Llama 3.1-8B 59.9% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 Jul 2024 huggingface.co Official leaderboard
270 mistralai/Mixtral-8x7B-Instruct-v0.1 46.7B 59.8% Three-shot, text-only, bfloat16, 2024-02-18 Feb 2024 huggingface.co Official leaderboard
271 WizardLMTeam/WizardLM-70B-V1.0 70B 59.8% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
272 cognitivecomputations/dolphin-2.9.2-Phi-3-Medium-abliterated 14B 59.8% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
273 JJhooww/Qwen2-7B_reload_v1 7.6B 59.8% Three-shot, text-only, float16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
274 THUDM/LongWriter-glm4-9b 9.4B 59.8% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
275 meta-llama/Llama-3.1-8B-Instruct 8B 59.8% Three-shot, text-only, float16, 2024-10-23 Oct 2024 huggingface.co Official leaderboard
276 ai21labs/Jamba-v0.1 51.6B 59.7% Three-shot, text-only, bfloat16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
277 cognitivecomputations/dolphin-2.9.2-qwen2-7b 7.6B 59.5% Three-shot, text-only, bfloat16, 2024-06-10 Jun 2024 huggingface.co Official leaderboard
278 Kukedlc/NeuralLLaMa-3-8b-DT-v0.1 8B 59.4% Three-shot, text-only, float16, 2024-05-17 May 2024 huggingface.co Official leaderboard
279 bunnycore/HyperLlama-3.1-8B 8B 59.4% Three-shot, text-only, bfloat16, 2024-09-05 Sep 2024 huggingface.co Official leaderboard
280 failspy/Phi-3-medium-4k-instruct-abliterated-v3 14B 59.3% Three-shot, text-only, bfloat16, 2024-05-25 May 2024 huggingface.co Official leaderboard
281 MaziyarPanahi/Llama-3-8B-Instruct-v0.8 8B 59.3% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
282 Llama 3.2 11B 59.3% Three-shot, text-only, bfloat16, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
283 princeton-nlp/gemma-2-9b-it-DPO 9.2B 59.3% Three-shot, text-only, rev: 422941a, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
284 RDson/WomboCombo-R1-Coder-14B-Preview 14.8B 59.3% Three-shot, text-only, bfloat16, 2025-02-06 Feb 2025 huggingface.co Official leaderboard
285 rhaymison/Mistral-8x7b-portuguese-luana 46.7B 59.1% Three-shot, text-only, float16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
286 mlabonne/ChimeraLlama-3-8B-v3 8B 59.1% Three-shot, text-only, float16, 2024-08-06 Aug 2024 huggingface.co Official leaderboard
287 upstage/SOLAR-10.7B-v1.0 10.7B 59% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
288 vicgalle/ConfigurableBeagle-11B 10.7B 59% Three-shot, text-only, rev: bbc16db, float16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
289 recogna-nlp/Bode-3.1-8B-Instruct-full 8B 59% Three-shot, text-only, rev: oldalpaca, float16, 2024-08-31 Aug 2024 huggingface.co Official leaderboard
290 deepcogito/cogito-v1-preview-llama-8B 8B 59% Three-shot, text-only, bfloat16, 2025-04-09 Apr 2025 huggingface.co Official leaderboard
291 tiiuae/Falcon-H1-3B-Base 3.2B 59% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
292 lightblue/suzume-llama-3-8B-multilingual 8B 58.8% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
293 uygarkurt/llama-3-merged-linear 8B 58.8% Three-shot, text-only, float16, 2024-05-13 May 2024 huggingface.co Official leaderboard
294 DeepMount00/Llama-3-8b-Ita 8B 58.8% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
295 meta-llama/Meta-Llama-3.1-8B-Instruct 8B 58.8% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
296 BAAI/Infinity-Instruct-3M-0625-Yi-1.5-9B 8.8B 58.8% Three-shot, text-only, rev: a42c86c, bfloat16, 2024-08-01 Aug 2024 huggingface.co Official leaderboard
297 BAAI/Infinity-Instruct-7M-0729-Llama3_1-8B 8B 58.8% Three-shot, text-only, bfloat16, 2024-08-05 Aug 2024 huggingface.co Official leaderboard
298 BAAI/Infinity-Instruct-7M-Gen-Llama3_1-8B 8B 58.8% Three-shot, text-only, bfloat16, 2024-08-22 Aug 2024 huggingface.co Official leaderboard
299 v000000/SwallowMaid-8B-L3-SPPO-abliterated 8B 58.8% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
300 Gemini 1.0 Pro 58.7% Three-shot, text-only, 2024-03-08 Dec 2023 Mar 2024 ai.google.dev Official leaderboard
301 OrionStarAI/Orion-14B-Base 14.5B 58.7% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
302 recogna-nlp/internlm-chatbode-20b 19.9B 58.7% Three-shot, text-only, float16, 2024-05-07 May 2024 huggingface.co Official leaderboard
303 internlm/internlm2_5-7b-chat-1m 7.7B 58.7% Three-shot, text-only, bfloat16, 2024-07-05 Jul 2024 huggingface.co Official leaderboard
304 vicgalle/Configurable-Llama-3.1-8B-Instruct 8B 58.7% Three-shot, text-only, float16, 2024-08-03 Aug 2024 huggingface.co Official leaderboard
305 freewheelin/free-llama3-dpo-v0.2 8B 58.7% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
306 Eurdem/Defne-llama3.1-8B 8B 58.7% Three-shot, text-only, bfloat16, 2024-08-13 Aug 2024 huggingface.co Official leaderboard
307 unsloth/Meta-Llama-3.1-70B-bnb-4bit 70.6B 58.7% Three-shot, text-only, 4bit, 2024-08-13 Aug 2024 huggingface.co Official leaderboard
308 internlm/internlm2-20b 20B 58.5% Three-shot, text-only, bfloat16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
309 PrunaAI/Jamba-v0.1-bnb-4bit 51.6B 58.5% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
310 VAGOsolutions/Llama-3-SauerkrautLM-8b-Instruct 8B 58.5% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
311 shadowml/Mixolar-4x7b 36.1B 58.5% Three-shot, text-only, float16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
312 OpenBuddy/openbuddy-qwen2.5llamaify-7b-v23.1-200k 7.6B 58.5% Three-shot, text-only, bfloat16, 2024-10-10 Oct 2024 huggingface.co Official leaderboard
313 speakleash/Bielik-11B-v2 11.2B 58.5% Three-shot, text-only, bfloat16, 2024-10-16 Oct 2024 huggingface.co Official leaderboard
314 invalid-coder/Sakura-SOLAR-Instruct-CarbonVillain-en-10.7B-v2-slerp 10.7B 58.4% Three-shot, text-only, float16, 2024-05-16 May 2024 huggingface.co Official leaderboard
315 VAGOsolutions/SauerkrautLM-Nemo-12b-Instruct 12.3B 58.4% Three-shot, text-only, bfloat16, 2024-07-29 Jul 2024 huggingface.co Official leaderboard
316 MaziyarPanahi/Llama-3-8B-Instruct-v0.10 8B 58.4% Three-shot, text-only, bfloat16, 2024-08-13 Aug 2024 huggingface.co Official leaderboard
317 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Base-Rule 7.6B 58.4% Three-shot, text-only, bfloat16, 2025-03-07 Mar 2025 huggingface.co Official leaderboard
318 SOLAR-10.7B-Instruct-v1.0 58.3% Three-shot, text-only, float16, 2024-02-19 Dec 2023 Feb 2024 huggingface.co Official leaderboard
319 unsloth/llama-3-70b-bnb-4bit 70.6B 58.3% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
320 Danielbrdz/Barcenas-Llama3-8b-ORPO 8B 58.3% Three-shot, text-only, float16, 2024-05-13 May 2024 huggingface.co Official leaderboard
321 MaziyarPanahi/Llama-3-8B-Instruct-v0.9 8B 58.3% Three-shot, text-only, bfloat16, 2024-08-13 Aug 2024 huggingface.co Official leaderboard
322 princeton-nlp/Llama-3-Instruct-8B-CPO-v0.2 8B 58.3% Three-shot, text-only, rev: 5ed8372, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
323 princeton-nlp/Llama-3-Instruct-8B-DPO-v0.2 8B 58.3% Three-shot, text-only, rev: d06275e, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
324 princeton-nlp/Llama-3-Instruct-8B-ORPO-v0.2 8B 58.3% Three-shot, text-only, rev: 3ea5c54, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
325 princeton-nlp/Llama-3-Instruct-8B-RDPO-v0.2 8B 58.3% Three-shot, text-only, rev: 4e5bc97, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
326 kekmodel/StopCarbon-10.7B-v5 10.7B 58.1% Three-shot, text-only, float16, 2024-05-16 May 2024 huggingface.co Official leaderboard
327 DeepMount00/Llama-3.1-8b-Ita 8B 58.1% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
328 princeton-nlp/Llama-3-Instruct-8B-RRHF-v0.2 8B 58.1% Three-shot, text-only, rev: 81191fb, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
329 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF-v0.2 8B 58.1% Three-shot, text-only, rev: 1821cc4, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
330 jeonsworld/CarbonVillain-en-10.7B-v4 10.7B 58% Three-shot, text-only, bfloat16, 2024-04-26 Apr 2024 huggingface.co Official leaderboard
331 rhaymison/Llama-3-portuguese-Tom-cat-8b-instruct 8B 58% Three-shot, text-only, float16, 2024-04-30 Apr 2024 huggingface.co Official leaderboard
332 saltlux/luxia-21.4b-alignment-v1.0 21.4B 58% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
333 failspy/Meta-Llama-3-8B-Instruct-abliterated-v3 8B 58% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
334 saltlux/luxia-21.4b-alignment-v1.2 21.4B 58% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
335 RLHFlow/LLaMA3-iterative-DPO-final 8B 58% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
336 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter3 8B 58% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
337 dnhkng/RYS-Llama-3.1-8B-Instruct 8.7B 58% Three-shot, text-only, bfloat16, 2024-08-22 Aug 2024 huggingface.co Official leaderboard
338 internlm/internlm2-chat-20b 20B 57.9% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
339 openchat/openchat-3.5-0106-gemma 8.5B 57.9% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
340 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.3 8.1B 57.9% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
341 vicgalle/ConfigurableSOLAR-10.7B 10.7B 57.9% Three-shot, text-only, rev: c5c844a, float16, 2024-08-25 Aug 2024 huggingface.co Official leaderboard
342 Qwen2.5-Coder (7B) 57.9% Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 Sep 2024 Oct 2024 huggingface.co Official leaderboard
343 01-ai/Yi-1.5-9B 8.8B 57.7% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
344 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-top75 8B 57.7% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 huggingface.co Official leaderboard
345 UCLA-AGI/Llama-3-Instruct-8B-SPPO-Iter2 8B 57.7% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
346 Dampfinchen/Llama-3.1-8B-Ultra-Instruct 8B 57.7% Three-shot, text-only, bfloat16, 2024-09-16 Sep 2024 huggingface.co Official leaderboard
347 princeton-nlp/Llama-3-Instruct-8B-CPO 8B 57.7% Three-shot, text-only, rev: d4645ae, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
348 ibivibiv/llama-3-nectar-dpo-8B 8B 57.6% Three-shot, text-only, bfloat16, 2024-06-22 Jun 2024 huggingface.co Official leaderboard
349 princeton-nlp/Llama-3-Instruct-8B-KTO 8B 57.6% Three-shot, text-only, rev: e697908, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
350 anthracite-org/magnum-v2.5-12b-kto 12.3B 57.6% Three-shot, text-only, rev: aee0374, float16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
351 Sao10K/L3-8B-Niitama-v1 8B 57.6% Three-shot, text-only, float16, 2024-12-18 Dec 2024 huggingface.co Official leaderboard
352 VAGOsolutions/Llama-3.1-SauerkrautLM-8b-Instruct 8B 57.4% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
353 migtissera/Trinity-2-Codestral-22B 22.3B 57.4% Three-shot, text-only, bfloat16, 2024-09-16 Sep 2024 huggingface.co Official leaderboard
354 princeton-nlp/Llama-3-Instruct-8B-RDPO 8B 57.4% Three-shot, text-only, rev: 9497ca2, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
355 Llama 3-8B 57.3% Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 Apr 2024 Apr 2024 huggingface.co Official leaderboard
356 internlm/internlm2-chat-20b-sft 19.9B 57.3% Three-shot, text-only, bfloat16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
357 mlabonne/Llama-3-8B-Instruct-abliterated-dpomix 8B 57.3% Three-shot, text-only, float16, 2024-05-27 May 2024 huggingface.co Official leaderboard
358 princeton-nlp/Llama-3-Instruct-8B-SimPO 8B 57.3% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
359 grimjim/Llama-3-Instruct-8B-SPPO-Iter3-SimPO-merge 8B 57.3% Three-shot, text-only, bfloat16, 2024-08-08 Aug 2024 huggingface.co Official leaderboard
360 recogna-nlp/Bode-3.1-8B-Instruct-lora 8.1B 57.3% Three-shot, text-only, float16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
361 EpistemeAI2/Fireball-Llama-3.1-8B-Philos-Relection 8B 57.3% Three-shot, text-only, rev: 22257d3, float16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
362 princeton-nlp/Llama-3-Instruct-8B-KTO-v0.2 8B 57.3% Three-shot, text-only, rev: 477d33e, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
363 princeton-nlp/Llama-3-Instruct-8B-IPO-v0.2 8B 57.3% Three-shot, text-only, rev: 24601cd, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
364 princeton-nlp/Llama-3-Instruct-8B-RRHF 8B 57.3% Three-shot, text-only, rev: 73561d9, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
365 Granite-3.1-8B-Instruct 57.3% Three-shot, text-only, float16, 2025-08-29 Dec 2024 Aug 2025 huggingface.co Official leaderboard
366 MagusCorp/grpo_lora_enem_llama3_7b 8B 57.3% Three-shot, text-only, float16, 2025-02-11 Feb 2025 huggingface.co Official leaderboard
367 recogna-nlp/gembode-7b 8.7B 57.2% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
368 unsloth/llama-3-8b-Instruct-bnb-4bit 8B 57.2% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
369 vicgalle/Configurable-Llama-3-8B-v0.3 8B 57.2% Three-shot, text-only, float16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
370 princeton-nlp/Llama-3-Instruct-8B-DPO 8B 57.2% Three-shot, text-only, rev: 0afbf4c, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
371 tiiuae/Falcon-H1-1.5B-Deep-Instruct 1.6B 57.2% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
372 NousResearch/Hermes-2-Pro-Llama-3-8B 8B 57% Three-shot, text-only, float16, 2024-05-06 May 2024 huggingface.co Official leaderboard
373 01-ai/Yi-1.5-9B-32K 8.8B 57% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
374 NousResearch/Hermes-2-Theta-Llama-3-8B 8B 57% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
375 arthrod/cicerollamatry8 8B 57% Three-shot, text-only, float16, 2024-05-29 May 2024 huggingface.co Official leaderboard
376 maywell/Qwen2-7B-Multilingual-RP 7.6B 57% Three-shot, text-only, bfloat16, 2024-07-24 Jul 2024 huggingface.co Official leaderboard
377 botbot-ai/CabraLlama3-8b 8B 56.9% Three-shot, text-only, bfloat16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
378 jondurbin/bagel-8b-v1.0 8B 56.9% Three-shot, text-only, bfloat16, 2024-05-18 May 2024 huggingface.co Official leaderboard
379 vicgalle/Configurable-Hermes-2-Pro-Llama-3-8B 8B 56.9% Three-shot, text-only, float16, 2024-06-12 Jun 2024 huggingface.co Official leaderboard
380 BAAI/Infinity-Instruct-3M-0625-Llama3-8B 8B 56.9% Three-shot, text-only, bfloat16, 2024-07-18 Jul 2024 huggingface.co Official leaderboard
381 EpistemeAI/Fireball-Alpaca-Llama3.1.07-8B-Philos-Math-KTO-beta 8B 56.9% Three-shot, text-only, rev: ef37828, float16, 2024-09-15 Sep 2024 huggingface.co Official leaderboard
382 MaziyarPanahi/calme-2.7-qwen2-7b 7.6B 56.9% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
383 Qwen/Qwen2.5-3B-Instruct 3.1B 56.9% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
384 Phi-4-reasoning 56.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
385 qnguyen3/Master-Yi-9B 8.8B 56.8% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
386 OpenBuddy/openbuddy-qwen1.5-32b-v21.1-32k 32.5B 56.8% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
387 tobiaspires/command-r-p11-fn 35B 56.8% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
388 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.4 8.8B 56.8% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
389 EpistemeAI2/Fireball-Alpaca-Llama-3.1-8B-Instruct-KTO-beta 8B 56.8% Three-shot, text-only, rev: 010aaa1, float16, 2024-09-13 Sep 2024 huggingface.co Official leaderboard
390 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R1-KTO-beta 8B 56.8% Three-shot, text-only, float16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
391 grimjim/Llama-3-Instruct-8B-SimPO-SPPO-Iter3-merge 8B 56.8% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
392 01-ai/Yi-1.5-9B-Chat-16K 8.8B 56.6% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
393 chujiezheng/Llama-3-Instruct-8B-SimPO-ExPO 8B 56.6% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
394 microsoft/Phi-3.5-mini-instruct 3.8B 56.6% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
395 Gemma 7B 56.5% Three-shot, text-only, bfloat16, 2024-02-21 Feb 2024 Feb 2024 huggingface.co Official leaderboard
396 EpistemeAI/Fireball-Alpaca-Llama-3.1-8B-Philos-DPO-200 8B 56.5% Three-shot, text-only, float16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
397 TIGER-Lab/AceCoder-Qwen2.5-Coder-7B-Ins-Rule 7.6B 56.5% Three-shot, text-only, bfloat16, 2025-03-07 Mar 2025 huggingface.co Official leaderboard
398 rishiraj/CatPPT 7.2B 56.3% Three-shot, text-only, bfloat16, 2024-02-25 Feb 2024 huggingface.co Official leaderboard
399 VAGOsolutions/SauerkrautLM-Gemma-7b 8.5B 56.3% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
400 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.2 8.8B 56.3% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
401 NousResearch/Hermes-3-Llama-3.1-8B 8B 56.3% Three-shot, text-only, bfloat16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
402 leafspark/Llama-3.1-8B-MultiReflection-Instruct 8B 56.3% Three-shot, text-only, float16, 2024-09-16 Sep 2024 huggingface.co Official leaderboard
403 Qwen/Qwen2.5-Coder-7B-Instruct 7.6B 56.3% Three-shot, text-only, bfloat16, 2024-10-13 Oct 2024 huggingface.co Official leaderboard
404 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.1 8.8B 56.2% Three-shot, text-only, bfloat16, 2024-07-09 Jul 2024 huggingface.co Official leaderboard
405 vicgalle/Configurable-Hermes-3-Llama-3.1-8B 8B 56.2% Three-shot, text-only, float16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
406 MaziyarPanahi/calme-2.3-qwen2-7b 7.6B 56.2% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
407 mistralai/Ministral-8B-Instruct-2410 8B 56.2% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
408 cognitivecomputations/Dolphin3.0-R1-Mistral-24B 23.6B 56.2% Three-shot, text-only, bfloat16, 2025-02-11 Feb 2025 huggingface.co Official leaderboard
409 NousResearch/Nous-Hermes-2-SOLAR-10.7B 10.7B 56% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
410 nicolasdec/CabraQwen7b 7.7B 56% Three-shot, text-only, bfloat16, 2024-04-02 Apr 2024 huggingface.co Official leaderboard
411 tiiuae/Falcon-H1-1.5B-Deep-Base 1.6B 56% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
412 rishiraj/CatPPT-base 7.2B 55.9% Three-shot, text-only, float16, 2024-02-25 Feb 2024 huggingface.co Official leaderboard
413 cognitivecomputations/dolphin-2.9.1-yi-1.5-9b 8.8B 55.9% Three-shot, text-only, bfloat16, 2024-05-25 May 2024 huggingface.co Official leaderboard
414 internlm/internlm2_5-7b-chat 7.7B 55.9% Three-shot, text-only, bfloat16, 2024-07-05 Jul 2024 huggingface.co Official leaderboard
415 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.3 8.8B 55.9% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
416 arcee-ai/Arcee-Scribe 7.7B 55.9% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
417 princeton-nlp/Llama-3-Instruct-8B-SimPO-v0.2 8B 55.9% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
418 EpistemeAI2/Fireball-Alpaca-Llama3.1.06-8B-Philos 8B 55.9% Three-shot, text-only, float16, 2024-09-09 Sep 2024 huggingface.co Official leaderboard
419 Phi-4-Reasoning-plus 55.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
420 vicgalle/CarbonBeagle-11B 10.7B 55.8% Three-shot, text-only, float16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
421 microsoft/MediPhi 3.8B 55.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
422 Starling-LM-7B-alpha 55.6% Three-shot, text-only, bfloat16, 2024-03-04 Nov 2023 Mar 2024 huggingface.co Official leaderboard
423 SeaLLMs/SeaLLM-7B-v2.5 8.5B 55.6% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
424 princeton-nlp/Llama-3-8B-ProLong-512k-Instruct 8B 55.6% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
425 princeton-nlp/Llama-3-8B-ProLong-64k-Base 8B 55.6% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
426 Qwen-14B 55.5% Three-shot, text-only, float16, 2024-04-18 Sep 2023 Apr 2024 huggingface.co Official leaderboard
427 Sabiá-2 Small 55.5% Three-shot, text-only, 2024-04-12 Apr 2024 maritaca.ai Official leaderboard
428 lemon-mint/gemma-ko-7b-instruct-v0.62 8.5B 55.5% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
429 wenbopan/Faro-Yi-9B 8.8B 55.5% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
430 OpenBuddy/openbuddy-llama3.1-8b-v22.3-131k 8B 55.5% Three-shot, text-only, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
431 princeton-nlp/Llama-3-Instruct-8B-IPO 8B 55.5% Three-shot, text-only, rev: fbe883f, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
432 princeton-nlp/Llama-3-Instruct-8B-SLiC-HF 8B 55.5% Three-shot, text-only, rev: 7e9001f, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
433 LLaMA-65B 55.4% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
434 Nous-Hermes-2-Mixtral-8x7B-DPO 55.4% Three-shot, text-only, bfloat16, 2024-02-27 Jan 2024 Feb 2024 huggingface.co Official leaderboard
435 wenbopan/Faro-Yi-9B-DPO 8.8B 55.2% Three-shot, text-only, rev: 58a4349, float16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
436 Magpie-Align/Llama-3.1-8B-Magpie-Align-SFT-v0.1 8B 55.2% Three-shot, text-only, bfloat16, 2024-08-06 Aug 2024 huggingface.co Official leaderboard
437 terrycraddock/Reflection-Llama-3.1-8B 8B 55.2% Three-shot, text-only, float16, 2024-09-15 Sep 2024 huggingface.co Official leaderboard
438 migtissera/Trinity-2-Codestral-22B-v0.2 22.3B 55.2% Three-shot, text-only, bfloat16, 2024-09-16 Sep 2024 huggingface.co Official leaderboard
439 MaziyarPanahi/calme-2.1-qwen2-7b 7.6B 55.2% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
440 vicgalle/Configurable-Yi-1.5-9B-Chat 8.8B 55.1% Three-shot, text-only, float16, 2024-05-29 May 2024 huggingface.co Official leaderboard
441 meraGPT/mera-mix-4x7B 24.2B 55.1% Three-shot, text-only, bfloat16, 2024-06-10 Jun 2024 huggingface.co Official leaderboard
442 BAAI/Infinity-Instruct-3M-0625-Mistral-7B 7.2B 55.1% Three-shot, text-only, bfloat16, 2024-07-18 Jul 2024 huggingface.co Official leaderboard
443 Yi-9B 54.9% Three-shot, text-only, bfloat16, 2024-04-13 Mar 2024 Apr 2024 huggingface.co Official leaderboard
444 FuseAI/FuseChat-7B-VaRM 7.2B 54.9% Three-shot, text-only, bfloat16, 2024-03-04 Mar 2024 huggingface.co Official leaderboard
445 unsloth/llama-3-8b-bnb-4bit 8B 54.9% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
446 princeton-nlp/Llama-3-8B-ProLong-64k-Instruct 8B 54.9% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
447 internlm/internlm2-base-20b 20B 54.8% Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
448 Yi-1.5-9B-Chat 54.8% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 May 2024 huggingface.co Official leaderboard
449 ibivibiv/multimaster-7b-v6 35.4B 54.8% Three-shot, text-only, bfloat16, 2024-06-08 Jun 2024 huggingface.co Official leaderboard
450 MaziyarPanahi/Topxtral-4x7B-v0.1 18.5B 54.8% Three-shot, text-only, bfloat16, 2024-06-10 Jun 2024 huggingface.co Official leaderboard
451 Kukedlc/NeuralSynthesis-7B-v0.1 7.2B 54.8% Three-shot, text-only, bfloat16, 2024-06-12 Jun 2024 huggingface.co Official leaderboard
452 jsfs11/MixtureofMerges-MoE-4x7b-v5 24.2B 54.8% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
453 mistralai/Codestral-22B-v0.1 22.3B 54.8% Three-shot, text-only, bfloat16, 2024-07-02 Jul 2024 huggingface.co Official leaderboard
454 cognitivecomputations/laserxtral 24.2B 54.8% Three-shot, text-only, bfloat16, 2024-07-31 Jul 2024 huggingface.co Official leaderboard
455 freewheelin/free-solar-evo-v0.1 10.7B 54.8% Three-shot, text-only, float16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
456 FuseAI/OpenChat-3.5-7B-Solar 7.2B 54.7% Three-shot, text-only, bfloat16, 2024-03-04 Mar 2024 huggingface.co Official leaderboard
457 kevin009/llamaRAGdrama 7.2B 54.7% Three-shot, text-only, float16, 2024-05-30 May 2024 huggingface.co Official leaderboard
458 cognitivecomputations/WestLake-7B-v2-laser 7.2B 54.7% Three-shot, text-only, bfloat16, 2024-07-31 Jul 2024 huggingface.co Official leaderboard
459 freewheelin/free-solar-evo-v0.13 10.7B 54.7% Three-shot, text-only, float16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
460 princeton-nlp/Llama-3-Instruct-8B-ORPO 8B 54.7% Three-shot, text-only, rev: 4bb3ffc, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
461 Kukedlc/NeuralSynthesis-7b-v0.4-slerp 7.2B 54.5% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
462 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.5 8.8B 54.5% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
463 liminerity/M7-7b 7.2B 54.5% Three-shot, text-only, bfloat16, 2024-07-13 Jul 2024 huggingface.co Official leaderboard
464 freewheelin/free-solar-evo-v0.11 10.7B 54.5% Three-shot, text-only, float16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
465 Magpie-Align/MagpieLM-8B-SFT-v0.1 8B 54.5% Three-shot, text-only, rev: b91f605, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
466 rombodawg/rombos_Replete-Coder-Instruct-8b-Merged 8B 54.5% Three-shot, text-only, bfloat16, 2024-10-14 Oct 2024 huggingface.co Official leaderboard
467 paulml/OGNO-7B 7.2B 54.4% Three-shot, text-only, bfloat16, 2024-02-25 Feb 2024 huggingface.co Official leaderboard
468 MaziyarPanahi/Mistral-7B-Instruct-Aya-101 7.2B 54.4% Three-shot, text-only, bfloat16, 2024-04-17 Apr 2024 huggingface.co Official leaderboard
469 J-LAB/BRisa-7B-Instruct-v0.2 7.2B 54.4% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
470 Kquant03/CognitiveFusion2-4x7B-BF16 24.2B 54.4% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
471 NotAiLOL/Yi-1.5-dolphin-9B 8.8B 54.4% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
472 01-ai/Yi-9B-200K 8.8B 54.4% Three-shot, text-only, rev: v20240318, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
473 allknowingroger/MultiverseEx26-7B-slerp 7.2B 54.4% Three-shot, text-only, bfloat16, 2024-07-03 Jul 2024 huggingface.co Official leaderboard
474 EpistemeAI/Fireball-3.1-8B-ORPO 8.1B 54.4% Three-shot, text-only, bfloat16, 2024-08-26 Aug 2024 huggingface.co Official leaderboard
475 Aya Expanse 8B 54.4% Three-shot, text-only, float16, 2024-10-24 Oct 2024 Oct 2024 huggingface.co Official leaderboard
476 bardsai/jaskier-7b-dpo-v5.6 7.2B 54.2% Three-shot, text-only, bfloat16, 2024-02-25 Feb 2024 huggingface.co Official leaderboard
477 teknium/OpenHermes-2-Mistral-7B 7.2B 54.2% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
478 automerger/YamshadowExperiment28-7B 7.2B 54.2% Three-shot, text-only, bfloat16, 2024-05-30 May 2024 huggingface.co Official leaderboard
479 Kukedlc/NeuralSynthesis-7B-v0.3 7.2B 54.2% Three-shot, text-only, bfloat16, 2024-07-29 Jul 2024 huggingface.co Official leaderboard
480 TIGER-Lab/AceCodeRM-7B 7.6B 54.2% Three-shot, text-only, bfloat16, 2025-03-07 Mar 2025 huggingface.co Official leaderboard
481 Qwen1.5-32B 54.1% Three-shot, text-only, bfloat16, 2024-04-08 Feb 2024 Apr 2024 huggingface.co Official leaderboard
482 NousResearch/Nous-Hermes-2-Mistral-7B-DPO 7.2B 54.1% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
483 stabilityai/stablelm-2-12b 12.1B 54.1% Three-shot, text-only, bfloat16, 2024-04-08 Apr 2024 huggingface.co Official leaderboard
484 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.1 8B 54.1% Three-shot, text-only, bfloat16, 2024-04-20 Apr 2024 huggingface.co Official leaderboard
485 Phi-3-mini-128k-instruct 54.1% Three-shot, text-only, bfloat16, 2024-04-23 Apr 2024 Apr 2024 huggingface.co Official leaderboard
486 zhengr/MixTAO-7Bx2-MoE-v8.1 12.9B 54.1% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
487 jsfs11/MixtureofMerges-MoE-4x7b-v4 24.2B 54.1% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
488 J-LAB/FluxiIA-Small 7.2B 54.1% Three-shot, text-only, float16, 2024-11-19 Nov 2024 huggingface.co Official leaderboard
489 JJhooww/Mistral-7B-v0.2-Base_ptbr 7.2B 54% Three-shot, text-only, float16, 2024-04-13 Apr 2024 huggingface.co Official leaderboard
490 phi-3-mini 3.8B 54% Three-shot, text-only, bfloat16, 2024-04-23 Apr 2024 Apr 2024 huggingface.co Official leaderboard
491 princeton-nlp/Llama-3-Base-8B-SFT-ORPO 8B 54% Three-shot, text-only, rev: 54d5840, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
492 princeton-nlp/Llama-3-Base-8B-SFT-RDPO 8B 54% Three-shot, text-only, rev: b41a964, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
493 EpistemeAI/Polypsyche-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto-Logic 8B 54% Three-shot, text-only, float16, 2024-12-13 Dec 2024 huggingface.co Official leaderboard
494 Starling-LM-7B-beta 53.8% Three-shot, text-only, bfloat16, 2024-03-29 Mar 2024 Mar 2024 huggingface.co Official leaderboard
495 Walmart-the-bag/Misted-v2-7B 7.2B 53.8% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
496 adalbertojunior/Llama-3-8B-Dolphin-Portuguese-v0.2 8B 53.8% Three-shot, text-only, bfloat16, 2024-04-30 Apr 2024 huggingface.co Official leaderboard
497 internlm/internlm2-wqx-20b 19.9B 53.8% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
498 princeton-nlp/Llama-3-Base-8B-SFT-RRHF 8B 53.8% Three-shot, text-only, rev: aea8c04, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
499 kurakurai/Luth-1.7B-Instruct 1.7B 53.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
500 utter-project/EuroLLM-9B-Instruct 9.2B 53.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
501 Walmart-the-bag/WordWoven-2x7B 12.9B 53.7% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
502 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.3 8B 53.7% Three-shot, text-only, bfloat16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
503 adalbertojunior/Llama-3-8B-Dolphin-Portuguese 8B 53.7% Three-shot, text-only, bfloat16, 2024-04-27 Apr 2024 huggingface.co Official leaderboard
504 abacusai/Slerp-CM-mist-dpo 7.2B 53.7% Three-shot, text-only, float16, 2024-09-05 Sep 2024 huggingface.co Official leaderboard
505 ValiantLabs/Llama3.1-8B-Cobalt 8B 53.7% Three-shot, text-only, bfloat16, 2024-10-04 Oct 2024 huggingface.co Official leaderboard
506 princeton-nlp/Llama-3-Base-8B-SFT-SLiC-HF 8B 53.7% Three-shot, text-only, rev: 325092c, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
507 HuggingFaceTB/SmolLM3-3B-Base 3.1B 53.7% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
508 01-ai/Yi-9B-200k 8.8B 53.5% Three-shot, text-only, bfloat16, 2024-04-13 Apr 2024 huggingface.co Official leaderboard
509 eduagarcia/mistral-orpo-mix-21k 7.2B 53.5% Three-shot, text-only, bfloat16, 2024-05-06 May 2024 huggingface.co Official leaderboard
510 EpistemeAI/Fireball-Meta-Llama-3.1-8B-Instruct-Agent-0.003-128K-code-ds-auto 8B 53.5% Three-shot, text-only, float16, 2024-11-04 Nov 2024 huggingface.co Official leaderboard
511 kaist-ai/mistral-orpo-capybara-7k 7.2B 53.4% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
512 yunconglong/Truthful_DPO_TomGrc_FusionNet_7Bx2_MoE_13B 12.9B 53.4% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
513 CultriX/NeuralMona_MoE-4x7B 24.2B 53.4% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
514 Salesforce/SFR-Iterative-DPO-LLaMA-3-8B-R 8B 53.4% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
515 RubielLabarta/LogoS-7Bx2-MoE-13B-v0.2 12.9B 53.4% Three-shot, text-only, bfloat16, 2024-07-03 Jul 2024 huggingface.co Official leaderboard
516 Magpie-Align/Llama-3-8B-Magpie-Align-SFT-v0.3 8B 53.4% Three-shot, text-only, bfloat16, 2024-08-06 Aug 2024 huggingface.co Official leaderboard
517 mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated 8B 53.4% Three-shot, text-only, bfloat16, 2024-09-10 Sep 2024 huggingface.co Official leaderboard
518 princeton-nlp/Mistral-7B-Instruct-SimPO 7.2B 53.4% Three-shot, text-only, rev: 03191ee, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
519 princeton-nlp/Llama-3-Base-8B-SFT-DPO 8B 53.4% Three-shot, text-only, rev: 3f5ec47, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
520 BAAI/Infinity-Instruct-3M-0613-Mistral-7B 7.2B 53.3% Three-shot, text-only, float16, 2024-06-22 Jun 2024 huggingface.co Official leaderboard
521 J-LAB/Nemo_RolePlay_PTBR_new 12.3B 53.3% Three-shot, text-only, float16, 2024-09-10 Sep 2024 huggingface.co Official leaderboard
522 EpistemeAI/Fireball-Alpaca-Llama3.1.08-8B-Philos-C-R2 8B 53.3% Three-shot, text-only, float16, 2024-09-14 Sep 2024 huggingface.co Official leaderboard
523 byroneverson/Yi-1.5-9B-Chat-16K-abliterated 8.8B 53.3% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
524 Mistral 7B v0.2 53.1% Three-shot, text-only, bfloat16, 2024-04-17 Dec 2023 Apr 2024 huggingface.co Official leaderboard
525 eduagarcia/zephyr-pt-phi-3-mini-128k-orpo-v0.1 3.8B 53.1% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
526 mistralai/Mistral-7B-Instruct-v0.3 7.3B 53.1% Three-shot, text-only, bfloat16, 2024-05-22 May 2024 huggingface.co Official leaderboard
527 MaziyarPanahi/Mistral-7B-Instruct-v0.3 7.3B 53.1% Three-shot, text-only, bfloat16, 2024-05-26 May 2024 huggingface.co Official leaderboard
528 yunconglong/MoE_13B_DPO 12.9B 53.1% Three-shot, text-only, bfloat16, 2024-07-03 Jul 2024 huggingface.co Official leaderboard
529 cognitivecomputations/openchat-3.5-0106-laser 7.2B 53.1% Three-shot, text-only, bfloat16, 2024-07-31 Jul 2024 huggingface.co Official leaderboard
530 Magpie-Align/Llama-3-8B-Magpie-Align-v0.3 8B 53.1% Three-shot, text-only, bfloat16, 2024-08-06 Aug 2024 huggingface.co Official leaderboard
531 leliuga/Phi-3-mini-4k-instruct-bnb-4bit 3.8B 53% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
532 princeton-nlp/Llama-3-Base-8B-SFT-CPO 8B 53% Three-shot, text-only, rev: 536ce7e, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
533 utter-project/EuroLLM-9B 9.2B 53% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
534 teknium/OpenHermes-2.5-Mistral-7B 7.2B 52.9% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
535 unsloth/Phi-3-mini-4k-instruct-bnb-4bit 3.8B 52.9% Three-shot, text-only, 4bit, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
536 DeepSeek-R1-Distill-Qwen-7B 52.9% Three-shot, text-only, bfloat16, 2025-01-28 Jan 2025 Jan 2025 huggingface.co Official leaderboard
537 tiiuae/Falcon-H1-1.5B-Instruct 1.6B 52.9% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
538 openchat/openchat-3.5-0106 7.2B 52.7% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
539 eduagarcia/zephyr-pt-phi-3-mini-128k-sft-v0.1 3.8B 52.7% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
540 Kukedlc/NeuralExperiment-7b-MagicCoder-v7.5 7.2B 52.7% Three-shot, text-only, float16, 2024-07-27 Jul 2024 huggingface.co Official leaderboard
541 Magpie-Align/MagpieLM-8B-Chat-v0.1 8B 52.7% Three-shot, text-only, rev: 0b30eab, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
542 princeton-nlp/Llama-3-Base-8B-SFT-IPO 8B 52.7% Three-shot, text-only, rev: 85055cc, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
543 princeton-nlp/Mistral-7B-Instruct-KTO 7.2B 52.7% Three-shot, text-only, rev: 834422e, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
544 internlm-20b 52.6% Three-shot, text-only, bfloat16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
545 mlabonne/Monarch-7B 7.2B 52.6% Three-shot, text-only, bfloat16, 2024-02-25 Feb 2024 huggingface.co Official leaderboard
546 JJhooww/Mistral_Relora_Step2k 7.2B 52.6% Three-shot, text-only, float16, 2024-03-08 Mar 2024 huggingface.co Official leaderboard
547 princeton-nlp/Llama-3-Base-8B-SFT-SimPO 8B 52.6% Three-shot, text-only, rev: 0a6e518, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
548 Qwen/Qwen2.5-1.5B-Instruct 1.5B 52.6% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
549 utter-project/EuroLLM-22B-Instruct-Preview 22.6B 52.6% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
550 internlm/internlm2-7b 7.7B 52.4% Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
551 argilla/CapybaraHermes-2.5-Mistral-7B 7.2B 52.4% Three-shot, text-only, float16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
552 unsloth/gemma-7b-bnb-4bit 8.5B 52.4% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
553 eduagarcia/mistral-orpo-capybara-3k 7.2B 52.4% Three-shot, text-only, bfloat16, 2024-05-01 May 2024 huggingface.co Official leaderboard
554 recogna-nlp/internlm-chatbode2-7b-beta 8.4B 52.4% Three-shot, text-only, float16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
555 Mistral 7B v0.3 52.3% Three-shot, text-only, bfloat16, 2024-05-22 Sep 2023 May 2024 huggingface.co Official leaderboard
556 Qwen1.5-7B-Chat 52.3% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 Feb 2024 huggingface.co Official leaderboard
557 yunconglong/DARE_TIES_13B 12.9B 52.3% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
558 uukuguy/speechless-zephyr-code-functionary-7b 7.2B 52.3% Three-shot, text-only, bfloat16, 2024-07-27 Jul 2024 huggingface.co Official leaderboard
559 princeton-nlp/Llama-3-Base-8B-SFT 8B 52.3% Three-shot, text-only, rev: b622b7d, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
560 meta-llama/Llama-3.2-3B-Instruct 3.2B 52.3% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
561 Gemma 3 4B 52.3% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
562 Mistral-7B-Instruct-v0.2 52.2% Three-shot, text-only, bfloat16, 2024-02-18 Dec 2023 Feb 2024 huggingface.co Official leaderboard
563 alvarobartt/Mistral-7B-v0.1-ORPO 7.2B 52.2% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
564 tokyotech-llm/Llama-3-Swallow-8B-Instruct-v0.1 8B 52.2% Three-shot, text-only, bfloat16, 2024-09-12 Sep 2024 huggingface.co Official leaderboard
565 princeton-nlp/Llama-3-Base-8B-SFT-KTO 8B 52.2% Three-shot, text-only, rev: 49a8c2e, bfloat16, 2024-09-28 Sep 2024 huggingface.co Official leaderboard
566 Qwen/Qwen1.5-MoE-A2.7B-Chat 14.3B 52% Three-shot, text-only, bfloat16, 2024-04-12 Apr 2024 huggingface.co Official leaderboard
567 mlabonne/Beyonder-4x7B-v3 24.2B 52% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
568 uukuguy/zephyr-7b-alpha-dare-0.85 7.2B 52% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
569 01-ai/Yi-1.5-34B-Chat-16K 34.4B 52% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
570 dzakwan/dzakwan-MoE-4x7b-Beta 24.2B 52% Three-shot, text-only, float16, 2024-06-10 Jun 2024 huggingface.co Official leaderboard
571 Qwen2.5-7B 52% Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 Sep 2024 Oct 2024 huggingface.co Official leaderboard
572 kaist-ai/janus-dpo-7b 7.2B 52% Three-shot, text-only, bfloat16, 2024-10-09 Oct 2024 huggingface.co Official leaderboard
573 huggyllama/llama-30b 32.5B 51.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
574 eduagarcia/zephyr-pt-phi-3-mini-128k-dpo-v0.1 3.8B 51.9% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
575 princeton-nlp/Mistral-7B-Instruct-RRHF 7.2B 51.9% Three-shot, text-only, rev: 493d3ce, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
576 BornSaint/Dare_Angel_8B 8B 51.9% Three-shot, text-only, float16, 2025-05-22 May 2025 huggingface.co Official leaderboard
577 rhaymison/Llama3-portuguese-luana-8b-instruct 8B 51.7% Three-shot, text-only, float16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
578 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.4 8B 51.7% Three-shot, text-only, float16, 2024-06-15 Jun 2024 huggingface.co Official leaderboard
579 SeaLLMs/SeaLLM-7B-v2 7.4B 51.7% Three-shot, text-only, bfloat16, 2024-08-06 Aug 2024 huggingface.co Official leaderboard
580 abacusai/bigstral-12b-32k 12.5B 51.7% Three-shot, text-only, float16, 2024-09-04 Sep 2024 huggingface.co Official leaderboard
581 abacusai/bigyi-15b 15.1B 51.7% Three-shot, text-only, float16, 2024-09-04 Sep 2024 huggingface.co Official leaderboard
582 byroneverson/Yi-1.5-9B-Chat-abliterated 8.8B 51.7% Three-shot, text-only, bfloat16, 2024-09-17 Sep 2024 huggingface.co Official leaderboard
583 internlm/internlm2-chat-7b-sft 7.7B 51.6% Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
584 eduagarcia/mistral-orpo-mix-7k 7.2B 51.6% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
585 rombodawg/Everyone-Coder-4x7b-Base 24.2B 51.6% Three-shot, text-only, float16, 2024-07-27 Jul 2024 huggingface.co Official leaderboard
586 recogna-nlp/internlm-chatbode-7b 7.7B 51.5% Three-shot, text-only, float16, 2024-05-07 May 2024 huggingface.co Official leaderboard
587 vicgalle/Configurable-Mistral-7B 7.2B 51.5% Three-shot, text-only, float16, 2024-06-12 Jun 2024 huggingface.co Official leaderboard
588 vicgalle/ConfigurableHermes-7B 7.2B 51.5% Three-shot, text-only, float16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
589 princeton-nlp/Mistral-7B-Instruct-DPO 7.2B 51.5% Three-shot, text-only, rev: 5e96cff, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
590 Qwen3-14B-Base 51.5% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
591 Yi 6B 51.3% Three-shot, text-only, bfloat16, 2024-02-05 Nov 2023 Feb 2024 huggingface.co Official leaderboard
592 Skywork/Skywork-13B-base 13.9B 51.3% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
593 bartowski/internlm2-chat-7b-llama 7.7B 51.3% Three-shot, text-only, rev: refs/pr/2, float16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
594 uukuguy/speechless-code-mistral-7b-v1.0 7.2B 51.3% Three-shot, text-only, float16, 2024-06-16 Jun 2024 huggingface.co Official leaderboard
595 unsloth/mistral-7b-v0.3-bnb-4bit 7.3B 51.2% Three-shot, text-only, 4bit, 2024-05-22 May 2024 huggingface.co Official leaderboard
596 openchat/openchat-3.6-8b-20240522 8B 51.2% Three-shot, text-only, bfloat16, 2024-05-25 May 2024 huggingface.co Official leaderboard
597 shadowml/BeagSake-7B 7.2B 51.2% Three-shot, text-only, bfloat16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
598 rombodawg/rombos_Replete-Coder-Llama3-8B 8B 51.2% Three-shot, text-only, bfloat16, 2024-10-14 Oct 2024 huggingface.co Official leaderboard
599 Zephyr 7B Alpha 51% Three-shot, text-only, bfloat16, 2024-04-14 Oct 2023 Apr 2024 huggingface.co Official leaderboard
600 MagusCorp/legislinho 7.2B 51% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
601 GritLM/GritLM-7B-KTO 7.2B 51% Three-shot, text-only, bfloat16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
602 beowolx/CodeNinja-1.0-OpenChat-7B 7.2B 51% Three-shot, text-only, bfloat16, 2024-07-27 Jul 2024 huggingface.co Official leaderboard
603 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter3 7.2B 51% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
604 princeton-nlp/Mistral-7B-Instruct-CPO 7.2B 51% Three-shot, text-only, rev: 32492f8, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
605 internlm/internlm2-chat-7b 7.7B 50.8% Three-shot, text-only, rev: v1.0.0, float16, 2024-02-19 Feb 2024 huggingface.co Official leaderboard
606 gradientai/Llama-3-8B-Instruct-262k 8B 50.8% Three-shot, text-only, bfloat16, 2024-06-13 Jun 2024 huggingface.co Official leaderboard
607 AetherResearch/Cerebrum-1.0-7b 7.2B 50.6% Three-shot, text-only, float16, 2024-03-14 Mar 2024 huggingface.co Official leaderboard
608 rhaymison/phi-3-portuguese-tom-cat-4k-instruct 3.8B 50.6% Three-shot, text-only, float16, 2024-04-29 Apr 2024 huggingface.co Official leaderboard
609 UCLA-AGI/Mistral7B-PairRM-SPPO-Iter2 7.2B 50.6% Three-shot, text-only, bfloat16, 2024-08-07 Aug 2024 huggingface.co Official leaderboard
610 mlabonne/FineLlama-3.1-8B 8B 50.6% Three-shot, text-only, bfloat16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
611 princeton-nlp/Mistral-7B-Instruct-RDPO 7.2B 50.6% Three-shot, text-only, rev: 23ec6ab, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
612 argilla/notus-7b-v1 7.2B 50.5% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
613 Llama 3.2 3B 50.5% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
614 princeton-nlp/Mistral-7B-Instruct-ORPO 7.2B 50.5% Three-shot, text-only, rev: 69c0481, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
615 Qwen/Qwen3-1.7B-Base 1.7B 50.5% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
616 Intel/neural-chat-7b-v3-3 7.2B 50.4% Three-shot, text-only, float16, 2024-02-21 Feb 2024 huggingface.co Official leaderboard
617 Mistral 7B v0.1 50.2% Three-shot, text-only, bfloat16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
618 THUDM/chatglm3-6b-base 6.2B 50.2% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
619 lmsys/vicuna-33b-v1.3 33B 50.2% Three-shot, text-only, float16, 2024-03-05 Mar 2024 huggingface.co Official leaderboard
620 kaist-ai/janus-7b 7.2B 50.2% Three-shot, text-only, bfloat16, 2024-10-09 Oct 2024 huggingface.co Official leaderboard
621 Qwen3-30B-A3B-Base 50.2% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
622 Yi-6B-Chat 50.1% Three-shot, text-only, bfloat16, 2024-02-27 Nov 2023 Feb 2024 huggingface.co Official leaderboard
623 recogna-nlp/internlmbode-7b 7.7B 50.1% Three-shot, text-only, float16, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
624 mlabonne/NeuralMonarch-7B 7.2B 50.1% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
625 UCLA-AGI/Mistral7B-PairRM-SPPO 7.2B 50.1% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
626 princeton-nlp/Mistral-7B-Instruct-SLiC-HF 7.2B 50.1% Three-shot, text-only, rev: 3d08c8b, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
627 unsloth/mistral-7b-bnb-4bit 7.2B 49.9% Three-shot, text-only, 4bit, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
628 01-ai/Yi-1.5-6B 6.1B 49.9% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
629 eldogbbhed/Peagle-9b 9B 49.9% Three-shot, text-only, float16, 2024-05-17 May 2024 huggingface.co Official leaderboard
630 amazingvince/Not-WizardLM-2-7B 7.2B 49.9% Three-shot, text-only, bfloat16, 2024-05-22 May 2024 huggingface.co Official leaderboard
631 google/medgemma-4b-it 4.3B 49.9% Three-shot, text-only, bfloat16, 2025-07-15 Jul 2025 huggingface.co Official leaderboard
632 CEIA-UFG/Gemma-3-Gaia-PT-BR-4b-it 4.3B 49.8% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
633 Falcon-40B 49.6% Three-shot, text-only, bfloat16, 2024-02-05 Mar 2023 Feb 2024 huggingface.co Official leaderboard
634 cognitivecomputations/dolphin-2.9-llama3-8b 8B 49.6% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
635 alvarobartt/mistral-7b-orpo-alignment-handbook 7.2B 49.6% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
636 cosmicvalor/mistral-orthogonalized 7.2B 49.6% Three-shot, text-only, float16, 2024-05-25 May 2024 huggingface.co Official leaderboard
637 J-AI/Mistral_7b_ptbr_icatalogo 7.2B 49.6% Three-shot, text-only, float16, 2024-05-27 May 2024 huggingface.co Official leaderboard
638 princeton-nlp/Mistral-7B-Instruct-IPO 7.2B 49.6% Three-shot, text-only, rev: 32ad99c, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
639 deepcogito/cogito-v1-preview-llama-3B 3.6B 49.6% Three-shot, text-only, bfloat16, 2025-04-09 Apr 2025 huggingface.co Official leaderboard
640 chujiezheng/Mistral7B-PairRM-SPPO-ExPO 7.2B 49.5% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
641 stabilityai/stablelm-2-12b-chat 12.1B 49.4% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
642 lucianosb/boto-7B-v1.1 7.2B 49.4% Three-shot, text-only, float16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
643 cognitivecomputations/dolphin-2.9.3-mistral-7B-32k 7.3B 49.4% Three-shot, text-only, bfloat16, 2024-06-30 Jun 2024 huggingface.co Official leaderboard
644 failspy/Codestral-22B-v0.1-abliterated-v3 22.3B 49.4% Three-shot, text-only, bfloat16, 2024-07-02 Jul 2024 huggingface.co Official leaderboard
645 kaist-ai/janus-orpo-7b 7.2B 49.4% Three-shot, text-only, bfloat16, 2024-10-09 Oct 2024 huggingface.co Official leaderboard
646 BSC-LT/salamandra-7b-instruct 7.8B 49.4% Three-shot, text-only, bfloat16, 2025-04-04 Apr 2025 huggingface.co Official leaderboard
647 microsoft/Phi-4-mini-instruct 3.8B 49.4% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
648 rhaymison/Mistral-portuguese-luana-7b-chat 7.2B 49.2% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
649 Walmart-the-bag/Quintellect-10.7B 10.7B 49.2% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
650 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.4 8B 49.2% Three-shot, text-only, bfloat16, 2024-04-24 Apr 2024 huggingface.co Official leaderboard
651 lucianosb/boto-7B-v1.2 7.3B 49.2% Three-shot, text-only, bfloat16, 2024-05-24 May 2024 huggingface.co Official leaderboard
652 GritLM/GritLM-7B 7.2B 49.2% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 huggingface.co Official leaderboard
653 ValiantLabs/Llama3.1-8B-ShiningValiant2 8B 49.2% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
654 mlabonne/AlphaMonarch-7B 7.2B 49.1% Three-shot, text-only, float16, 2024-05-15 May 2024 huggingface.co Official leaderboard
655 alvarobartt/mistral-7b-orpo-capybara-reproduction 7.2B 49% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
656 MAmmoTH2-7B-Plus 49% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 May 2024 huggingface.co Official leaderboard
657 Xwin-LM/Xwin-LM-13B-V0.2 13B 49% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
658 Qwen-7B 48.8% Three-shot, text-only, float16, 2024-04-18 Sep 2023 Apr 2024 huggingface.co Official leaderboard
659 TencentARC/Mistral_Pro_8B_v0.1 9B 48.8% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 huggingface.co Official leaderboard
660 lucianosb/boto-7B 7.2B 48.8% Three-shot, text-only, float16, 2024-04-10 Apr 2024 huggingface.co Official leaderboard
661 Columbia-NLP/LION-LLaMA-3-8b-odpo-v1.0 8B 48.8% Three-shot, text-only, bfloat16, 2024-07-13 Jul 2024 huggingface.co Official leaderboard
662 princeton-nlp/Mistral-7B-Base-SFT-IPO 7.2B 48.8% Three-shot, text-only, rev: eea7817, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
663 princeton-nlp/Mistral-7B-Base-SFT-KTO 7.2B 48.8% Three-shot, text-only, rev: 02148bb, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
664 cnmoro/Mistral-7B-Portuguese 7.2B 48.7% Three-shot, text-only, float16, 2024-03-04 Mar 2024 huggingface.co Official leaderboard
665 princeton-nlp/Mistral-7B-Base-SFT-SimPO 7.2B 48.7% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
666 recogna-nlp/internlm-chatbode2-7b-alpha 8.4B 48.7% Three-shot, text-only, float16, 2024-06-12 Jun 2024 huggingface.co Official leaderboard
667 ghost-x/ghost-8b-beta-1608 8B 48.7% Three-shot, text-only, bfloat16, 2024-08-18 Aug 2024 huggingface.co Official leaderboard
668 allenai/OLMo-2-1124-7B 7.3B 48.7% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
669 rhaymison/Mistral-portuguese-luana-7b-mental-health 7.2B 48.5% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
670 alvarobartt/mistral-orpo-mix 7.2B 48.5% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
671 princeton-nlp/Mistral-7B-Base-SFT-SLiC-HF 7.2B 48.5% Three-shot, text-only, rev: 65d2cc4, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
672 HuggingFaceTB/SmolLM3-3B 3.1B 48.5% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
673 cognitivecomputations/WizardLM-30B-Uncensored 32.5B 48.4% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
674 Xwin-LM/Xwin-LM-13B-V0.1 13B 48.4% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
675 CohereForAI/aya-23-8B 8B 48.4% Three-shot, text-only, float16, 2024-05-23 May 2024 huggingface.co Official leaderboard
676 artificialguybr/OpenHermesV2-PTBR 7.2B 48.4% Three-shot, text-only, float16, 2024-05-27 May 2024 huggingface.co Official leaderboard
677 princeton-nlp/Mistral-7B-Base-SFT-RDPO 7.2B 48.4% Three-shot, text-only, rev: 2a63a6d, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
678 Weni/ZeroShot-3.4.22-Mistral-7b-DPO-1.0.0 7.3B 48.3% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
679 amazon/MegaBeam-Mistral-7B-300k 7.2B 48.3% Three-shot, text-only, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
680 allenai/OLMo-2-1124-7B-Instruct 7.3B 48.3% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
681 allenai/tulu-2-dpo-13b 13B 48.1% Three-shot, text-only, bfloat16, 2024-03-05 Mar 2024 huggingface.co Official leaderboard
682 rhaymison/Qwen-portuguese-luana-7b 7.7B 48.1% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
683 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-half 8B 48.1% Three-shot, text-only, rev: b82150a, bfloat16, 2024-06-14 Jun 2024 huggingface.co Official leaderboard
684 eduagarcia/zephyr-pt-llama-3-8B-orpo-v0.1 8B 48.1% Three-shot, text-only, bfloat16, 2024-07-09 Jul 2024 huggingface.co Official leaderboard
685 eduagarcia/zephyr-pt-Yi-1.5-9B-orpo-v0.6 8.8B 48.1% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
686 Gemma 2 2B IT 48.1% Three-shot, text-only, bfloat16, 2024-08-09 Jul 2024 Aug 2024 huggingface.co Official leaderboard
687 princeton-nlp/Mistral-7B-Base-SFT-CPO 7.2B 48.1% Three-shot, text-only, rev: 7f67394, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
688 tiiuae/Falcon-H1-1.5B-Base 1.6B 48.1% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
689 Zephyr 7B Beta 48% Three-shot, text-only, bfloat16, 2024-02-21 Oct 2023 Feb 2024 huggingface.co Official leaderboard
690 Intel/neural-chat-7b-v3-1 7.2B 48% Three-shot, text-only, float16, 2024-02-21 Feb 2024 huggingface.co Official leaderboard
691 JJhooww/MistralReloadBR_v2_ptbr 7.2B 48% Three-shot, text-only, bfloat16, 2024-03-08 Mar 2024 huggingface.co Official leaderboard
692 rhaymison/Mistral-portuguese-luana-7b 7.2B 48% Three-shot, text-only, bfloat16, 2024-04-08 Apr 2024 huggingface.co Official leaderboard
693 hkust-nlp/deita-7b-v1.0-sft 7.2B 48% Three-shot, text-only, bfloat16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
694 CohereForAI/aya-101 12.9B 47.8% Three-shot, text-only, float16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
695 royallab/ZephRP-m7b 7.2B 47.8% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
696 ValiantLabs/Llama3.1-8B-Fireplace2 8B 47.8% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
697 maritaca-ai/sabia-7b 6.7B 47.7% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
698 internlm/internlm2-base-7b 7.7B 47.7% Three-shot, text-only, rev: v1.0.0, bfloat16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
699 Gemma 1.1 7B IT 47.7% Three-shot, text-only, bfloat16, 2024-04-07 Apr 2024 Apr 2024 huggingface.co Official leaderboard
700 deepseek-ai/DeepSeek-V2-Lite-Chat 15.7B 47.7% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
701 meta-llama/Llama-2-70b-chat-hf 69B 47.6% Three-shot, text-only, float16, 2024-02-18 Feb 2024 huggingface.co Official leaderboard
702 Weni/ZeroShot-3.3.34-Mistral-7b-Multilanguage-3.3.0-merged 7.2B 47.6% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
703 kaitchup/Qwen1.5-7B-bnb-4bit 7.7B 47.6% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
704 alvarobartt/mistral-orpo-mix-b0.1-l2048-pl1792-lr5e-6-inverse-sqrt 7.2B 47.6% Three-shot, text-only, bfloat16, 2024-04-28 Apr 2024 huggingface.co Official leaderboard
705 HuggingFaceH4/zephyr-7b-gemma-v0.1 8.5B 47.4% Three-shot, text-only, bfloat16, 2024-03-02 Mar 2024 huggingface.co Official leaderboard
706 Weni/WeniGPT-2.4.1-Zephyr-7B-3-epochs-GPT-QA-1.0.1_DP_DPO 7.3B 47.4% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
707 Gemma 3n E2B 47.3% Three-shot, text-only, bfloat16, 2025-07-15 Jun 2025 Jul 2025 huggingface.co Official leaderboard
708 recogna-nlp/mistralbode_7b_qlora_ultraalpaca 7.4B 47.1% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
709 heloisy/zephyr-7b-cosmosqa-ptbr_text 7.3B 47.1% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
710 nicolasdec/Cabramistral7b 7.2B 47% Three-shot, text-only, float16, 2024-03-18 Mar 2024 huggingface.co Official leaderboard
711 chargoddard/internlm2-base-7b-llama 7.7B 47% Three-shot, text-only, rev: refs/pr/2, bfloat16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
712 tiiuae/falcon-11B 11.1B 47% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
713 aws-prototyping/MegaBeam-Mistral-7B-512k 7.2B 47% Three-shot, text-only, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
714 OpenLLM-France/Claire-Mistral-7B-0.1 7.2B 46.9% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
715 nicolasdec/CabraMistral7b 7.2B 46.9% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
716 maywell/Synatra-7B-v0.3-RP 7.2B 46.9% Three-shot, text-only, float16, 2024-05-13 May 2024 huggingface.co Official leaderboard
717 matheusrdgsf/cesar-ptbr 1.1B 46.9% Three-shot, text-only, GPTQ, 2024-05-27 May 2024 huggingface.co Official leaderboard
718 TheBloke/zephyr-7B-beta-GPTQ 9.6B 46.9% Three-shot, text-only, GPTQ, 2024-05-27 May 2024 huggingface.co Official leaderboard
719 01-ai/Yi-6B-200K 6.1B 46.7% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
720 Qwen1.5-4B-Chat 46.6% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 Feb 2024 huggingface.co Official leaderboard
721 Falcon3-3B-Instruct 46.5% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
722 Yi-1.5-6B-Chat 46.3% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 May 2024 huggingface.co Official leaderboard
723 Qwen/Qwen-7B-Chat 7.7B 46.2% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
724 allenai/tulu-2-13b 13B 46.2% Three-shot, text-only, bfloat16, 2024-05-22 May 2024 huggingface.co Official leaderboard
725 Qwen2.5-3B 46.2% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
726 rhaymison/Mistral-portuguese-luana-7b-Mathematics 7.2B 46% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
727 hkust-nlp/deita-7b-v1.0 7.2B 45.9% Three-shot, text-only, bfloat16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
728 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v3 7.3B 45.8% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
729 Kukedlc/NeuralLLaMa-3-8b-ORPO-v0.3 8B 45.8% Three-shot, text-only, float16, 2024-05-28 May 2024 huggingface.co Official leaderboard
730 Qwen1.5-14B 45.6% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 Feb 2024 huggingface.co Official leaderboard
731 Weni/ZeroShot-Multilanguage-Zephyr-7B 7.3B 45.6% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
732 meta-llama/Llama-2-13b-chat-hf 13B 45.6% Three-shot, text-only, bfloat16, 2024-04-19 Apr 2024 huggingface.co Official leaderboard
733 rhaymison/portuguese-tom-cat-13b 13B 45.6% Three-shot, text-only, bfloat16, 2024-05-20 May 2024 huggingface.co Official leaderboard
734 rfanucchi/Llama3-pt_br_cabrita 8.1B 45.6% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 huggingface.co Official leaderboard
735 botbot-ai/CabraMistral-v3-7b-32k 7.3B 45.6% Three-shot, text-only, bfloat16, 2024-06-10 Jun 2024 huggingface.co Official leaderboard
736 DeepSeek-R1-Distill-Llama-70B 45.6% Three-shot, text-only, 4bit, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
737 Motif-Technologies/Motif-2.6B 2.6B 45.6% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
738 heloisy/zephyr-7b-b-cosmosqa-ptbr-text-v2 7.3B 45.5% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
739 nvidia/Llama-3.1-Nemotron-Nano-8B-v1 8B 45.5% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
740 Qwen3-4B-Base 45.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
741 princeton-nlp/Mistral-7B-Base-SFT-DPO 7.2B 45.1% Three-shot, text-only, rev: 17134fd, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
742 recogna-nlp/zephyr_7b_beta_ultraalpaca 7.4B 44.9% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
743 meta-llama/Llama-2-13b-hf 13B 44.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
744 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2-fft 8B 44.4% Three-shot, text-only, bfloat16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
745 lmsys/vicuna-13b-v1.5 13B 44.2% Three-shot, text-only, float16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
746 allenai/tulu-2-7b 7B 44.2% Three-shot, text-only, bfloat16, 2024-05-22 May 2024 huggingface.co Official leaderboard
747 Motif-Technologies/Motif-2.6b-v1.1-LC 2.6B 44.2% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
748 allenai/tulu-2-dpo-7b 7B 44.1% Three-shot, text-only, bfloat16, 2024-03-05 Mar 2024 huggingface.co Official leaderboard
749 SakanaAI/DiscoPOP-zephyr-7b-gemma 8.5B 44.1% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
750 AIDC-AI/Marco-LLM-ES 7.6B 44.1% Three-shot, text-only, bfloat16, 2025-02-27 Feb 2025 huggingface.co Official leaderboard
751 BAAI/Aquila2-34B 34B 43.8% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
752 OliveiraJLT/Sagui-7B-Instruct-v0.1 6.7B 43.7% Three-shot, text-only, bfloat16, 2024-07-18 Jul 2024 huggingface.co Official leaderboard
753 THUDM/chatglm3-6b-32k 6.2B 43.5% Three-shot, text-only, float16, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
754 Qwen3-0.6B 43.4% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
755 GuiCas/Phituguese_FP16 3.8B 43.3% Three-shot, text-only, float16, 2024-06-04 Jun 2024 huggingface.co Official leaderboard
756 abacusai/Liberated-Qwen1.5-14B 14.2B 43.1% Three-shot, text-only, float16, 2024-06-12 Jun 2024 huggingface.co Official leaderboard
757 google/medgemma-4b-pt 4.3B 42.8% Three-shot, text-only, bfloat16, 2025-07-15 Jul 2025 huggingface.co Official leaderboard
758 xverse/XVERSE-13B 13.7B 42.7% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
759 rhaymison/portuguese-Phi3-Tom-Cat-128k-instruct 3.8B 42.6% Three-shot, text-only, float16, 2024-05-23 May 2024 huggingface.co Official leaderboard
760 01-ai/Yi-Coder-9B-Chat 9B 42.6% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
761 LFM2-1.2B 42.3% Three-shot, text-only, bfloat16, 2025-08-30 Jul 2025 Aug 2025 huggingface.co Official leaderboard
762 kurakurai/Luth-0.6B-Instruct 0.6B 42.3% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
763 Deci/DeciLM-7B 7B 42% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
764 J-LAB/Brisa_v0.2_sft 7.2B 41.9% Three-shot, text-only, float16, 2024-10-26 Oct 2024 huggingface.co Official leaderboard
765 google/gemma-2-2b 2.6B 41.7% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
766 dfurman/Llama-3-8B-Orpo-v0.1 8B 41.7% Three-shot, text-only, float16, 2024-08-22 Aug 2024 huggingface.co Official leaderboard
767 kurakurai/Luth-LFM2-1.2B 1.2B 41.7% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
768 Mistral-7B-Instruct-v0.1 41.6% Three-shot, text-only, bfloat16, 2024-05-27 Sep 2023 May 2024 huggingface.co Official leaderboard
769 LiquidAI/LFM2-700M 0.7B 41.6% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
770 Qwen/Qwen1.5-MoE-A2.7B 14.3B 41.5% Three-shot, text-only, bfloat16, 2024-04-12 Apr 2024 huggingface.co Official leaderboard
771 lmsys/vicuna-7b-v1.5 7B 41.3% Three-shot, text-only, float16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
772 rfanucchi/Llama3-pt_br_cabrit_orca_qkvo 8.1B 41.3% Three-shot, text-only, bfloat16, 2024-06-04 Jun 2024 huggingface.co Official leaderboard
773 princeton-nlp/Mistral-7B-Base-SFT-RRHF 7.2B 41.3% Three-shot, text-only, rev: 0d58610, bfloat16, 2024-10-07 Oct 2024 huggingface.co Official leaderboard
774 tiiuae/Falcon3-3B-Base 3.2B 41.2% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 huggingface.co Official leaderboard
775 nicolasdec/cabra13b 13B 40.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
776 recogna-nlp/phibode-3-mini-4k-ultraalpaca 3.8B 40.8% Three-shot, text-only, float16, 2024-05-05 May 2024 huggingface.co Official leaderboard
777 TIGER-Lab/Qwen2.5-Math-7B-CFT 7.6B 40.8% Three-shot, text-only, bfloat16, 2025-03-07 Mar 2025 huggingface.co Official leaderboard
778 Xwin-LM/Xwin-LM-7B-V0.1 7B 40.6% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
779 lightblue/suzume-llama-3-8B-multilingual-orpo-borda-full 8B 40.6% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 huggingface.co Official leaderboard
780 X-D-Lab/XrayQwen 9.7B 40.5% Three-shot, text-only, rev: 3f477a4, float16, 2024-09-18 Sep 2024 huggingface.co Official leaderboard
781 LGAI-EXAONE/EXAONE-3.0-7.8B-Instruct 7.8B 40.3% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
782 baichuan-inc/Baichuan2-7B-Base 7.5B 40.1% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
783 kurakurai/Luth-LFM2-700M 0.7B 40.1% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
784 recogna-nlp/mistral-bode 7.3B 39.8% Three-shot, text-only, float16, 2024-04-04 Apr 2024 huggingface.co Official leaderboard
785 adalbertojunior/Llama-3-8B-Instruct-Portuguese-v0.2 8B 39.8% Three-shot, text-only, bfloat16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
786 01-ai/Yi-Coder-9B 8.8B 39.5% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
787 h2oai/h2o-danube3.1-4b-chat 4B 39.1% Three-shot, text-only, bfloat16, 2024-12-05 Dec 2024 huggingface.co Official leaderboard
788 migtissera/Tess-3-Mistral-Nemo-12B 12.3B 38.9% Three-shot, text-only, bfloat16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
789 xverse/XVERSE-65B-2 66.4B 38.8% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
790 MPT-30B 38.7% Three-shot, text-only, bfloat16, 2024-02-05 Jun 2023 Feb 2024 huggingface.co Official leaderboard
791 AdaptLLM/finance-LLM-13B 13B 38.5% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
792 deepseek-ai/deepseek-llm-7b-base 7B 38.4% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
793 recogna-nlp/bode-13b-alpaca-pt-br 13B 38.3% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
794 h2oai/h2o-danube3-4b-chat 4B 38.3% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
795 J-LAB/FluxiIA-Small_Brisa 7.2B 38.3% Three-shot, text-only, float16, 2024-11-16 Nov 2024 huggingface.co Official leaderboard
796 AdaptLLM/law-LLM-13B 13B 38% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
797 deepseek-ai/deepseek-moe-16b-chat 16.4B 38% Three-shot, text-only, bfloat16, 2024-04-13 Apr 2024 huggingface.co Official leaderboard
798 xverse/XVERSE-65B 66.4B 37.8% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
799 ghost-x/ghost-8b-beta 8B 37.7% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
800 gpt-oss-20b 37.7% Three-shot, text-only, bfloat16, 2025-08-29 Aug 2025 Aug 2025 huggingface.co Official leaderboard
801 Qwen1.5-7B 37.5% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 Feb 2024 huggingface.co Official leaderboard
802 AdaptLLM/medicine-LLM-13B 13B 37.5% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
803 Xwin-LM/Xwin-LM-7B-V0.2 7B 37.4% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
804 haoranxu/ALMA-13B-Pretrain 13B 37.3% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 huggingface.co Official leaderboard
805 rfanucchi/Llama3-pt_br_orca 8.1B 37% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
806 xverse/XVERSE-7B 7.3B 36.9% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
807 THUDM/agentlm-7b 6.7B 36.7% Three-shot, text-only, float16, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
808 Weni/WeniGPT-2.8.1-Zephyr-7B-zephyr-prompt-binarized 7.3B 36.6% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
809 recogna-nlp/gembode-7b-it 8.7B 36.6% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
810 h2oai/h2o-danube3-4b-base 4B 36.4% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
811 tanliboy/lambda-qwen2.5-32b-dpo-test 32.8B 36.4% Three-shot, text-only, bfloat16, 2024-09-30 Sep 2024 huggingface.co Official leaderboard
812 NousResearch/Nous-Hermes-13b 13B 36.3% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
813 Qwen/Qwen1.5-4B 4B 36.2% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
814 eduagarcia/gemma-7b-it_no_chat_template 8.5B 36% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 huggingface.co Official leaderboard
815 stabilityai/stablelm-zephyr-3b 2.8B 36% Three-shot, text-only, bfloat16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
816 Qwen3-8B-Base 36% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
817 ChatGLM3-6B 35.6% Three-shot, text-only, float16, 2024-02-19 Oct 2023 Feb 2024 huggingface.co Official leaderboard
818 THUDM/chatglm3-6b-128k 6.2B 35.5% Three-shot, text-only, float16, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
819 Qwen/Qwen2.5-0.5B-Instruct 0.5B 35.5% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
820 cnmoro/Qwen2.5-0.5B-Portuguese-v1 0.5B 34.6% Three-shot, text-only, float16, 2025-02-25 Feb 2025 huggingface.co Official leaderboard
821 Qwen2-0.5B-Instruct 34.5% Three-shot, text-only, bfloat16, 2024-06-07 Jun 2024 Jun 2024 huggingface.co Official leaderboard
822 THUDM/LongAlign-7B-64k 7B 33.7% Three-shot, text-only, float16, 2024-04-05 Apr 2024 huggingface.co Official leaderboard
823 internlm-7b 33.5% Three-shot, text-only, float16, 2024-02-05 Jul 2023 Feb 2024 huggingface.co Official leaderboard
824 nicolasdec/Cabra 6.7B 33.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
825 stabilityai/stablelm-2-1_6b-chat 1.7B 33.2% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
826 cognitivecomputations/dolphin-2.9.3-llama-3-8b 8B 33.2% Three-shot, text-only, bfloat16, 2024-07-02 Jul 2024 huggingface.co Official leaderboard
827 Gemma 3 1B 33% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
828 LLaMA-13B 32.8% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
829 rhaymison/Llama-portuguese-13b-Luana-v0.2 13B 32.7% Three-shot, text-only, bfloat16, 2024-04-08 Apr 2024 huggingface.co Official leaderboard
830 cognitivecomputations/dolphin-2.9.1-mixtral-1x22b 22.2B 32.7% Three-shot, text-only, bfloat16, 2024-05-24 May 2024 huggingface.co Official leaderboard
831 BAAI/OPI-Llama-3.1-8B-Instruct 8B 32.7% Three-shot, text-only, bfloat16, 2024-09-21 Sep 2024 huggingface.co Official leaderboard
832 stabilityai/stablelm-2-zephyr-1_6b 1.7B 32.4% Three-shot, text-only, float16, 2024-02-27 Feb 2024 huggingface.co Official leaderboard
833 internlm/internlm2-chat-1_8b 1.9B 32.3% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
834 internlm/internlm2_5-1_8b 8B 32.3% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
835 internlm/internlm2-chat-1_8b-sft 1.9B 32.1% Three-shot, text-only, rev: v1.0.0, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
836 internlm/internlm2-1_8b 8B 31.7% Three-shot, text-only, bfloat16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
837 cognitivecomputations/WizardLM-13B-Uncensored 13B 31.7% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
838 AdaptLLM/law-LLM 6.7B 31.6% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
839 internlm/internlm2_5-1_8b-chat 1.9B 31.6% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
840 Falcon3-1B-Instruct 31.6% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
841 haoranxu/ALMA-13B-R 13B 31.4% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 huggingface.co Official leaderboard
842 google/recurrentgemma-2b-it 2.7B 31.4% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
843 Oburaco/llama2-qlora-finetunined-ptbr 6.8B 31.4% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
844 TinyPixel/Llama-2-7B-bf16-sharded 6.7B 31.4% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
845 rfanucchi/Llama3-pt_bt_orca_cabrita_qkvLora 8.1B 31.4% Three-shot, text-only, 4bit, 2024-09-27 Sep 2024 huggingface.co Official leaderboard
846 unsloth/Llama-3.2-1B-Instruct 1.2B 31.4% Three-shot, text-only, float16, 2024-11-24 Nov 2024 huggingface.co Official leaderboard
847 cnmoro/Qwen2.5-0.5B-Portuguese-Hybrid-Reasoning 0.5B 31.4% Three-shot, text-only, float16, 2025-03-08 Mar 2025 huggingface.co Official leaderboard
848 meta-llama/Llama-2-7b-hf 6.7B 31.3% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
849 AdaptLLM/medicine-LLM 6.7B 31.3% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
850 kurakurai/Luth-LFM2-350M 0.4B 31% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
851 recogna-nlp/internlm2-chat-1_8b-ultracabrita 8B 30.7% Three-shot, text-only, float16, 2024-05-05 May 2024 huggingface.co Official leaderboard
852 Unbabel/TowerBase-7B-v0.1 6.7B 30.6% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
853 tensoropera/Fox-1-1.6B-Instruct-v0.1 1.7B 30.6% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
854 meta-llama/Llama-3.2-1B-Instruct 1.2B 30.6% Three-shot, text-only, bfloat16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
855 deepseek-ai/deepseek-moe-16b-base 16.4B 30.3% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
856 google/gemma-7b-it 8.5B 30.3% Three-shot, text-only, rev: float16, float16, 2024-02-23 Feb 2024 huggingface.co Official leaderboard
857 MAmmoTH2-8B-Plus 30.3% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 May 2024 huggingface.co Official leaderboard
858 tiiuae/Falcon-H1-0.5B-Instruct 0.5B 30.3% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
859 GeneZC/MiniMA-2-3B 3B 30.2% Three-shot, text-only, float16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
860 chatglm2-6b 29.9% Three-shot, text-only, float16, 2024-04-05 Jun 2023 Apr 2024 huggingface.co Official leaderboard
861 stabilityai/stablelm-3b-4e1t 2.8B 29.9% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
862 dominguesm/canarim-7b 7B 29.8% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
863 stabilityai/stablelm-base-alpha-7b-v2 6.9B 29.8% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
864 Qwen/Qwen1.5-1.8B-Chat 1.8B 29.8% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
865 NTQAI/Nxcode-CQ-7B-orpo 7.3B 29.6% Three-shot, text-only, bfloat16, 2024-08-10 Aug 2024 huggingface.co Official leaderboard
866 deepseek-ai/DeepSeek-R1-Distill-Llama-8B 8B 29.6% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 huggingface.co Official leaderboard
867 LiquidAI/LFM2-350M 0.4B 29.5% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
868 lrds-code/boana-7b-instruct 6.7B 29.2% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
869 DeepSeek-R1-Distill-Qwen-32B 29.2% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
870 AdaptLLM/finance-LLM 6.7B 29.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
871 semantixai/LloroV2 6.7B 29.1% Three-shot, text-only, bfloat16, 2024-03-13 Mar 2024 huggingface.co Official leaderboard
872 meta-llama/Llama-2-7b-chat-hf 6.7B 29.1% Three-shot, text-only, bfloat16, 2024-04-19 Apr 2024 huggingface.co Official leaderboard
873 rhaymison/gemma-portuguese-tom-cat-2b-it 2.5B 29.1% Three-shot, text-only, float16, 2024-04-29 Apr 2024 huggingface.co Official leaderboard
874 recogna-nlp/bode-7b-alpaca-pt-br 7B 28.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
875 langtech-languagemodeling/IberianLLM-7B-Instruct 7.8B 28.9% Three-shot, text-only, bfloat16, 2025-07-14 Jul 2025 huggingface.co Official leaderboard
876 Weni/WeniGPT-2.2.3-Zephyr-7B-LLM_Base_2.0.3_SFT 7.3B 28.8% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
877 Weni/WeniGPT-2.2.3-Zephyr-7B-merged-LLM_Base_2.0.3_SFT 7.2B 28.8% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
878 GeneZC/MiniLoong-3B 3B 28.8% Three-shot, text-only, float16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
879 Gemma 2B 28.4% Three-shot, text-only, bfloat16, 2024-02-21 Feb 2024 Feb 2024 huggingface.co Official leaderboard
880 h2oai/h2o-danube2-1.8b-base 1.8B 28.4% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
881 nvidia/Llama-3.1-Nemotron-Nano-4B-v1.1 4.5B 28.4% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
882 baichuan-inc/Baichuan2-13B-Base 13.9B 28.2% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
883 AI-Sweden-Models/gpt-sw3-40b 39.9B 28.1% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
884 mosaicml/mpt-7b-8k 7B 28.1% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
885 h2oai/h2o-danube2-1.8b-chat 1.8B 28.1% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
886 BAAI/Aquila-7B 7.3B 28% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
887 pfnet/plamo-13b 13.1B 27.7% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
888 unsloth/gemma-2b-bnb-4bit 2.5B 27.4% Three-shot, text-only, 4bit, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
889 cognitivecomputations/dolphin-2.9.4-llama3.1-8b 8B 27.4% Three-shot, text-only, bfloat16, 2024-08-25 Aug 2024 huggingface.co Official leaderboard
890 BSC-LT/salamandra-7b 7.8B 27.1% Three-shot, text-only, bfloat16, 2025-04-04 Apr 2025 huggingface.co Official leaderboard
891 baidu/ERNIE-4.5-0.3B-Base-PT 0.4B 27.1% Three-shot, text-only, bfloat16, 2025-08-31 Aug 2025 huggingface.co Official leaderboard
892 Phi-2 27% Three-shot, text-only, float16, 2024-02-05 Dec 2023 Feb 2024 huggingface.co Official leaderboard
893 nbeerbower/gemma2-gutenberg-27B 27.2B 26.8% Three-shot, text-only, bfloat16, 2024-09-15 Sep 2024 huggingface.co Official leaderboard
894 TucanoBR/Tucano-630m 0.6B 26.8% Three-shot, text-only, float16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
895 cnmoro/Qwen2.5-0.5B-Portuguese-v2 0.5B 26.8% Three-shot, text-only, float16, 2025-03-08 Mar 2025 huggingface.co Official leaderboard
896 DAMO-NLP-MT/polylm-1.7b 1.7B 26.6% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
897 Oburaco/ptbr-falcon-7b 7B 26.6% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
898 Baichuan2-13B-Chat 26.3% Three-shot, text-only, bfloat16, 2024-05-27 Sep 2023 May 2024 huggingface.co Official leaderboard
899 Qwen-1_8B 26.3% Three-shot, text-only, float16, 2024-04-18 Nov 2023 Apr 2024 huggingface.co Official leaderboard
900 dominguesm/Canarim-7B-Instruct 7B 26.1% Three-shot, text-only, float16, 2024-02-23 Feb 2024 huggingface.co Official leaderboard
901 google/recurrentgemma-2b 2.7B 26.1% Three-shot, text-only, float16, 2024-05-17 May 2024 huggingface.co Official leaderboard
902 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca_qlora 8B 26% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
903 tiiuae/Falcon3-1B-Base 1.7B 26% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 huggingface.co Official leaderboard
904 BSC-LT/salamandra-2b 2.3B 26% Three-shot, text-only, bfloat16, 2025-04-04 Apr 2025 huggingface.co Official leaderboard
905 OpenLLM-France/Claire-7B-0.1 7B 25.9% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
906 google/gemma-2b-it 2.5B 25.9% Three-shot, text-only, bfloat16, 2024-02-21 Feb 2024 huggingface.co Official leaderboard
907 recogna-nlp/gembode-2b-ultraalpaca 2.5B 25.9% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
908 AI-Sweden-Models/gpt-sw3-6.7b 7.1B 25.7% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
909 nicholasKluge/TeenyTinyLlama-460m 0.5B 25.7% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
910 recogna-nlp/qwenbode_1_8b_chat_ultraalpaca 8B 25.7% Three-shot, text-only, float16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
911 OPT-66B 25.6% Three-shot, text-only, float16, 2024-02-05 May 2022 Feb 2024 huggingface.co Official leaderboard
912 stabilityai/stablelm-2-1_6b 1.7B 25.6% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
913 TucanoBR/Tucano-1b1 1.1B 25.6% Three-shot, text-only, float16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
914 gpt-oss-120b 25.6% Three-shot, text-only, bfloat16, 2025-08-29 Aug 2025 Aug 2025 huggingface.co Official leaderboard
915 nicholasKluge/TeenyTinyLlama-460m-Chat 0.5B 25.4% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
916 Qwen/Qwen1.5-0.5B-Chat 0.6B 25.4% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
917 allenai/OLMo-2-0425-1B 1.5B 25.4% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
918 cerebras/btlm-3b-8k-base 3B 25.3% Three-shot, text-only, bfloat16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
919 recogna-nlp/GemBode-2b-it 2.5B 25.3% Three-shot, text-only, float16, 2024-03-14 Mar 2024 huggingface.co Official leaderboard
920 recogna-nlp/Phi-Bode 2.8B 25.3% Three-shot, text-only, float16, 2024-03-14 Mar 2024 huggingface.co Official leaderboard
921 SmolLM-360M 25.3% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
922 GeneZC/MiniMA-3B 3B 25.3% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
923 TheDrummer/Big-Tiger-Gemma-27B-v1 27.2B 25.3% Three-shot, text-only, rev: 892ca94, bfloat16, 2024-09-29 Sep 2024 huggingface.co Official leaderboard
924 croissantllm/CroissantLLMBase 1.4B 25.2% Three-shot, text-only, float16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
925 Qwen/Qwen1.5-1.8B 1.8B 25.2% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
926 recogna-nlp/phi-bode-2-ultraalpaca 2.8B 25.2% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
927 MulaBR/Mula-4x160-v0.1 0.4B 25.2% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
928 anthracite-org/magnum-v4-9b 9.2B 25.2% Three-shot, text-only, bfloat16, 2024-10-24 Oct 2024 huggingface.co Official leaderboard
929 TucanoBR/Tucano-160m 0.2B 25.2% Three-shot, text-only, float16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
930 RedPajama-INCITE-7B-Base 25% Three-shot, text-only, float16, 2024-02-05 May 2023 Feb 2024 huggingface.co Official leaderboard
931 openlm-research/open_llama_7b_v2 7B 25% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
932 TucanoBR/Tucano-2b4 2.4B 25% Three-shot, text-only, float16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
933 microsoft/phi-1 1.4B 24.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
934 Gemma 1.1 2B IT 24.9% Three-shot, text-only, bfloat16, 2024-04-07 Apr 2024 Apr 2024 huggingface.co Official leaderboard
935 rhaymison/gemma-portuguese-luana-2b 2.5B 24.9% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
936 h2oai/h2o-danube2-1.8b-sft 1.8B 24.9% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 huggingface.co Official leaderboard
937 OLMo 2 1B Instruct 24.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
938 openlm-research/open_llama_13b 13B 24.8% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
939 TheBloke/wizardLM-7B-HF 7B 24.8% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
940 togethercomputer/RedPajama-INCITE-Base-3B-v1 3B 24.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
941 haoranxu/ALMA-7B-R 6.8B 24.6% Three-shot, text-only, bfloat16, 2024-07-29 Jul 2024 huggingface.co Official leaderboard
942 Bruno/Caramelo_7B 7.1B 24.5% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 huggingface.co Official leaderboard
943 Weni/WeniGPT-Mistral-7B-instructBase-4bit 7.3B 24.5% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
944 tensoropera/Fox-1-1.6B 1.7B 24.5% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
945 Ramikan-BR/Qwen2-0.5B-v5 0.5B 24.3% Three-shot, text-only, rev: ce92f05, float16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
946 tiiuae/Falcon-H1-0.5B-Base 0.5B 24.3% Three-shot, text-only, bfloat16, 2025-07-08 Jul 2025 huggingface.co Official leaderboard
947 Cerebras-GPT-13B 24.2% Three-shot, text-only, float16, 2024-02-11 Mar 2023 Feb 2024 huggingface.co Official leaderboard
948 facebook/galactica-30b 30B 24.2% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
949 recogna-nlp/gembode-2b-base-ultraalpaca 2.5B 24.2% Three-shot, text-only, float16, 2024-04-22 Apr 2024 huggingface.co Official leaderboard
950 yahma/llama-7b-hf 7B 24.2% Three-shot, text-only, float16, 2024-05-27 May 2024 huggingface.co Official leaderboard
951 fernandosola/bluearara-7B-instruct 7.2B 24.1% Three-shot, text-only, bfloat16, 2024-03-08 Mar 2024 huggingface.co Official leaderboard
952 Ramikan-BR/Qwen2-0.5B-v9 0.5B 24.1% Three-shot, text-only, rev: 51d076f, float16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
953 TinyLlama/TinyLlama_v1.1 1.1B 24.1% Three-shot, text-only, float16, 2024-07-25 Jul 2024 huggingface.co Official leaderboard
954 Emu3-Chat 24.1% Three-shot, text-only, bfloat16, 2024-10-21 Sep 2024 Oct 2024 huggingface.co Official leaderboard
955 LLaMA-7B 23.9% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
956 matsuo-lab/weblab-10b 10.7B 23.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
957 Oburaco/ptbr-falcon-7b-v3 7B 23.9% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
958 vilsonrodrigues/falcon-7b-instruct-sharded 6.9B 23.9% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
959 GPT-J-6B 23.6% Three-shot, text-only, float16, 2024-02-05 Aug 2021 Feb 2024 huggingface.co Official leaderboard
960 bigscience/bloom-7b1 7.1B 23.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
961 EleutherAI/pythia-410m 0.5B 23.6% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
962 allenai/OLMo-7B-Twin-2T 6.9B 23.6% Three-shot, text-only, float16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
963 Phi-1.5 23.5% Three-shot, text-only, float16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
964 AI-Sweden-Models/gpt-sw3-6.7b-v2 7.1B 23.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
965 Weni/WeniGPT-Mistral-7B-instructBase 7.3B 23.5% Three-shot, text-only, float16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
966 M4-ai/tau-1.8B 1.8B 23.5% Three-shot, text-only, bfloat16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
967 cognitivecomputations/WizardLM-7B-Uncensored 7B 23.5% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
968 RogerioPiazzon/alpaca-lora-ptbr-7b 7B 23.5% Three-shot, text-only, float16, 2024-05-27 May 2024 huggingface.co Official leaderboard
969 projecte-aina/FLOR-760M 0.8B 23.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
970 facebook/xglm-4.5B 5.1B 23.4% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
971 Llama 3.2 1B 23.4% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
972 NucleusAI/nucleus-22B-token-500B 21.8B 23.2% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
973 ericzzz/falcon-rw-1b-instruct-openorca 1.3B 23.2% Three-shot, text-only, bfloat16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
974 lucianosb/boto-27B 27.2B 23.2% Three-shot, text-only, bfloat16, 2024-07-12 Jul 2024 huggingface.co Official leaderboard
975 22h/cabrita_7b_pt_850000 7B 23.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
976 nicholasKluge/TeenyTinyLlama-160m 0.2B 23.1% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
977 openlm-research/open_llama_3b_v2 3.4B 22.9% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
978 fernandosola/bluearara-7B 7.2B 22.9% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
979 Oburaco/juridic-falcon-7b 7B 22.9% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
980 GPT-NeoX-20B 22.8% Three-shot, text-only, float16, 2024-02-05 Apr 2022 Feb 2024 huggingface.co Official leaderboard
981 TinyLlama/TinyLlama-1.1B-intermediate-step-1431k-3T 1.1B 22.8% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
982 TechxGenus/Jamba-v0.1-9B 9.3B 22.8% Three-shot, text-only, bfloat16, 2024-05-29 May 2024 huggingface.co Official leaderboard
983 SmolLM-1.7B 22.8% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
984 TucanoBR/Tucano-2b4-Instruct 2.4B 22.8% Three-shot, text-only, float16, 2024-12-03 Dec 2024 huggingface.co Official leaderboard
985 utter-project/EuroMoE-2.6B-A0.6B-Instruct-Preview 2.6B 22.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
986 MPT-7B 22.7% Three-shot, text-only, bfloat16, 2024-02-05 May 2023 Feb 2024 huggingface.co Official leaderboard
987 stabilityai/stablelm-base-alpha-3b-v2 2.8B 22.7% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
988 cerebras/Cerebras-GPT-590M 0.6B 22.7% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
989 EleutherAI/pythia-12b 12B 22.7% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
990 h2oai/h2o-danube-1.8b-base 1.8B 22.7% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
991 AI-Sweden-Models/gpt-sw3-20b 20.9B 22.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
992 EleutherAI/pythia-2.8b-deduped 2.9B 22.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
993 unicamp-dl/ptt5-base-portuguese-vocab 0.2B 22.5% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
994 unicamp-dl/ptt5-small-portuguese-vocab 0.1B 22.5% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
995 state-spaces/mamba-790m-hf 0.8B 22.5% Three-shot, text-only, float16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
996 Qwen2-0.5B 22.5% Three-shot, text-only, bfloat16, 2024-06-07 Jun 2024 Jun 2024 huggingface.co Official leaderboard
997 baidu/ERNIE-4.5-0.3B-PT 0.4B 22.5% Three-shot, text-only, bfloat16, 2025-08-31 Aug 2025 huggingface.co Official leaderboard
998 EleutherAI/pythia-2.8b 2.9B 22.4% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
999 nicolasdec/CabraMistral7b-0.4 7.2B 22.4% Three-shot, text-only, float16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
1000 proxectonos/FLOR-1.3B-GL 1.3B 22.4% Three-shot, text-only, float16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
1001 utter-project/EuroLLM-1.7B 1.7B 22.4% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 huggingface.co Official leaderboard
1002 openlm-research/open_llama_3b 3.4B 22.3% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1003 Gemma 3 1B PT 22.3% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
1004 EleutherAI/pythia-6.9b-deduped 6.9B 22.1% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1005 cerebras/Cerebras-GPT-6.7B 6.7B 22.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1006 Bruno/Caramelinho 7.1B 22.1% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 huggingface.co Official leaderboard
1007 GeneZC/MiniMA-2-1B 1.4B 22.1% Three-shot, text-only, float16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1008 Falcon-7B 22% Three-shot, text-only, bfloat16, 2024-02-05 Apr 2023 Feb 2024 huggingface.co Official leaderboard
1009 open_llama_7b 22% Three-shot, text-only, float16, 2024-02-11 Jun 2023 Feb 2024 huggingface.co Official leaderboard
1010 Ramikan-BR/TiamaPY-v31 1.1B 22% Three-shot, text-only, rev: d4612a5, float16, 2024-06-20 Jun 2024 huggingface.co Official leaderboard
1011 facebook/opt-30b 30B 21.8% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1012 Ramikan-BR/TiamaPY-v30 1.1B 21.8% Three-shot, text-only, rev: 300C415, float16, 2024-06-19 Jun 2024 huggingface.co Official leaderboard
1013 fernandosola/bluearara-7B-instruct-v02 7.2B 21.8% Three-shot, text-only, bfloat16, 2024-12-30 Dec 2024 huggingface.co Official leaderboard
1014 GPT-Neo-2.7B 21.7% Three-shot, text-only, float16, 2024-02-05 Mar 2021 Feb 2024 huggingface.co Official leaderboard
1015 LiteAI/Hare-1.1B-base 1.1B 21.7% Three-shot, text-only, float16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1016 projecte-aina/FLOR-6.3B 6.3B 21.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1017 facebook/galactica-6.7b 6.7B 21.6% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1018 TinyLlama/TinyLlama-1.1B-Chat-v1.0 1.1B 21.6% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
1019 recogna-nlp/gembode-2b-ultraalpaca-qlora 2.6B 21.6% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
1020 utter-project/EuroLLM-1.7B-Instruct 1.7B 21.6% Three-shot, text-only, float16, 2025-02-21 Feb 2025 huggingface.co Official leaderboard
1021 bigscience/bloom-1b7 1.7B 21.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1022 openai-community/gpt2-xl 1.6B 21.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1023 pierreguillou/gpt2-small-portuguese 0.1B 21.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1024 openai-community/gpt2-large 0.8B 21.3% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1025 facebook/galactica-1.3b 1.3B 21.3% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1026 JosephusCheung/LL7M 6.8B 21.3% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
1027 M4-ai/tau-0.5B-instruct-DPOP 0.5B 21.3% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
1028 MulaBR/Mula-8x160-v0.1 0.8B 21.3% Three-shot, text-only, float16, 2024-05-08 May 2024 huggingface.co Official leaderboard
1029 h2oai/h2o-danube-1.8b-sft 1.8B 21.3% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 huggingface.co Official leaderboard
1030 rhaymison/portuguese-phi1_5-tom-cat 1.4B 21.3% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 huggingface.co Official leaderboard
1031 22h/open-cabrita3b 3.6B 21.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1032 wandgibaut/periquito-3B 3.6B 21.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1033 allenai/OLMo-7B 6.9B 21% Three-shot, text-only, float16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
1034 PORTULAN/gervasio-7b-portuguese-ptbr-decoder 7B 21% Three-shot, text-only, bfloat16, 2024-03-07 Mar 2024 huggingface.co Official leaderboard
1035 facebook/opt-2.7b 2.7B 20.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1036 EleutherAI/pythia-70m 0.1B 20.9% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1037 dynamofl/dynamo-8B-v0.1 8.3B 20.7% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1038 HuggingFaceTB/cosmo-1b 1.7B 20.7% Three-shot, text-only, float16, 2024-02-24 Feb 2024 huggingface.co Official leaderboard
1039 pedrogengo/gemma-ptbr 2.5B 20.7% Three-shot, text-only, float16, 2024-03-28 Mar 2024 huggingface.co Official leaderboard
1040 recogna-nlp/phibode_1_5_ultraalpaca 1.4B 20.7% Three-shot, text-only, float16, 2024-05-12 May 2024 huggingface.co Official leaderboard
1041 BAAI/Emu3-Stage1 8.5B 20.7% Three-shot, text-only, bfloat16, 2024-10-21 Oct 2024 huggingface.co Official leaderboard
1042 bigscience/bloom-3b 3B 20.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1043 EleutherAI/pythia-1b-deduped 1.1B 20.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1044 openai-community/gpt2-medium 0.4B 20.6% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1045 nisten/Biggie-SmoLlm-0.15B-Base 0.2B 20.6% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
1046 EleutherAI/pythia-6.9b 6.9B 20.3% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1047 state-spaces/mamba-1.4b-hf 1.4B 20.3% Three-shot, text-only, float16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
1048 state-spaces/mamba-370m-hf 0.4B 20.3% Three-shot, text-only, float16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
1049 recogna-nlp/gembode-2b-base-ultraalpaca-qlora 2.6B 20.3% Three-shot, text-only, float16, 2024-04-23 Apr 2024 huggingface.co Official leaderboard
1050 baichuan-inc/Baichuan-7B 7B 20.2% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1051 EleutherAI/pythia-410m-deduped 0.5B 20.2% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1052 facebook/xglm-7.5B 7.5B 20.2% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1053 nicholasKluge/baseline 0.8B 20.2% Three-shot, text-only, float16, 2024-05-06 May 2024 huggingface.co Official leaderboard
1054 LiteAI/Hare-1.1B-Chat 1.1B 20% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1055 Qwen2.5-Coder-32B 20% Three-shot, text-only, bfloat16, 2024-11-12 Sep 2024 Nov 2024 huggingface.co Official leaderboard
1056 proxectonos/Llama-3.1-Carballo 8B 20% Three-shot, text-only, float16, 2025-04-01 Apr 2025 huggingface.co Official leaderboard
1057 facebook/xglm-1.7B 1.7B 19.9% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1058 state-spaces/mamba-2.8b-hf 2.8B 19.9% Three-shot, text-only, float16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
1059 adalbertojunior/Mistral-7b-Portuguese-V0.1 7.2B 19.9% Three-shot, text-only, bfloat16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
1060 Delta-Vector/Odin-9B 9.2B 19.9% Three-shot, text-only, bfloat16, 2024-10-29 Oct 2024 huggingface.co Official leaderboard
1061 facebook/xglm-2.9B 2.9B 19.8% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1062 facebook/xglm-564M 0.6B 19.8% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1063 cerebras/Cerebras-GPT-2.7B 2.7B 19.6% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1064 stabilityai/stablelm-base-alpha-3b 3.6B 19.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1065 BAAI/Emu3-Gen 8.5B 19.5% Three-shot, text-only, bfloat16, 2024-10-21 Oct 2024 huggingface.co Official leaderboard
1066 gpt2 0.1B 19.3% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1067 h2oai/h2o-danube-1.8b-chat 1.8B 19.3% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
1068 proxectonos/Cerebras-1.3B-GL 1.3B 19.3% Three-shot, text-only, bfloat16, 2024-04-24 Apr 2024 huggingface.co Official leaderboard
1069 OPT-1.3B 19.2% Three-shot, text-only, float16, 2024-02-05 May 2022 Feb 2024 huggingface.co Official leaderboard
1070 EleutherAI/pythia-1b 1.1B 19.2% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1071 Nos-PT/Carvalho_pt-gl-1.3B 1.3B 19.2% Three-shot, text-only, float16, 2024-06-26 Jun 2024 huggingface.co Official leaderboard
1072 SmolLM-135M 19.2% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
1073 facebook/opt-6.7b 6.7B 19.1% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1074 projecte-aina/aguila-7b 6.9B 19.1% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1075 EleutherAI/pythia-160m 0.2B 19.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1076 bigscience/bloom-560m 0.6B 18.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1077 stabilityai/stablelm-base-alpha-7b 7.9B 18.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1078 allenai/OLMo-1B 1.2B 18.9% Three-shot, text-only, float16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
1079 Qwen/Qwen1.5-0.5B 0.6B 18.9% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 huggingface.co Official leaderboard
1080 PORTULAN/gervasio-7b-portuguese-ptpt-decoder 7B 18.9% Three-shot, text-only, bfloat16, 2024-03-07 Mar 2024 huggingface.co Official leaderboard
1081 M4-ai/tau-0.5B 0.5B 18.9% Three-shot, text-only, float16, 2024-04-21 Apr 2024 huggingface.co Official leaderboard
1082 h2oai/h2o-danube3-500m-base 0.5B 18.9% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
1083 premai-io/prem-1B-chat 1.1B 18.9% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1084 Nos-PT/Llama-Carvalho-PT 8B 18.9% Three-shot, text-only, float16, 2025-04-01 Apr 2025 huggingface.co Official leaderboard
1085 Nos-PT/Llama-Carvalho-PT-GL 8B 18.9% Three-shot, text-only, float16, 2025-04-01 Apr 2025 huggingface.co Official leaderboard
1086 projecte-aina/FLOR-1.3B 1.3B 18.8% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1087 state-spaces/mamba-130m-hf 0.1B 18.8% Three-shot, text-only, float16, 2024-04-07 Apr 2024 huggingface.co Official leaderboard
1088 Ramikan-BR/tinyllama-coder-py-4bit-v10 1.1B 18.6% Three-shot, text-only, rev: da5637d, float16, 2024-05-28 May 2024 huggingface.co Official leaderboard
1089 h2oai/h2o-danube3-500m-chat 0.5B 18.6% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
1090 EleutherAI/gpt-neo-125m 0.2B 18.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1091 HuggingFaceTB/SmolLM-1.7B-Instruct 1.7B 18.5% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
1092 Gemma 3 270M 18.5% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
1093 EleutherAI/gpt-neo-1.3B 1.4B 18.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1094 EleutherAI/pythia-70m-deduped 0.1B 18.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1095 facebook/opt-125m 0.1B 18.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1096 josu/gpt-neo-pt-1.3B 1.3B 18.4% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1097 cerebras/Cerebras-GPT-256M 0.3B 18.4% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1098 facebook/opt-350m 0.4B 18.2% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1099 cerebras/Cerebras-GPT-111M 0.1B 18.1% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1100 EleutherAI/pythia-14m 0B 17.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1101 EleutherAI/pythia-160m-deduped 0.2B 17.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1102 josu/gpt-neo-pt-br 0.1B 17.7% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1103 nicholasKluge/Aira-2-portuguese-124M 0.1B 17.1% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1104 HuggingFaceTB/SmolLM-360M-Instruct 0.4B 16.7% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
1105 artificialguybr/llama3-8b-alpacadata-ptbr 8B 16.4% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
1106 HuggingFaceTB/SmolLM-135M-Instruct 0.1B 16.3% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 huggingface.co Official leaderboard
1107 FluxiIA/Tucaninho_dpo 2.4B 15.4% Three-shot, text-only, float16, 2025-03-24 Mar 2025 huggingface.co Official leaderboard
1108 FluxiIA/Tucaninho 2.4B 15.3% Three-shot, text-only, float16, 2025-02-27 Feb 2025 huggingface.co Official leaderboard
1109 facebook/galactica-125m 0.1B 14.9% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1110 BAAI/Aquila2-7B 7.3B 14.5% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1111 deepseek-ai/DeepSeek-V2-Lite 15.7B 14.5% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 huggingface.co Official leaderboard
1112 DeepSeek-R1-Distill-Qwen-1.5B 13.9% Three-shot, text-only, bfloat16, 2025-01-28 Jan 2025 Jan 2025 huggingface.co Official leaderboard
1113 T5-Large 13.5% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
1114 T5-Small 13.1% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
1115 pucpr/gpt2-bio-pt 0.1B 12.9% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1116 internlm/internlm2_5-7b 7.7B 11.3% Three-shot, text-only, bfloat16, 2024-07-05 Jul 2024 huggingface.co Official leaderboard
1117 Ramikan-BR/tinyllama-coder-py-v11 1.1B 10.7% Three-shot, text-only, rev: f1b5e2e, float16, 2024-05-28 May 2024 huggingface.co Official leaderboard
1118 dominguesm/mambarim-110m 0.1B 10.6% Three-shot, text-only, float16, 2024-04-15 Apr 2024 huggingface.co Official leaderboard
1119 Qwen/Qwen3-0.6B-Base 0.6B 10.6% Three-shot, text-only, bfloat16, 2025-05-01 May 2025 huggingface.co Official leaderboard
1120 ai-forever/mGPT-13B 13.1B 10.4% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1121 google/mt5-base 0.6B 10.3% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
1122 T5-Base 10.2% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
1123 NLPark/AnFeng_v3_Avocet 35B 9.60% Three-shot, text-only, bfloat16, 2024-05-22 May 2024 huggingface.co Official leaderboard
1124 lrds-code/samba-1.1B 1.1B 8.07% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1125 EleutherAI/polyglot-ko-12.8b 13.1B 7.51% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1126 Qwen2.5-0.5B 6.68% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
1127 adalbertojunior/NeuralDaredevil-Dolphin-Portuguese 8B 6.12% Three-shot, text-only, bfloat16, 2024-06-04 Jun 2024 huggingface.co Official leaderboard
1128 HeyLucasLeao/gpt-neo-small-portuguese 0.1B 3.89% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1129 JJhooww/Mistral_Reload_v4_Functions 7.2B 3.48% Three-shot, text-only, float16, 2024-06-15 Jun 2024 huggingface.co Official leaderboard
1130 NOVA-vision-language/GlorIA-1.3B 1.4B 3.20% Three-shot, text-only, float16, 2024-03-07 Mar 2024 huggingface.co Official leaderboard
1131 Ramikan-BR/tinyllama-coder-py-v12 1.1B 2.78% Three-shot, text-only, rev: abd0469, float16, 2024-05-28 May 2024 huggingface.co Official leaderboard
1132 Qwen/Qwen-1_8B-Chat 1.8B 1.11% Three-shot, text-only, bfloat16, 2024-02-22 Feb 2024 huggingface.co Official leaderboard
1133 ssmits/Falcon2-5.5B-multilingual 5.5B 0.83% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
1134 ssmits/Falcon2-5.5B-Portuguese 5.5B 0.83% Three-shot, text-only, bfloat16, 2024-05-27 May 2024 huggingface.co Official leaderboard
1135 monilouise/opt125M_portuguese 0.1B 0.70% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1136 Qwen/Qwen-72B-Chat 72.3B 0.70% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 huggingface.co Official leaderboard
1137 MTSAIR/multi_verse_model 7.2B 0.70% Three-shot, text-only, bfloat16, 2024-05-25 May 2024 huggingface.co Official leaderboard
1138 internlm/internlm2_5-20b 19.9B 0.70% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 huggingface.co Official leaderboard
1139 MaziyarPanahi/Calme-4x7B-MoE-v0.2 24.2B 0.42% Three-shot, text-only, bfloat16, 2024-06-17 Jun 2024 huggingface.co Official leaderboard
1140 nicholasKluge/Aira-2-portuguese-1B7 1.7B 0.28% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1141 MaziyarPanahi/Calme-4x7B-MoE-v0.1 24.2B 0.28% Three-shot, text-only, bfloat16, 2024-06-16 Jun 2024 huggingface.co Official leaderboard
1142 eduagarcia/gemma-7b-it_singleturn_chat_template 8.5B 0.14% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 huggingface.co Official leaderboard
1143 google/mt5-small 0.3B 0.14% Three-shot, text-only, float16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
1144 meta-llama/Meta-Llama-3-8B-Instruct 8B 0.14% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 huggingface.co Official leaderboard
1145 abacusai/Llama-3-Smaug-8B 8B 0.14% Three-shot, text-only, bfloat16, 2024-05-13 May 2024 huggingface.co Official leaderboard
1146 Qwen2.5-1.5B 0.14% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
1147 gaverfraxz/Meta-Llama-3.1-8B-Instruct-HalfAbliterated-TIES 8B 0.14% Three-shot, text-only, float16, 2024-09-19 Sep 2024 huggingface.co Official leaderboard
1148 RLHFlow/ArmoRM-Llama3-8B-v0.1 8B 0.14% Three-shot, text-only, bfloat16, 2024-10-08 Oct 2024 huggingface.co Official leaderboard
1149 nicholasKluge/Aira-2-portuguese-560M 0.6B 0% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1150 openai-community/openai-gpt 0.1B 0% Three-shot, text-only, float16, 2024-02-05 Feb 2024 huggingface.co Official leaderboard
1151 ai-forever/mGPT 1.4B 0% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1152 DAMO-NLP-MT/polylm-13b 13.9B 0% Three-shot, text-only, float16, 2024-02-11 Feb 2024 huggingface.co Official leaderboard
1153 rhaymison/gemma-portuguese-2b-it 2.5B 0% Three-shot, text-only, bfloat16, 2024-04-08 Apr 2024 huggingface.co Official leaderboard
1154 Weni/WeniGPT-Agents-Zephyr-1.0.17-KTO 7.3B 0% Three-shot, text-only, bfloat16, 2024-04-09 Apr 2024 huggingface.co Official leaderboard
1155 abhishek/autotrain-llama3-orpo-v2 8B 0% Three-shot, text-only, bfloat16, 2024-04-25 Apr 2024 huggingface.co Official leaderboard
1156 WizardLMTeam/WizardLM-13B-V1.0 13B 0% Three-shot, text-only, float16, 2024-05-22 May 2024 huggingface.co Official leaderboard
1157 recogna-nlp/phibode_1_5_ultraalpaca_qlora 1.5B 0% Three-shot, text-only, float16, 2024-05-31 May 2024 huggingface.co Official leaderboard
1158 cognitivess/bella-1-8b 8.1B 0% Three-shot, text-only, float16, 2024-06-24 Jun 2024 huggingface.co Official leaderboard
1159 GeneZC/MiniChat-1.5-3B 3B 0% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1160 GeneZC/MiniChat-2-3B 3B 0% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1161 GeneZC/MiniChat-3B 3B 0% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 huggingface.co Official leaderboard
1162 monsterapi/Llama-3_1-8B-Instruct-orca-ORPO 8.1B 0% Three-shot, text-only, bfloat16, 2024-08-30 Aug 2024 huggingface.co Official leaderboard
1163 kaist-ai/janus-rm-7b 7.2B 0% Three-shot, text-only, bfloat16, 2024-10-09 Oct 2024 huggingface.co Official leaderboard
1164 J-LAB/Qwen2.5_Thinik_base_v1.0 3.4B 0% Three-shot, text-only, float16, 2024-10-15 Oct 2024 huggingface.co Official leaderboard
1165 J-LAB/Thinik 3.1B 0% Three-shot, text-only, float16, 2024-10-15 Oct 2024 huggingface.co Official leaderboard
#ModelScoreSettingReleasedRun onLinkSource
1 Gemini 2.5 Pro Mar 2025 95% Three-shot, text-only, reasoning, 2025-04-03 Mar 2025 Apr 2025 aistudio.google.com Official leaderboard
2 GPT-5 mini 91.4% Three-shot, text-only, reasoning, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
3 Grok-3 mini 89.8% Three-shot, text-only, reasoning, 2025-09-01 Apr 2025 Sep 2025 x.ai Official leaderboard
4 Gemini 2.5 Flash Jun 2025 86.5% Three-shot, text-only, 2025-09-01 Jun 2025 Sep 2025 aistudio.google.com Official leaderboard
5 Qwen3-32B 85.8% Three-shot, text-only, 4bit, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
6 GPT-5 nano 85.3% Three-shot, text-only, reasoning, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
7 Claude 3.7 Sonnet 84.6% Three-shot, text-only, 2025-04-04 Feb 2025 Apr 2025 anthropic.com Official leaderboard
8 DeepSeek-V3 Mar 2025 84.1% Three-shot, text-only, 2025-04-03 Mar 2025 Apr 2025 huggingface.co Official leaderboard
9 Gemini 2.5 Flash-Lite Jun 2025 84% Three-shot, text-only, reasoning: low, 2025-09-01 Jun 2025 Sep 2025 aistudio.google.com Official leaderboard
10 Qwen3-14B 83.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
11 Qwen3-30B-A3B 83% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
12 Kimi K2 Jul 2025 82.8% Three-shot, text-only, 2025-09-01 Jul 2025 Sep 2025 huggingface.co Official leaderboard
13 DeepSeek-V3.1 81.8% Three-shot, text-only, 2025-09-01 Aug 2025 Sep 2025 huggingface.co Official leaderboard
14 Llama 4 Maverick 81.2% Three-shot, text-only, 2025-04-05 Apr 2025 Apr 2025 huggingface.co Official leaderboard
15 Qwen3-8B 80.7% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
16 Qwen2.5-VL-72B 80.5% Three-shot, text-only, 2025-04-03 Jan 2025 Apr 2025 huggingface.co Official leaderboard
17 Qwen2.5-VL-32B 80.5% Three-shot, text-only, 2025-04-03 Mar 2025 Apr 2025 huggingface.co Official leaderboard
18 Gemini 2.0 Flash Feb 2025 80.4% Three-shot, text-only, 2025-04-03 Feb 2025 Apr 2025 cloud.google.com Official leaderboard
19 GPT-4o Aug 2024 79.7% Three-shot, text-only, 2025-04-09 Aug 2024 Apr 2025 openai.com Official leaderboard
20 Qwen2.5-72B 79% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 Sep 2024 huggingface.co Official leaderboard
21 GPT-5 78.9% Three-shot, text-only, reasoning: minimal, 2025-09-01 Aug 2025 Sep 2025 openai.com Official leaderboard
22 Gemini 2.0 Flash-Lite 78.7% Three-shot, text-only, 2025-04-03 Feb 2025 Apr 2025 cloud.google.com Official leaderboard
23 Falcon-H1-34B 78.3% Three-shot, text-only, bfloat16, 2025-07-08 May 2025 Jul 2025 huggingface.co Official leaderboard
24 Qwen3-4B 78% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
25 Qwen3-30B-A3B-Instruct Jul 2025 76.9% Three-shot, text-only, bfloat16, 2025-08-30 Jul 2025 Aug 2025 huggingface.co Official leaderboard
26 Qwen2.5-32B 76.8% Three-shot, text-only, bfloat16, 2024-09-18 Sep 2024 Sep 2024 huggingface.co Official leaderboard
27 QwQ-32B-Preview 76.6% Three-shot, text-only, bfloat16, 2024-12-03 Nov 2024 Dec 2024 huggingface.co Official leaderboard
28 DeepSeek-R1-Distill-Qwen-14B 76.5% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
29 Gemini 1.5 Flash Sep 2024 76.1% Three-shot, text-only, 2025-04-03 Aug 2024 Apr 2025 cloud.google.com Official leaderboard
30 Llama 3.3 70B Instruct 75.9% Three-shot, text-only, 2025-04-03 Dec 2024 Apr 2025 huggingface.co Official leaderboard
31 Gemini 1.5 Flash May 2024 75.8% Three-shot, text-only, 2024-08-09 May 2024 Aug 2024 cloud.google.com Official leaderboard
32 Qwen2-72B 75.4% Three-shot, text-only, bfloat16, 2024-06-08 Jun 2024 Jun 2024 huggingface.co Official leaderboard
33 Qwen2.5-14B-Instruct-1M 72% Three-shot, text-only, bfloat16, 2025-01-31 Jan 2025 Jan 2025 huggingface.co Official leaderboard
34 Llama 3.1-70B 71.2% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 Jul 2024 huggingface.co Official leaderboard
35 Llama 3.2 90B 71.1% Three-shot, text-only, 4bit, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
36 Llama 3-70B 70.4% Three-shot, text-only, bfloat16, 2024-04-18 Apr 2024 Apr 2024 huggingface.co Official leaderboard
37 Phi-4 70.2% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
38 Gemma 3 12B PT 68.2% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
39 Gemma 2 27B 68% Three-shot, text-only, bfloat16, 2024-07-02 Jun 2024 Jul 2024 huggingface.co Official leaderboard
40 Qwen1.5-110B 67.9% Three-shot, text-only, 4bit, 2024-05-23 Apr 2024 May 2024 huggingface.co Official leaderboard
41 Qwen2.5-Coder-14B 67.9% Three-shot, text-only, bfloat16, 2024-11-12 Sep 2024 Nov 2024 huggingface.co Official leaderboard
42 qwen3-4b-instruct-2507 67.7% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
43 Qwen1.5-72B 67.6% Three-shot, text-only, bfloat16, 2024-02-18 Feb 2024 Feb 2024 huggingface.co Official leaderboard
44 Qwen2.5-Coder-32B-Instruct 67.3% Three-shot, text-only, bfloat16, 2024-11-12 Nov 2024 Nov 2024 huggingface.co Official leaderboard
45 Yi-1.5-34B 66.6% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 May 2024 huggingface.co Official leaderboard
46 Gemma 3 12B 66.6% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
47 Yi-34B 66.5% Three-shot, text-only, bfloat16, 2024-02-05 Nov 2023 Feb 2024 huggingface.co Official leaderboard
48 Qwen2.5-Coder-14B-Instruct 66.5% Three-shot, text-only, bfloat16, 2024-11-12 Nov 2024 Nov 2024 huggingface.co Official leaderboard
49 Keye-VL-1.5-8B 65.9% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
50 WizardLM-2 8x22B 65.8% Three-shot, text-only, bfloat16, 2024-05-22 Apr 2024 May 2024 huggingface.co Official leaderboard
51 Nemotron-4-340B-Instruct 65.8% Three-shot, text-only, 2024-06-30 Jun 2024 Jun 2024 huggingface.co Official leaderboard
52 c4ai-command-r-08-2024 65.4% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2024 Aug 2025 huggingface.co Official leaderboard
53 Aya Expanse 32B 65.4% Three-shot, text-only, float16, 2024-10-27 Oct 2024 Oct 2024 huggingface.co Official leaderboard
54 OLMo 2 32B Instruct 65.4% Three-shot, text-only, bfloat16, 2025-05-01 Mar 2025 May 2025 huggingface.co Official leaderboard
55 GLM-4-9B-Chat 65% Three-shot, text-only, float16, 2024-06-09 Jun 2024 Jun 2024 huggingface.co Official leaderboard
56 GLM-4-9B 64.5% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 Jun 2024 huggingface.co Official leaderboard
57 Mixtral 8x7B 64.3% Three-shot, text-only, bfloat16, 2024-02-05 Dec 2023 Feb 2024 huggingface.co Official leaderboard
58 Qwen3-1.7B 64.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
59 Gemma 2 9B 64% Three-shot, text-only, bfloat16, 2024-07-02 Jun 2024 Jul 2024 huggingface.co Official leaderboard
60 Phi-3.5-MoE 63.4% Three-shot, text-only, 4bit, 2024-12-05 Aug 2024 Dec 2024 huggingface.co Official leaderboard
61 Tulu 2 DPO 70B 63% Three-shot, text-only, bfloat16, 2024-03-05 Nov 2023 Mar 2024 huggingface.co Official leaderboard
62 Falcon3-10B-Instruct 62.9% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
63 GPT-3.5 Turbo Jan 2024 62.5% Three-shot, text-only, 2024-03-08 Jan 2024 Mar 2024 openai.com Official leaderboard
64 phi-3-medium 14B 62.5% Three-shot, text-only, bfloat16, 2024-05-21 Apr 2024 May 2024 huggingface.co Official leaderboard
65 Command R (03-2024) 62% Three-shot, text-only, float16, 2024-04-05 Mar 2024 Apr 2024 huggingface.co Official leaderboard
66 GLM-4-9B-Chat-1M 61.9% Three-shot, text-only, bfloat16, 2024-06-05 Jun 2024 Jun 2024 huggingface.co Official leaderboard
67 Mistral-Nemo-Base-2407 61.8% Three-shot, text-only, bfloat16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
68 phi-3-small 7.4B 61.5% Three-shot, text-only, bfloat16, 2024-05-21 Apr 2024 May 2024 huggingface.co Official leaderboard
69 Phi-3-medium-128k-instruct 61.5% Three-shot, text-only, bfloat16, 2024-05-21 May 2024 May 2024 huggingface.co Official leaderboard
70 Llama 2-70B 61.3% Three-shot, text-only, float16, 2024-02-05 Jul 2023 Feb 2024 huggingface.co Official leaderboard
71 InternLM2.5-20B-Chat 61.3% Three-shot, text-only, bfloat16, 2024-08-09 Aug 2024 Aug 2024 huggingface.co Official leaderboard
72 Falcon3-7B-Instruct 61.3% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
73 Qwen2-7B 61.1% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 Jun 2024 huggingface.co Official leaderboard
74 Qwen2-7B-Instruct 61.1% Three-shot, text-only, bfloat16, 2024-06-06 Jun 2024 Jun 2024 huggingface.co Official leaderboard
75 Qwen1.5-14B-Chat 60.8% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 Feb 2024 huggingface.co Official leaderboard
76 Qwen3-4B-Thinking-2507 60.8% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
77 Aria 60.6% Three-shot, text-only, bfloat16, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
78 Llama 3.1-8B 59.9% Three-shot, text-only, bfloat16, 2024-07-23 Jul 2024 Jul 2024 huggingface.co Official leaderboard
79 Llama 3.2 11B 59.3% Three-shot, text-only, bfloat16, 2024-12-05 Sep 2024 Dec 2024 huggingface.co Official leaderboard
80 Gemini 1.0 Pro 58.7% Three-shot, text-only, 2024-03-08 Dec 2023 Mar 2024 ai.google.dev Official leaderboard
81 SOLAR-10.7B-Instruct-v1.0 58.3% Three-shot, text-only, float16, 2024-02-19 Dec 2023 Feb 2024 huggingface.co Official leaderboard
82 Qwen2.5-Coder (7B) 57.9% Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 Sep 2024 Oct 2024 huggingface.co Official leaderboard
83 Llama 3-8B 57.3% Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 Apr 2024 Apr 2024 huggingface.co Official leaderboard
84 Granite-3.1-8B-Instruct 57.3% Three-shot, text-only, float16, 2025-08-29 Dec 2024 Aug 2025 huggingface.co Official leaderboard
85 Phi-4-reasoning 56.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
86 Gemma 7B 56.5% Three-shot, text-only, bfloat16, 2024-02-21 Feb 2024 Feb 2024 huggingface.co Official leaderboard
87 Phi-4-Reasoning-plus 55.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
88 Starling-LM-7B-alpha 55.6% Three-shot, text-only, bfloat16, 2024-03-04 Nov 2023 Mar 2024 huggingface.co Official leaderboard
89 Qwen-14B 55.5% Three-shot, text-only, float16, 2024-04-18 Sep 2023 Apr 2024 huggingface.co Official leaderboard
90 LLaMA-65B 55.4% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
91 Nous-Hermes-2-Mixtral-8x7B-DPO 55.4% Three-shot, text-only, bfloat16, 2024-02-27 Jan 2024 Feb 2024 huggingface.co Official leaderboard
92 Yi-9B 54.9% Three-shot, text-only, bfloat16, 2024-04-13 Mar 2024 Apr 2024 huggingface.co Official leaderboard
93 Yi-1.5-9B-Chat 54.8% Three-shot, text-only, bfloat16, 2024-05-15 May 2024 May 2024 huggingface.co Official leaderboard
94 Aya Expanse 8B 54.4% Three-shot, text-only, float16, 2024-10-24 Oct 2024 Oct 2024 huggingface.co Official leaderboard
95 Qwen1.5-32B 54.1% Three-shot, text-only, bfloat16, 2024-04-08 Feb 2024 Apr 2024 huggingface.co Official leaderboard
96 Phi-3-mini-128k-instruct 54.1% Three-shot, text-only, bfloat16, 2024-04-23 Apr 2024 Apr 2024 huggingface.co Official leaderboard
97 phi-3-mini 3.8B 54% Three-shot, text-only, bfloat16, 2024-04-23 Apr 2024 Apr 2024 huggingface.co Official leaderboard
98 Starling-LM-7B-beta 53.8% Three-shot, text-only, bfloat16, 2024-03-29 Mar 2024 Mar 2024 huggingface.co Official leaderboard
99 Mistral 7B v0.2 53.1% Three-shot, text-only, bfloat16, 2024-04-17 Dec 2023 Apr 2024 huggingface.co Official leaderboard
100 DeepSeek-R1-Distill-Qwen-7B 52.9% Three-shot, text-only, bfloat16, 2025-01-28 Jan 2025 Jan 2025 huggingface.co Official leaderboard
101 internlm-20b 52.6% Three-shot, text-only, bfloat16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
102 Mistral 7B v0.3 52.3% Three-shot, text-only, bfloat16, 2024-05-22 Sep 2023 May 2024 huggingface.co Official leaderboard
103 Qwen1.5-7B-Chat 52.3% Three-shot, text-only, bfloat16, 2024-02-24 Feb 2024 Feb 2024 huggingface.co Official leaderboard
104 Gemma 3 4B 52.3% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
105 Mistral-7B-Instruct-v0.2 52.2% Three-shot, text-only, bfloat16, 2024-02-18 Dec 2023 Feb 2024 huggingface.co Official leaderboard
106 Qwen2.5-7B 52% Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 Sep 2024 Oct 2024 huggingface.co Official leaderboard
107 Qwen3-14B-Base 51.5% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
108 Yi 6B 51.3% Three-shot, text-only, bfloat16, 2024-02-05 Nov 2023 Feb 2024 huggingface.co Official leaderboard
109 Zephyr 7B Alpha 51% Three-shot, text-only, bfloat16, 2024-04-14 Oct 2023 Apr 2024 huggingface.co Official leaderboard
110 Llama 3.2 3B 50.5% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
111 Mistral 7B v0.1 50.2% Three-shot, text-only, bfloat16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
112 Qwen3-30B-A3B-Base 50.2% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
113 Yi-6B-Chat 50.1% Three-shot, text-only, bfloat16, 2024-02-27 Nov 2023 Feb 2024 huggingface.co Official leaderboard
114 Falcon-40B 49.6% Three-shot, text-only, bfloat16, 2024-02-05 Mar 2023 Feb 2024 huggingface.co Official leaderboard
115 MAmmoTH2-7B-Plus 49% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 May 2024 huggingface.co Official leaderboard
116 Qwen-7B 48.8% Three-shot, text-only, float16, 2024-04-18 Sep 2023 Apr 2024 huggingface.co Official leaderboard
117 Gemma 2 2B IT 48.1% Three-shot, text-only, bfloat16, 2024-08-09 Jul 2024 Aug 2024 huggingface.co Official leaderboard
118 Zephyr 7B Beta 48% Three-shot, text-only, bfloat16, 2024-02-21 Oct 2023 Feb 2024 huggingface.co Official leaderboard
119 Gemma 1.1 7B IT 47.7% Three-shot, text-only, bfloat16, 2024-04-07 Apr 2024 Apr 2024 huggingface.co Official leaderboard
120 Gemma 3n E2B 47.3% Three-shot, text-only, bfloat16, 2025-07-15 Jun 2025 Jul 2025 huggingface.co Official leaderboard
121 Qwen1.5-4B-Chat 46.6% Three-shot, text-only, bfloat16, 2024-02-23 Feb 2024 Feb 2024 huggingface.co Official leaderboard
122 Falcon3-3B-Instruct 46.5% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
123 Yi-1.5-6B-Chat 46.3% Three-shot, text-only, bfloat16, 2024-05-16 May 2024 May 2024 huggingface.co Official leaderboard
124 Qwen2.5-3B 46.2% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
125 Qwen1.5-14B 45.6% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 Feb 2024 huggingface.co Official leaderboard
126 DeepSeek-R1-Distill-Llama-70B 45.6% Three-shot, text-only, 4bit, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
127 Qwen3-4B-Base 45.3% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
128 Qwen3-0.6B 43.4% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
129 LFM2-1.2B 42.3% Three-shot, text-only, bfloat16, 2025-08-30 Jul 2025 Aug 2025 huggingface.co Official leaderboard
130 Mistral-7B-Instruct-v0.1 41.6% Three-shot, text-only, bfloat16, 2024-05-27 Sep 2023 May 2024 huggingface.co Official leaderboard
131 MPT-30B 38.7% Three-shot, text-only, bfloat16, 2024-02-05 Jun 2023 Feb 2024 huggingface.co Official leaderboard
132 gpt-oss-20b 37.7% Three-shot, text-only, bfloat16, 2025-08-29 Aug 2025 Aug 2025 huggingface.co Official leaderboard
133 Qwen1.5-7B 37.5% Three-shot, text-only, bfloat16, 2024-02-17 Feb 2024 Feb 2024 huggingface.co Official leaderboard
134 Qwen3-8B-Base 36% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
135 ChatGLM3-6B 35.6% Three-shot, text-only, float16, 2024-02-19 Oct 2023 Feb 2024 huggingface.co Official leaderboard
136 Qwen2-0.5B-Instruct 34.5% Three-shot, text-only, bfloat16, 2024-06-07 Jun 2024 Jun 2024 huggingface.co Official leaderboard
137 internlm-7b 33.5% Three-shot, text-only, float16, 2024-02-05 Jul 2023 Feb 2024 huggingface.co Official leaderboard
138 Gemma 3 1B 33% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
139 LLaMA-13B 32.8% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
140 Falcon3-1B-Instruct 31.6% Three-shot, text-only, bfloat16, 2025-01-29 Dec 2024 Jan 2025 huggingface.co Official leaderboard
141 MAmmoTH2-8B-Plus 30.3% Three-shot, text-only, bfloat16, 2024-05-17 May 2024 May 2024 huggingface.co Official leaderboard
142 chatglm2-6b 29.9% Three-shot, text-only, float16, 2024-04-05 Jun 2023 Apr 2024 huggingface.co Official leaderboard
143 DeepSeek-R1-Distill-Qwen-32B 29.2% Three-shot, text-only, bfloat16, 2025-01-29 Jan 2025 Jan 2025 huggingface.co Official leaderboard
144 Gemma 2B 28.4% Three-shot, text-only, bfloat16, 2024-02-21 Feb 2024 Feb 2024 huggingface.co Official leaderboard
145 Phi-2 27% Three-shot, text-only, float16, 2024-02-05 Dec 2023 Feb 2024 huggingface.co Official leaderboard
146 Baichuan2-13B-Chat 26.3% Three-shot, text-only, bfloat16, 2024-05-27 Sep 2023 May 2024 huggingface.co Official leaderboard
147 Qwen-1_8B 26.3% Three-shot, text-only, float16, 2024-04-18 Nov 2023 Apr 2024 huggingface.co Official leaderboard
148 OPT-66B 25.6% Three-shot, text-only, float16, 2024-02-05 May 2022 Feb 2024 huggingface.co Official leaderboard
149 gpt-oss-120b 25.6% Three-shot, text-only, bfloat16, 2025-08-29 Aug 2025 Aug 2025 huggingface.co Official leaderboard
150 SmolLM-360M 25.3% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
151 RedPajama-INCITE-7B-Base 25% Three-shot, text-only, float16, 2024-02-05 May 2023 Feb 2024 huggingface.co Official leaderboard
152 Gemma 1.1 2B IT 24.9% Three-shot, text-only, bfloat16, 2024-04-07 Apr 2024 Apr 2024 huggingface.co Official leaderboard
153 OLMo 2 1B Instruct 24.9% Three-shot, text-only, bfloat16, 2025-05-01 Apr 2025 May 2025 huggingface.co Official leaderboard
154 Cerebras-GPT-13B 24.2% Three-shot, text-only, float16, 2024-02-11 Mar 2023 Feb 2024 huggingface.co Official leaderboard
155 Emu3-Chat 24.1% Three-shot, text-only, bfloat16, 2024-10-21 Sep 2024 Oct 2024 huggingface.co Official leaderboard
156 LLaMA-7B 23.9% Three-shot, text-only, float16, 2024-02-05 Feb 2023 Feb 2024 huggingface.co Official leaderboard
157 GPT-J-6B 23.6% Three-shot, text-only, float16, 2024-02-05 Aug 2021 Feb 2024 huggingface.co Official leaderboard
158 Phi-1.5 23.5% Three-shot, text-only, float16, 2024-02-05 Sep 2023 Feb 2024 huggingface.co Official leaderboard
159 Llama 3.2 1B 23.4% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
160 GPT-NeoX-20B 22.8% Three-shot, text-only, float16, 2024-02-05 Apr 2022 Feb 2024 huggingface.co Official leaderboard
161 SmolLM-1.7B 22.8% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
162 MPT-7B 22.7% Three-shot, text-only, bfloat16, 2024-02-05 May 2023 Feb 2024 huggingface.co Official leaderboard
163 Qwen2-0.5B 22.5% Three-shot, text-only, bfloat16, 2024-06-07 Jun 2024 Jun 2024 huggingface.co Official leaderboard
164 Gemma 3 1B PT 22.3% Three-shot, text-only, bfloat16, 2025-04-04 Mar 2025 Apr 2025 huggingface.co Official leaderboard
165 Falcon-7B 22% Three-shot, text-only, bfloat16, 2024-02-05 Apr 2023 Feb 2024 huggingface.co Official leaderboard
166 open_llama_7b 22% Three-shot, text-only, float16, 2024-02-11 Jun 2023 Feb 2024 huggingface.co Official leaderboard
167 GPT-Neo-2.7B 21.7% Three-shot, text-only, float16, 2024-02-05 Mar 2021 Feb 2024 huggingface.co Official leaderboard
168 Qwen2.5-Coder-32B 20% Three-shot, text-only, bfloat16, 2024-11-12 Sep 2024 Nov 2024 huggingface.co Official leaderboard
169 OPT-1.3B 19.2% Three-shot, text-only, float16, 2024-02-05 May 2022 Feb 2024 huggingface.co Official leaderboard
170 SmolLM-135M 19.2% Three-shot, text-only, float16, 2024-07-22 Jul 2024 Jul 2024 huggingface.co Official leaderboard
171 Gemma 3 270M 18.5% Three-shot, text-only, bfloat16, 2025-08-30 Aug 2025 Aug 2025 huggingface.co Official leaderboard
172 DeepSeek-R1-Distill-Qwen-1.5B 13.9% Three-shot, text-only, bfloat16, 2025-01-28 Jan 2025 Jan 2025 huggingface.co Official leaderboard
173 T5-Large 13.5% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
174 T5-Small 13.1% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
175 T5-Base 10.2% Three-shot, text-only, bfloat16, 2024-02-05 Feb 2024 Feb 2024 huggingface.co Official leaderboard
176 Qwen2.5-0.5B 6.68% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard
177 Qwen2.5-1.5B 0.14% Three-shot, text-only, bfloat16, 2024-12-03 Sep 2024 Dec 2024 huggingface.co Official leaderboard

Scores at each effort level

Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.

Lowest effort to highest, light to dark
Gemini 2.5 Flash-Lite
Three-shot,… Three-shot,…
84%
Qwen2.5-72B
Three-shot,… Three-shot,…
79%
Llama 3.3 70B Instruct
Three-shot,… Three-shot,…
75.9%
Qwen2-72B
Three-shot,…
75.4%
Qwen1.5-72B
Three-shot,… Three-shot,…
67.6%
WizardLM-2 8x22B
Three-shot,…
65.8%
GLM-4-9B-Chat
Three-shot,… Three-shot,…
65%
Qwen2.5-Coder (7B)
Three-shot,… Three-shot,…
57.9%
Llama 3-8B
Three-shot,… Three-shot,…
57.3%
Qwen-14B
Three-shot,…
55.5%
Nous-Hermes-2-Mixtral-8x7B-DPO
Three-shot,…
55.4%
Mistral 7B v0.3
Three-shot,…
52.3%

Source: Open Portuguese LLM Leaderboard’s leaderboard

ModelEffortHarnessScoreCost per taskOutput tokens
Gemini 2.5 Pro Mar 2025 Three-shot, text-only, reasoning, 2025-04-03 95%
GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
Gemini 2.5 Flash Jun 2025 Three-shot, text-only, 2025-09-01 86.5%
Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
DeepSeek-V3 Mar 2025 Three-shot, text-only, 2025-04-03 84.1%
Gemini 2.5 Flash-Lite Jun 2025 Three-shot, text-only, reasoning: low, 2025-09-01 84%
Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
Kimi K2 Jul 2025 Three-shot, text-only, 2025-09-01 82.8%
DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
Gemini 2.0 Flash Feb 2025 Three-shot, text-only, 2025-04-03 80.4%
GPT-4o Aug 2024 Three-shot, text-only, 2025-04-09 79.7%
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
Qwen2.5-72B Three-shot, text-only, 2025-04-03 78%
Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
Qwen2.5-72B Three-shot, text-only, 4bit, 2024-12-04 77.6%
Qwen3-30B-A3B-Instruct Jul 2025 Three-shot, text-only, bfloat16, 2025-08-30 76.9%
Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
Gemini 1.5 Flash Sep 2024 Three-shot, text-only, 2025-04-03 76.1%
Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
Gemini 1.5 Flash May 2024 Three-shot, text-only, 2024-08-09 75.8%
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75%
Qwen2-72B Three-shot, text-only, 4bit, 2024-08-12 74.4%
Gemini 2.5 Flash-Lite Jun 2025 Three-shot, text-only, 2025-09-01 73.3%
Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
WizardLM-2 8x22B Three-shot, text-only, 4bit, 2024-05-22 65.8%
Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
GLM-4-9B-Chat Three-shot, text-only, bfloat16, 2024-06-05 64.8%
GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
Llama 3.3 70B Instruct Three-shot, text-only, 4bit, 2024-12-20 64.3%
Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
GPT-3.5 Turbo Jan 2024 Three-shot, text-only, 2024-03-08 62.5%
phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 60.2%
Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
Llama 3-8B Three-shot, text-only, bfloat16, 2024-05-21 57.3%
Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
GLM-4-9B-Chat Three-shot, text-only, bfloat16, 2024-12-05 56%
Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
Qwen-14B Three-shot, text-only, bfloat16, 2024-02-05 55.5%
LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, float16, 2024-02-21 55.4%
Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-17 53%
DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-26 52.3%
Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
Qwen-7B Three-shot, text-only, bfloat16, 2024-02-05 48.7%
Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
Gemma 2 2B IT Three-shot, text-only, 8bit, 2024-08-09 47.6%
Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
Qwen3-4B-Base Three-shot, text-only, float16, 2025-09-01 37.4%
Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
Qwen2.5-Coder (7B) Three-shot, text-only, bfloat16, 2024-10-13 32.8%
Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
Qwen-1_8B Three-shot, text-only, bfloat16, 2024-02-05 26.1%
OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 23.5%
Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 18.6%
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.2%
Llama 3-8B Three-shot, text-only, rev: refs/pr/33, bfloat16, 2024-04-19 17.7%
DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%
Gemma 3 270M Three-shot, text-only, float16, 2025-08-30 0%

Scores at each effort level

Models the leaderboard ran at two or more effort levels. We don’t have enough cost data here to say what the extra effort costs.

Lowest effort to highest, light to dark
Gemini 2.5 Flash-Lite
Three-shot,… Three-shot,…
84%
Qwen2.5-72B
Three-shot,… Three-shot,…
79%
Llama 3.3 70B Instruct
Three-shot,… Three-shot,…
75.9%
Qwen2-72B
Three-shot,…
75.4%
Qwen1.5-72B
Three-shot,… Three-shot,…
67.6%
WizardLM-2 8x22B
Three-shot,…
65.8%
GLM-4-9B-Chat
Three-shot,… Three-shot,…
65%
Qwen2.5-Coder (7B)
Three-shot,… Three-shot,…
57.9%
Llama 3-8B
Three-shot,… Three-shot,…
57.3%
Qwen-14B
Three-shot,…
55.5%
Nous-Hermes-2-Mixtral-8x7B-DPO
Three-shot,…
55.4%
Mistral 7B v0.3
Three-shot,…
52.3%

Source: Open Portuguese LLM Leaderboard’s leaderboard

ModelEffortHarnessScoreCost per taskOutput tokens
Gemini 2.5 Pro Mar 2025 Three-shot, text-only, reasoning, 2025-04-03 95%
GPT-5 mini Three-shot, text-only, reasoning, 2025-09-01 91.4%
Grok-3 mini Three-shot, text-only, reasoning, 2025-09-01 89.8%
Gemini 2.5 Flash Jun 2025 Three-shot, text-only, 2025-09-01 86.5%
Qwen3-32B Three-shot, text-only, 4bit, 2025-05-01 85.8%
GPT-5 nano Three-shot, text-only, reasoning, 2025-09-01 85.3%
Claude 3.7 Sonnet Three-shot, text-only, 2025-04-04 84.6%
DeepSeek-V3 Mar 2025 Three-shot, text-only, 2025-04-03 84.1%
Gemini 2.5 Flash-Lite Jun 2025 Three-shot, text-only, reasoning: low, 2025-09-01 84%
Qwen3-14B Three-shot, text-only, bfloat16, 2025-05-01 83.3%
Qwen3-30B-A3B Three-shot, text-only, bfloat16, 2025-05-01 83%
Kimi K2 Jul 2025 Three-shot, text-only, 2025-09-01 82.8%
DeepSeek-V3.1 Three-shot, text-only, 2025-09-01 81.8%
Llama 4 Maverick Three-shot, text-only, 2025-04-05 81.2%
Qwen3-8B Three-shot, text-only, bfloat16, 2025-05-01 80.7%
Qwen2.5-VL-72B Three-shot, text-only, 2025-04-03 80.5%
Qwen2.5-VL-32B Three-shot, text-only, 2025-04-03 80.5%
Gemini 2.0 Flash Feb 2025 Three-shot, text-only, 2025-04-03 80.4%
GPT-4o Aug 2024 Three-shot, text-only, 2025-04-09 79.7%
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 79%
GPT-5 Three-shot, text-only, reasoning: minimal, 2025-09-01 78.9%
Gemini 2.0 Flash-Lite Three-shot, text-only, 2025-04-03 78.7%
Falcon-H1-34B Three-shot, text-only, bfloat16, 2025-07-08 78.3%
Qwen2.5-72B Three-shot, text-only, 2025-04-03 78%
Qwen3-4B Three-shot, text-only, bfloat16, 2025-05-01 78%
Qwen2.5-72B Three-shot, text-only, 4bit, 2024-12-04 77.6%
Qwen3-30B-A3B-Instruct Jul 2025 Three-shot, text-only, bfloat16, 2025-08-30 76.9%
Qwen2.5-32B Three-shot, text-only, bfloat16, 2024-09-18 76.8%
QwQ-32B-Preview Three-shot, text-only, bfloat16, 2024-12-03 76.6%
DeepSeek-R1-Distill-Qwen-14B Three-shot, text-only, bfloat16, 2025-01-29 76.5%
Gemini 1.5 Flash Sep 2024 Three-shot, text-only, 2025-04-03 76.1%
Llama 3.3 70B Instruct Three-shot, text-only, 2025-04-03 75.9%
Gemini 1.5 Flash May 2024 Three-shot, text-only, 2024-08-09 75.8%
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75.4%
Qwen2-72B Three-shot, text-only, bfloat16, 2024-06-08 75%
Qwen2-72B Three-shot, text-only, 4bit, 2024-08-12 74.4%
Gemini 2.5 Flash-Lite Jun 2025 Three-shot, text-only, 2025-09-01 73.3%
Qwen2.5-14B-Instruct-1M Three-shot, text-only, bfloat16, 2025-01-31 72%
Llama 3.1-70B Three-shot, text-only, bfloat16, 2024-07-23 71.2%
Llama 3.2 90B Three-shot, text-only, 4bit, 2024-12-05 71.1%
Llama 3-70B Three-shot, text-only, bfloat16, 2024-04-18 70.4%
Phi-4 Three-shot, text-only, bfloat16, 2025-01-29 70.2%
Gemma 3 12B PT Three-shot, text-only, bfloat16, 2025-04-04 68.2%
Gemma 2 27B Three-shot, text-only, bfloat16, 2024-07-02 68%
Qwen1.5-110B Three-shot, text-only, 4bit, 2024-05-23 67.9%
Qwen2.5-Coder-14B Three-shot, text-only, bfloat16, 2024-11-12 67.9%
qwen3-4b-instruct-2507 Three-shot, text-only, bfloat16, 2025-08-30 67.7%
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-18 67.6%
Qwen2.5-Coder-32B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 67.3%
Yi-1.5-34B Three-shot, text-only, bfloat16, 2024-05-15 66.6%
Gemma 3 12B Three-shot, text-only, bfloat16, 2025-04-04 66.6%
Yi-34B Three-shot, text-only, bfloat16, 2024-02-05 66.5%
Qwen2.5-Coder-14B-Instruct Three-shot, text-only, bfloat16, 2024-11-12 66.5%
Keye-VL-1.5-8B Three-shot, text-only, bfloat16, 2025-08-30 65.9%
WizardLM-2 8x22B Three-shot, text-only, bfloat16, 2024-05-22 65.8%
WizardLM-2 8x22B Three-shot, text-only, 4bit, 2024-05-22 65.8%
Nemotron-4-340B-Instruct Three-shot, text-only, 2024-06-30 65.8%
c4ai-command-r-08-2024 Three-shot, text-only, bfloat16, 2025-08-30 65.4%
Aya Expanse 32B Three-shot, text-only, float16, 2024-10-27 65.4%
OLMo 2 32B Instruct Three-shot, text-only, bfloat16, 2025-05-01 65.4%
GLM-4-9B-Chat Three-shot, text-only, float16, 2024-06-09 65%
GLM-4-9B-Chat Three-shot, text-only, bfloat16, 2024-06-05 64.8%
GLM-4-9B Three-shot, text-only, bfloat16, 2024-06-05 64.5%
Mixtral 8x7B Three-shot, text-only, bfloat16, 2024-02-05 64.3%
Llama 3.3 70B Instruct Three-shot, text-only, 4bit, 2024-12-20 64.3%
Qwen3-1.7B Three-shot, text-only, bfloat16, 2025-05-01 64.3%
Gemma 2 9B Three-shot, text-only, bfloat16, 2024-07-02 64%
Phi-3.5-MoE Three-shot, text-only, 4bit, 2024-12-05 63.4%
Tulu 2 DPO 70B Three-shot, text-only, bfloat16, 2024-03-05 63%
Falcon3-10B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 62.9%
GPT-3.5 Turbo Jan 2024 Three-shot, text-only, 2024-03-08 62.5%
phi-3-medium 14B Three-shot, text-only, bfloat16, 2024-05-21 62.5%
Command R (03-2024) Three-shot, text-only, float16, 2024-04-05 62%
GLM-4-9B-Chat-1M Three-shot, text-only, bfloat16, 2024-06-05 61.9%
Mistral-Nemo-Base-2407 Three-shot, text-only, bfloat16, 2024-07-22 61.8%
phi-3-small 7.4B Three-shot, text-only, bfloat16, 2024-05-21 61.5%
Phi-3-medium-128k-instruct Three-shot, text-only, bfloat16, 2024-05-21 61.5%
Llama 2-70B Three-shot, text-only, float16, 2024-02-05 61.3%
InternLM2.5-20B-Chat Three-shot, text-only, bfloat16, 2024-08-09 61.3%
Falcon3-7B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 61.3%
Qwen2-7B Three-shot, text-only, bfloat16, 2024-06-06 61.1%
Qwen2-7B-Instruct Three-shot, text-only, bfloat16, 2024-06-06 61.1%
Qwen1.5-14B-Chat Three-shot, text-only, bfloat16, 2024-02-23 60.8%
Qwen3-4B-Thinking-2507 Three-shot, text-only, bfloat16, 2025-08-30 60.8%
Aria Three-shot, text-only, bfloat16, 2024-12-05 60.6%
Qwen2.5-72B Three-shot, text-only, bfloat16, 2024-09-18 60.2%
Llama 3.1-8B Three-shot, text-only, bfloat16, 2024-07-23 59.9%
Llama 3.2 11B Three-shot, text-only, bfloat16, 2024-12-05 59.3%
Gemini 1.0 Pro Three-shot, text-only, 2024-03-08 58.7%
SOLAR-10.7B-Instruct-v1.0 Three-shot, text-only, float16, 2024-02-19 58.3%
Qwen2.5-Coder (7B) Three-shot, text-only, rev: 8e82b34, bfloat16, 2024-10-15 57.9%
Llama 3-8B Three-shot, text-only, rev: refs/pr/41, bfloat16, 2024-04-21 57.3%
Llama 3-8B Three-shot, text-only, bfloat16, 2024-05-21 57.3%
Granite-3.1-8B-Instruct Three-shot, text-only, float16, 2025-08-29 57.3%
Phi-4-reasoning Three-shot, text-only, bfloat16, 2025-05-01 56.9%
Gemma 7B Three-shot, text-only, bfloat16, 2024-02-21 56.5%
GLM-4-9B-Chat Three-shot, text-only, bfloat16, 2024-12-05 56%
Phi-4-Reasoning-plus Three-shot, text-only, bfloat16, 2025-05-01 55.9%
Starling-LM-7B-alpha Three-shot, text-only, bfloat16, 2024-03-04 55.6%
Qwen-14B Three-shot, text-only, float16, 2024-04-18 55.5%
Qwen-14B Three-shot, text-only, bfloat16, 2024-02-05 55.5%
LLaMA-65B Three-shot, text-only, float16, 2024-02-05 55.4%
Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, bfloat16, 2024-02-27 55.4%
Nous-Hermes-2-Mixtral-8x7B-DPO Three-shot, text-only, float16, 2024-02-21 55.4%
Yi-9B Three-shot, text-only, bfloat16, 2024-04-13 54.9%
Yi-1.5-9B-Chat Three-shot, text-only, bfloat16, 2024-05-15 54.8%
Aya Expanse 8B Three-shot, text-only, float16, 2024-10-24 54.4%
Qwen1.5-32B Three-shot, text-only, bfloat16, 2024-04-08 54.1%
Phi-3-mini-128k-instruct Three-shot, text-only, bfloat16, 2024-04-23 54.1%
phi-3-mini 3.8B Three-shot, text-only, bfloat16, 2024-04-23 54%
Starling-LM-7B-beta Three-shot, text-only, bfloat16, 2024-03-29 53.8%
Mistral 7B v0.2 Three-shot, text-only, bfloat16, 2024-04-17 53.1%
Qwen1.5-72B Three-shot, text-only, bfloat16, 2024-02-17 53%
DeepSeek-R1-Distill-Qwen-7B Three-shot, text-only, bfloat16, 2025-01-28 52.9%
internlm-20b Three-shot, text-only, bfloat16, 2024-02-05 52.6%
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-22 52.3%
Mistral 7B v0.3 Three-shot, text-only, bfloat16, 2024-05-26 52.3%
Qwen1.5-7B-Chat Three-shot, text-only, bfloat16, 2024-02-24 52.3%
Gemma 3 4B Three-shot, text-only, bfloat16, 2025-04-04 52.3%
Mistral-7B-Instruct-v0.2 Three-shot, text-only, bfloat16, 2024-02-18 52.2%
Qwen2.5-7B Three-shot, text-only, rev: d149729, bfloat16, 2024-10-15 52%
Qwen3-14B-Base Three-shot, text-only, bfloat16, 2025-05-01 51.5%
Yi 6B Three-shot, text-only, bfloat16, 2024-02-05 51.3%
Zephyr 7B Alpha Three-shot, text-only, bfloat16, 2024-04-14 51%
Llama 3.2 3B Three-shot, text-only, bfloat16, 2024-12-03 50.5%
Mistral 7B v0.1 Three-shot, text-only, bfloat16, 2024-02-05 50.2%
Qwen3-30B-A3B-Base Three-shot, text-only, bfloat16, 2025-05-01 50.2%
Yi-6B-Chat Three-shot, text-only, bfloat16, 2024-02-27 50.1%
Falcon-40B Three-shot, text-only, bfloat16, 2024-02-05 49.6%
MAmmoTH2-7B-Plus Three-shot, text-only, bfloat16, 2024-05-17 49%
Qwen-7B Three-shot, text-only, float16, 2024-04-18 48.8%
Qwen-7B Three-shot, text-only, bfloat16, 2024-02-05 48.7%
Gemma 2 2B IT Three-shot, text-only, bfloat16, 2024-08-09 48.1%
Zephyr 7B Beta Three-shot, text-only, bfloat16, 2024-02-21 48%
Gemma 1.1 7B IT Three-shot, text-only, bfloat16, 2024-04-07 47.7%
Gemma 2 2B IT Three-shot, text-only, 8bit, 2024-08-09 47.6%
Gemma 3n E2B Three-shot, text-only, bfloat16, 2025-07-15 47.3%
Qwen1.5-4B-Chat Three-shot, text-only, bfloat16, 2024-02-23 46.6%
Falcon3-3B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 46.5%
Yi-1.5-6B-Chat Three-shot, text-only, bfloat16, 2024-05-16 46.3%
Qwen2.5-3B Three-shot, text-only, bfloat16, 2024-12-03 46.2%
Qwen1.5-14B Three-shot, text-only, bfloat16, 2024-02-17 45.6%
DeepSeek-R1-Distill-Llama-70B Three-shot, text-only, 4bit, 2025-01-29 45.6%
Qwen3-4B-Base Three-shot, text-only, bfloat16, 2025-05-01 45.3%
Qwen3-0.6B Three-shot, text-only, bfloat16, 2025-05-01 43.4%
LFM2-1.2B Three-shot, text-only, bfloat16, 2025-08-30 42.3%
Mistral-7B-Instruct-v0.1 Three-shot, text-only, bfloat16, 2024-05-27 41.6%
MPT-30B Three-shot, text-only, bfloat16, 2024-02-05 38.7%
gpt-oss-20b Three-shot, text-only, bfloat16, 2025-08-29 37.7%
Qwen1.5-7B Three-shot, text-only, bfloat16, 2024-02-17 37.5%
Qwen3-4B-Base Three-shot, text-only, float16, 2025-09-01 37.4%
Qwen3-8B-Base Three-shot, text-only, bfloat16, 2025-05-01 36%
ChatGLM3-6B Three-shot, text-only, float16, 2024-02-19 35.6%
Qwen2-0.5B-Instruct Three-shot, text-only, bfloat16, 2024-06-07 34.5%
internlm-7b Three-shot, text-only, float16, 2024-02-05 33.5%
Gemma 3 1B Three-shot, text-only, bfloat16, 2025-04-04 33%
LLaMA-13B Three-shot, text-only, float16, 2024-02-05 32.8%
Qwen2.5-Coder (7B) Three-shot, text-only, bfloat16, 2024-10-13 32.8%
Falcon3-1B-Instruct Three-shot, text-only, bfloat16, 2025-01-29 31.6%
MAmmoTH2-8B-Plus Three-shot, text-only, bfloat16, 2024-05-17 30.3%
chatglm2-6b Three-shot, text-only, float16, 2024-04-05 29.9%
DeepSeek-R1-Distill-Qwen-32B Three-shot, text-only, bfloat16, 2025-01-29 29.2%
Gemma 2B Three-shot, text-only, bfloat16, 2024-02-21 28.4%
Phi-2 Three-shot, text-only, float16, 2024-02-05 27%
Baichuan2-13B-Chat Three-shot, text-only, bfloat16, 2024-05-27 26.3%
Qwen-1_8B Three-shot, text-only, float16, 2024-04-18 26.3%
Qwen-1_8B Three-shot, text-only, bfloat16, 2024-02-05 26.1%
OPT-66B Three-shot, text-only, float16, 2024-02-05 25.6%
gpt-oss-120b Three-shot, text-only, bfloat16, 2025-08-29 25.6%
SmolLM-360M Three-shot, text-only, float16, 2024-07-22 25.3%
RedPajama-INCITE-7B-Base Three-shot, text-only, float16, 2024-02-05 25%
Gemma 1.1 2B IT Three-shot, text-only, bfloat16, 2024-04-07 24.9%
OLMo 2 1B Instruct Three-shot, text-only, bfloat16, 2025-05-01 24.9%
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 24.2%
Emu3-Chat Three-shot, text-only, bfloat16, 2024-10-21 24.1%
LLaMA-7B Three-shot, text-only, float16, 2024-02-05 23.9%
GPT-J-6B Three-shot, text-only, float16, 2024-02-05 23.6%
Cerebras-GPT-13B Three-shot, text-only, float16, 2024-02-11 23.5%
Phi-1.5 Three-shot, text-only, float16, 2024-02-05 23.5%
Llama 3.2 1B Three-shot, text-only, bfloat16, 2024-12-03 23.4%
GPT-NeoX-20B Three-shot, text-only, float16, 2024-02-05 22.8%
SmolLM-1.7B Three-shot, text-only, float16, 2024-07-22 22.8%
MPT-7B Three-shot, text-only, bfloat16, 2024-02-05 22.7%
Qwen2-0.5B Three-shot, text-only, bfloat16, 2024-06-07 22.5%
Gemma 3 1B PT Three-shot, text-only, bfloat16, 2025-04-04 22.3%
Falcon-7B Three-shot, text-only, bfloat16, 2024-02-05 22%
open_llama_7b Three-shot, text-only, float16, 2024-02-11 22%
GPT-Neo-2.7B Three-shot, text-only, float16, 2024-02-05 21.7%
Qwen2.5-Coder-32B Three-shot, text-only, bfloat16, 2024-11-12 20%
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 19.2%
SmolLM-135M Three-shot, text-only, float16, 2024-07-22 19.2%
OPT-1.3B Three-shot, text-only, float16, 2024-02-05 18.6%
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.5%
Gemma 3 270M Three-shot, text-only, bfloat16, 2025-08-30 18.2%
Llama 3-8B Three-shot, text-only, rev: refs/pr/33, bfloat16, 2024-04-19 17.7%
DeepSeek-R1-Distill-Qwen-1.5B Three-shot, text-only, bfloat16, 2025-01-28 13.9%
T5-Large Three-shot, text-only, bfloat16, 2024-02-05 13.5%
T5-Small Three-shot, text-only, bfloat16, 2024-02-05 13.1%
T5-Base Three-shot, text-only, bfloat16, 2024-02-05 10.2%
Qwen2.5-0.5B Three-shot, text-only, bfloat16, 2024-12-03 6.68%
Qwen2.5-1.5B Three-shot, text-only, bfloat16, 2024-12-03 0.14%
Gemma 3 270M Three-shot, text-only, float16, 2025-08-30 0%

10 models have held number one on Open Portuguese LLM Leaderboard’s leaderboard since its release in July 2023

Lab claims count from the day the card came out, independent runs from the model’s release.

Meta 01.AI Qwen Google DeepMind OpenAI Anthropic
Open Portuguese LLM Leaderboard leaderboard Passed 85% in Mar 2025, by Gemini 2.5 Pro

Source: Open Portuguese LLM Leaderboard’s leaderboard

Gemini 2.5 Pro on the official leaderboard passed 85% in March 2025

That was 20 months after its release. By the same age, 36% of the benchmarks from 2023 had passed 85%. All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On Open Portuguese LLM Leaderboard’s leaderboard Best so far
0% 20% 40% 60% 80% 100% 2021 2022 2023 2024 2025 Near the ceiling (85%) Gemini 2.5 Pro Claude 3.7 Sonnet GPT-4o Llama 3-70B Llama 2-70B LLaMA-65B OPT-66B 0% 20% 40% 60% 80% 100% 2021 2022 2023 2024 2025 Near the ceiling (85%) Gemini 2.5 Pro Claude 3.7 Sonnet

Source: Open Portuguese LLM Leaderboard’s leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Multilingual

All 545 in Multilingual
  • MMMLU In use MMLU professionally translated into 14 languages. Multiple-choice accuracy. Claude Mythos Preview 92.7%
  • WMT24++ In use English-to-55-language translation of WMT24 test data. Scored with automatic metrics such as MetricX or xCOMET. K-EXAONE 90.5%
  • MMLU-ProX In use MMLU-Pro translated into up to 29 languages with expert review. Multiple-choice accuracy per language. Qwen3.7-Max 87%
  • CLIcK In use Models answer 1,995 multiple-choice questions on Korean language and culture. Questions come from official Korean exams and textbooks in eleven categories. Solar Open 2 90.7%
  • Global MMLU Lite 3.0 In use Models answer 400 human-translated MMLU questions per language in 23 languages. Version 3.0 adds Czech, Hungarian, Oriya, Slovak and Tajik and updates Italian. Accuracy. Claude Opus 5 95.7%
  • MMMB In use Models answer multiple-choice questions about images in six languages across 15 categories. The set has about 12,000 questions. LFM2.5-VL-3B 83%

Data audit

All 8 checks pass. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 2 pass 3 notes
  • Pass Independent runs Scores from the official leaderboard (1,165 entries).
  • Pass Models scored 177 models we track, plus 988 other entries on its leaderboard.
  • Note Newest score The newest came 15 months ago, in August 2025, for Keye-VL-1.5-8B. That’s expected for a saturated test.
  • Note Frontier models None of the top 10 has a score, which is fine for a retired test. The strongest tested is GPT-5 (#71).
  • Note Headroom Saturated. The best is 95%, past 85% since March 2025.
Leaderboard import 3 pass
  • Pass Importer We read the board on Open Portuguese LLM Leaderboard: 202 rows for models we track and 988 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check