Benchmark Almanac

metabench

SF-Foundation/Ein-72B-v0.12 79.0 tops its leaderboard Mixtral 8x22B 76.7 leads the models we track
Not in model cards

Models answer selected items from established evaluations. The benchmark uses a sparse item set to estimate reasoning and knowledge with fewer questions.

Made by
Alex Kipnis and colleagues
Released
July 2024
Kind
Composite indices
Level
University
Scored
Checked automatically
Answers
Multiple choice
Tasks
All public
Measures
Capability
Language
English
In and out
Text → Text
Interaction
Single turn
Items from
Another benchmark
Refresh
One fixed set
Run by
Anyone
Strongest model tested
Mixtral 8x22B #189 on the capability index
Last model added
May 2024
Scores refreshed
November 20th, 2026
464
Entries on its own leaderboard, 5 models we track

SF-Foundation/Ein-72B-v0.12 tops the leaderboard with 79.0 Mixtral 8x22B leads with 76.7 among models released by May 2024

Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Mixtral 8x22B, at 76.7. This view shows only models we track, each at its best.

The newest model with a score here came out in May 2024, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:

464 entries. Scroll sideways for the rest.

  1. 79.0 SF-Foundation/Ein-72B-v0.12
  2. 76.7 Mixtral 8x22B
  3. 76.0 MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3
  4. 74.5 TomGrc/FusionNet_34Bx2_MoE_v0.1
  5. 74.4 yam-peleg/Experiment24-7B
  6. 74.3 allknowingroger/Neuralmultiverse-7B-slerp
  7. 74.3 ammarali32/multi_verse_model
  8. 74.2 allknowingroger/Calmex26merge-12B-MoE
  9. 74.2 yam-peleg/Experiment29-7B
  10. 74.2 CultriX/NeuralTrix-bf16
  11. 74.2 eldogbbhed/NeuralBeagleJaskier
  12. 74.1 Gille/StrangeMerges_32-7B-slerp
  13. 74.1 fblgit/UNA-SimpleSmaug-34b-v1beta
  14. 74.1 ValiantLabs/Llama3-70B-Fireplace
  15. 74.1 yam-peleg/Experiment27-7B
  16. 74.0 mlabonne/Zebrafish-7B
  17. 74.0 allknowingroger/mergekit-slerp-zplzqvn
  18. 74.0 mayacinka/yam-jom-7B
  19. 74.0 MaziyarPanahi/Calme-7B-Instruct-v0.1.1
  20. 73.9 cloudyu/Mixtral_34Bx2_MoE_60B
  21. 73.9 CultriX/AlphaCeption-7B-v1
  22. 73.8 automerger/PasticheInex12-7B
  23. 73.8 ConvexAI/Luminex-34B-v0.1
  24. 73.8 cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
  25. 73.8 shenzhi-wang/Llama3-70B-Chinese-Chat
  26. 73.8 arcee-ai/Clown-DPO-Extended
  27. 73.8 eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
  28. 73.7 automerger/ShadowYamshadow-7B
  29. 73.7 daxiongshu/Pluto_24B_DPO_63
  30. 73.7 nbeerbower/slerp-bophades-truthy-math-mistral-7B
  31. 73.7 Kukedlc/NeuralMaxime-7B-slerp
  32. 73.5 rmdhirr/Multiparadigm_7B
  33. 73.4 yam-peleg/Experiment22-7B
  34. 73.3 alchemonaut/BoreanGale-70B
  35. 73.3 nbeerbower/Flammen-Bophades-7B
  36. 73.3 allknowingroger/Multimerge-Neurallaymons-12B-MoE
  37. 73.3 MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1
  38. 73.3 YKM11/Mistral-7B-adaptv1
  39. 73.2 saltlux/luxia-21.4b-alignment-v1.0
  40. 73.0 alnrg2arg/blockchainlabs_7B_merged_test2_4
  41. 73.0 dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach
  42. 73.0 Kukedlc/Neural-4-Maths-7b
  43. 73.0 AiMavenAi/AiMaven-Prometheus
  44. 72.9 leveldevai/TurdusDareBeagle-7B
  45. 72.8 Kukedlc/Fasciculus-Arcuatus-7B-slerp
  46. 72.8 FelixChao/Scorpio-7B
  47. 72.8 CultriX/Wernicke-7B-dpo
  48. 72.7 alnrg2arg/blockchainlabs_test3_seminar
  49. 72.7 fblgit/UNA-34BeagleSimpleMath-32K-v1
  50. 72.7 Weyaxi/Cosmosis-3x34B
  51. 72.6 kaitchup/TheMayonnaise
  52. 72.6 YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2
  53. 72.5 AbacusResearch/jaLLAbi2-7b
  54. 72.5 kekmodel/StopCarbon-10.7B-v5
  55. 72.4 leveldevai/MarcBeagle-7B
  56. 72.4 CultriX/Wernicke-7B-v9
  57. 72.4 Kquant03/Samlagast-7B-laser-bf16
  58. 72.2 allknowingroger/Neuralmaath-12B-MoE
  59. 72.2 zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0
  60. 72.2 mlabonne/Beagle14-7B
  61. 72.1 ConvexAI/BurningBruce-003
  62. 72.1 leveldevai/MarcDareBeagle-7B
  63. 71.9 dddsaty/SOLAR-Instruct-ko-Adapter-Attach
  64. 71.9 h2m/mhm-8x7B-FrankenMoE-v1.0
  65. 71.9 nbeerbower/bruphin-epsilon
  66. 71.9 moreh/MoMo-70B-LoRA-V1.4
  67. 71.8 SC56/Mistral-7B-orca-dpo-12h
  68. 71.7 MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1
  69. 71.7 DopeorNope/SOLARC-MOE-10.7Bx4
  70. 71.6 kekmodel/StopCarbon-10.7B-v6
  71. 71.6 janai-hq/trinity-v1
  72. 71.5 ResplendentAI/DaturaCookie_7B
  73. 71.5 vicgalle/NeuralBeagle-11B
  74. 71.4 CultriX/MergeTrix-7B-v2
  75. 71.4 Aryanne/Westest-7B
  76. 71.3 DreadPoor/SilverMaiden-7B-slerp
  77. 71.3 yam-peleg/Experiment7-7B
  78. 71.2 MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1
  79. 71.0 cloudyu/Mixtral_7Bx6_MoE_35B
  80. 70.9 SUSTech/SUS-Chat-34B
  81. 70.8 Gille/MoE-StrangeMerges-2x7B
  82. 70.8 ibndias/Nous-Hermes-2-MoE-2x34B
  83. 70.8 Steelskull/Umbra-v3-MoE-4x11b-2ex
  84. 70.8 jsfs11/SnorkelWestBeagle-DARETIES-7B
  85. 70.7 allknowingroger/StarlingMaths-12B-MoE
  86. 70.7 chujiezheng/tulu-2-dpo-70b-ExPO
  87. 70.7 Test157t/Prima-LelantaclesV6-7b
  88. 70.7 vicgalle/test-merge-3
  89. 70.6 JaeyeonKang/CCK_Asura_v2
  90. 70.6 jan-ai/Pandora-10.7B-v1
  91. 70.6 maywell/PiVoT-SUS-RP
  92. 70.6 Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B
  93. 70.6 NLPark/AnFeng_v3_Avocet
  94. 70.5 flammenai/flammen22-mistral-7B
  95. 70.4 nbeerbower/flammen11X-mistral-7B
  96. 70.4 occultml/CatMarcoro14-7B-slerp
  97. 70.3 Himitsui/KuroMitsu-11B
  98. 70.3 shadowml/Daredevil-7B
  99. 70.3 yunconglong/7Bx4_DPO_2e
  100. 70.2 Inv/Konstanta-7B
  101. 70.2 ParasiticRogue/Merged-RP-Stew-V2-34B
  102. 70.2 AA051610/A0127
  103. 70.2 mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp
  104. 69.9 brucethemoose/Yi-34B-200K-DARE-merge-v7
  105. 69.8 DreadPoor/Chimera-7B-slerp
  106. 69.7 DreadPoor/RoyalNoroichi-7B-slerp
  107. 69.7 JaeyeonKang/CCK_Gony_v3.1
  108. 69.6 Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled
  109. 69.6 jeiku/Cookie_7B
  110. 69.6 DreadPoor/RoyalMaid-7B-slerp
  111. 69.5 abacusai/Liberated-Qwen1.5-72B
  112. 69.5 Aryanne/MixSwap
  113. 69.4 SanjiWatsuki/Kunoichi-DPO-v2-7B
  114. 69.4 giraffe176/WestMaid_HermesMonarchv0.1
  115. 69.2 cloudyu/Pluto_24B_DPO_200
  116. 69.2 APMIC/caigun-lora-model-34B-v2
  117. 69.1 ChaoticNeutrals/This_is_fine_7B
  118. 69.1 saishf/Top-Western-Maid-7B
  119. 69.1 YeungNLP/firefly-mixtral-8x7b-v0.1
  120. 69.1 YeungNLP/firefly-mixtral-8x7b-v1
  121. 68.9 flammenai/Mahou-1.0-mistral-7B
  122. 68.9 nbeerbower/flammen2
  123. 68.8 DreadPoor/Satyr-7B-Model_Stock
  124. 68.7 viethq188/LeoScorpius-7B
  125. 68.6 EmbeddedLLM/Mistral-7B-Merge-14-v0.5
  126. 68.6 Locutusque/Hyperion-2.0-Yi-34B
  127. 68.5 Danielbrdz/Barcenas-Llama3-8b-ORPO
  128. 68.5 Nitral-AI/KukulStanta-7B
  129. 68.5 one-man-army/una-neural-chat-v3-3-P1-OMA
  130. 68.4 adamo1139/Yi-34B-200K-AEZAKMI-v2
  131. 68.4 Eric111/openchat-3.5-0106-128k-DPO
  132. 68.4 AIDC-ai-business/Marcoroni-7B-v2
  133. 68.4 brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties
  134. 68.3 sethuiyer/Eida_10.7B
  135. 68.3 APMIC/caigun-lora-model-34B-v3
  136. 68.1 nisten/shqiponja-15b-v1
  137. 68.1 Weyaxi/Seraph-openchat-3.5-1210-Slerp
  138. 68.0 migtissera/Tess-M-v1.3
  139. 68.0 nbeerbower/llama-3-stella-8B
  140. 68.0 Q-bert/MetaMath-Cybertron
  141. 67.9 PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp
  142. 67.9 Sao10K/Solstice-11B-v1
  143. 67.8 Abhinav7/NeuralPipe-7B-slerp
  144. 67.6 chanwit/flux-7b-v0.1
  145. 67.5 4season/sft_model_test1
  146. 67.5 Inv/MoeMoE-2x7b
  147. 67.4 perlthoughts/Chupacabra-8x7B-MoE
  148. 67.3 lex-hue/Delexa-7b
  149. 67.3 DreadPoor/NewtoccineLake-slerp-7B
  150. 67.3 DeepKarkhanis/Mistral-Passthrough-8L-10B
  151. 67.2 cloudyu/Mixtral_13B_Chat
  152. 67.2 Yi-1.5-9B-Chat
  153. 67.2 AA051610/FT
  154. 67.2 kyujinpy/PlatYi-34B-Q
  155. 67.0 GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3
  156. 67.0 MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1
  157. 67.0 ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2
  158. 67.0 migtissera/Tess-34B-v1.4
  159. 66.9 Artples/L-MChat-7b
  160. 66.9 vonjack/Phi-3-mini-4k-instruct-LLaMAfied
  161. 66.8 ResplendentAI/Persephone_7B
  162. 66.8 Azazelle/Maylin-7b
  163. 66.7 CallComply/openchat-3.5-0106-32k
  164. 66.7 openchat/openchat-3.5-0106
  165. 66.6 nbeerbower/llama-3-sauce-v2-8B
  166. 66.6 adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA
  167. 66.4 Salesforce/xLAM-v0.1-r
  168. 66.4 PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp
  169. 66.3 Xenon1/Eclipse-13B-dpo
  170. 66.2 andysalerno/openchat-nectar-0.6
  171. 66.2 Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp
  172. 66.2 argilla/DistilabelBeagle14-7B
  173. 66.2 lex-hue/LexGPT-V3
  174. 66.1 mlabonne/NeuralHermes-2.5-Mistral-7B
  175. 66.1 Azure99/blossom-v3_1-yi-34b
  176. 66.1 vicgalle/solarized-18B-dpo
  177. 66.0 Yuma42/KangalKhan-ShatteredRuby-7B
  178. 65.8 mayacinka/West-Ramen-7Bx4
  179. 65.8 DeepMount00/phi_3
  180. 65.8 saucam/aqua-smaug-0.3-8B
  181. 65.8 icefog72/Kunokukulemonchini-7b
  182. 65.7 Azazelle/Argetsu
  183. 65.7 NousResearch/Nous-Hermes-2-Mistral-7B-DPO
  184. 65.7 Isotonic/Hermes-2-Pro-Mixtral-4x7B
  185. 65.6 cognitivecomputations/MegaDolphin-120b
  186. 65.4 tenyx/TenyxChat-7B-v1
  187. 65.3 Gille/StrangeMerges_12-7B-slerp
  188. 65.3 Muhammad2003/TriMistral-7B-TIES
  189. 65.3 decruz07/kellemar-DPO-7B
  190. 65.3 fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged
  191. 65.1 elinas/Llama-3-15B-Instruct-zeroed-ft
  192. 65.1 Liangmingxin/ThetaWave-7B-sft
  193. 65.0 ibivibiv/aegolius-acadicus-34b-v3
  194. 65.0 Ba2han/Llama-Phi-3_DoRA
  195. 65.0 mahiatlinux/ShadowDolph-7B-v1
  196. 64.9 dozzke/hermorca
  197. 64.9 kyujinpy/PlatYi-34B-Llama-Q-v2
  198. 64.7 Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp
  199. 64.7 beowolx/CodeNinja-1.0-OpenChat-7B
  200. 64.7 JunchengXie/Starling-LM-7B-alpha-gpt-4-80k
  201. 64.6 aloobun/slerp_bun_mistral_7b_v2
  202. 64.6 Isaak-Carter/JOSIE_Beta-4-7B-slerp
  203. 64.6 mahiatlinux/MasherAI-v6.1-7B-eval-test
  204. 64.6 SeaLLMs/SeaLLM-7B-v2
  205. 64.5 jondurbin/bagel-dpo-7b-v0.4
  206. 64.4 nlpguy/ColorShadow-7B-v3
  207. 64.4 H-D-T/Buzz-8b-Large-v0.5
  208. 64.3 beberik/rawr
  209. 64.3 TomGrc/FusionNet_passthrough_v0.1
  210. 64.3 nlpguy/StarFusion-alpha2
  211. 64.3 perlthoughts/Starling-LM-alpha-8x7B-MoE
  212. 64.3 Undi95/Llama-3-Unholy-8B
  213. 64.3 Starling-LM-7B-alpha
  214. 64.2 ABX-AI/Quantum-Citrus-9B
  215. 64.2 bababababooey/mergekit-slerp-mntqhzv
  216. 64.1 freecs/ThetaWave-7B-v1
  217. 64.1 HIT-SCIR/Chinese-Mixtral-8x7B
  218. 64.1 ResplendentAI/Aura_L3_8B
  219. 64.1 Azazelle/Mocha-Sample-7b-ex
  220. 64.1 joowon99/SOLAR-10.7B-ko_alpaca
  221. 64.1 Replete-AI/Mistral-11b-v0.1
  222. 64.1 Replete-AI/Mistral-Evolved-11b-v0.1
  223. 64.0 FuseAI/FuseChat-7B-VaRM
  224. 64.0 abhishek/autotrain-llama3-orpo-v2
  225. 63.9 AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1
  226. 63.7 Qwen1.5-14B
  227. 63.6 Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B
  228. 63.5 rombodawg/Llama-3-8B-Instruct-Coder
  229. 63.3 abhishekchohan/mistral-7B-forest-merge-v0.1
  230. 63.3 hydra-project/OpenHyperion-2.5-Mistral-7B
  231. 63.3 NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
  232. 63.2 cstr/phi-3-orpo-v9_16
  233. 63.2 TeeZee/Kyllene-v1.0
  234. 63.2 jeiku/Zephyr_beta_32k_7B
  235. 63.1 SC99/Mistral-7B-privatemix-base-ia
  236. 63.0 Steelskull/VerA-Etheria-55b
  237. 63.0 HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2
  238. 62.9 grimjim/zephyr-beta-wizardLM-2-merge-7B
  239. 62.8 ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2
  240. 62.8 perlthoughts/openchat-3.5-1210-32k-8x7b-MoE
  241. 62.7 manishiitg/open-aditi-hi-v4
  242. 62.7 yaojialzc/Gigi-Llama3-8B-Chinese-zh
  243. 62.6 ContextualAI/Contextual_KTO_Mistral_PairRM
  244. 62.6 LeroyDyer/Mixtral_AI_Cyber_Child
  245. 62.6 azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0
  246. 62.6 Weyaxi/Einstein-v5-v0.2-7B
  247. 62.4 TeeZee/DarkSapling-7B-v2.0
  248. 62.3 liminerity/Blured-Ties-7B
  249. 62.2 Joseph717171/Genstruct-10.7B
  250. 62.1 NeverSleep/MiquMaid-v2-70B
  251. 62.0 x2bee/POLAR-14B-v0.2
  252. 62.0 cloudyu/Mixtral_7Bx2_MoE_13B
  253. 61.9 DreadPoor/ToppyEvil-7B-slerp
  254. 61.9 netcat420/MFANN3bv0.6
  255. 61.8 BlueNipples/SnowLotus-v2-10.7B
  256. 61.8 ewqr2130/mistral-inst-ppo
  257. 61.7 922-CA/monika-ddlc-8b-v1
  258. 61.6 silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3
  259. 61.5 PulsarAI/Einstein-v3-7B
  260. 61.5 jondurbin/bagel-7b-v0.4
  261. 61.4 macadeliccc/gemma-orchid-7b-dpo
  262. 61.4 nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp
  263. 61.4 yanolja/KoSOLAR-10.7B-v0.2
  264. 61.3 lodrick-the-lafted/Hermes-Instruct-7B-100K
  265. 61.2 eswardivi/llamathon
  266. 61.2 g-ronimo/llama3-8b-SlimHermes
  267. 61.2 Qwen1.5-72B
  268. 61.1 LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0
  269. 61.0 uukuguy/speechless-mistral-7B-v0.2-mixed-1
  270. 61.0 zelus82/Obelix-Phi2-v0
  271. 60.8 Changgil/K2S3-Mistral-7b-v1.0
  272. 60.8 dfurman/Llama-3-8B-Orpo-v0.1
  273. 60.7 Azure99/blossom-v4-mistral-7b
  274. 60.6 ibm/merlinite-7b
  275. 60.5 Deci/DeciLM-7B-instruct
  276. 60.4 ozayezerceli/Threnystril-2x7B-moe
  277. 60.4 DUAL-GPO/zephyr-7b-gpo-update4-i0
  278. 60.3 tourist800/mistral_2X7b
  279. 60.1 itsliupeng/llama_9b_long
  280. 60.1 uukuguy/speechless-zephyr-code-functionary-7b
  281. 60.0 cloudyu/mistral_18B_instruct_v0.1
  282. 60.0 Artples/L-MChat-Small
  283. 59.7 eduagarcia/mistral-orpo-mix-7k
  284. 59.7 MaziyarPanahi/gemma-7b-alpaca-52k-v0.1
  285. 59.6 grayhacker91/gemma-7b-open-platypus-commercial
  286. 59.6 MaziyarPanahi/phi-2-logical-sft
  287. 59.6 NeuralNovel/Aeryth-7B-v0.1
  288. 59.5 Locutusque/Hercules-2.0-Mistral-7B
  289. 59.5 jefferylovely/AthenaImaniMaven
  290. 59.4 Alsebay/Lorge-2x7B-UAMM
  291. 59.4 Syed-Hasan-8503/Llama-3-8B-NOLA
  292. 59.4 bunnycore/Blackbird-Llama-3-8B
  293. 59.4 Locutusque/Hyperion-2.1-Mistral-7B
  294. 59.4 chlee10/T3Q-Platypus-SOLAR
  295. 59.3 AlanRobotics/nanobot_v1
  296. 59.2 abhishekchohan/mistral-7B-forest-dpo
  297. 59.2 airesearch/typhoon-7b-WangchanX-sft-Demo
  298. 59.2 Novocoders/Mistral-NeuralDPO-v0.5
  299. 59.0 Undi95/Meta-Llama-3-8B-hf
  300. 59.0 jisukim8873/mistralai-case-2-0
  301. 59.0 NotAiLOL/Yi-1.5-9B-coder
  302. 59.0 WDong/Qwen1.5-7B-sft-0502
  303. 59.0 andysalerno/rainbowfish-7B-v10
  304. 59.0 Intel/neural-chat-7b-v3-1
  305. 58.7 DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1
  306. 58.5 NeuralNovel/Senzu-7B-v0.1-DPO
  307. 58.5 Ichsan2895/Merak-7B-v5-PROTOTYPE1
  308. 58.4 chatty123/mistral_rank32_invert
  309. 58.3 Isaak-Carter/J.O.S.I.E.3-Beta8-slerp
  310. 58.3 KnutJaegersberg/Deacon-20B
  311. 58.3 ABX-AI/Spicy-Laymonade-7B
  312. 58.3 HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K
  313. 58.2 allknowingroger/ANIMA-biodesign-7B-slerp
  314. 58.1 awnr/Mistral-7B-v0.1-half-naive-A
  315. 58.1 openaccess-ai-collective/mistral-7b-slimorcaboros
  316. 58.1 JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k
  317. 58.0 MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1
  318. 58.0 vaiv/llamion-14b-base
  319. 58.0 WDong/Qwen1.5-7B-sft-0506_9_8
  320. 58.0 awnr/Mistral-7B-v0.1-signtensors-1-over-2
  321. 57.9 jrruethe/balthazar-2x10.7b-v1
  322. 57.8 jondurbin/bagel-8x7b-v0.2
  323. 57.7 huseyinatahaninan/phi-2-instruction
  324. 57.6 Mollel/Swahili_Gemma
  325. 57.5 Mr-Bhaskar/fbt-gemma-7b
  326. 57.5 NovoCode/Novocode7b-v3
  327. 57.4 alvarobartt/mistral-7b-orpo-capybara-reproduction
  328. 57.4 SuperAGI/SAM
  329. 57.2 maywell/Synatra-RP-Orca-2-7b-v0.1
  330. 57.2 ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4
  331. 56.8 TheBloke/orca_mini_v3_13B-GPTQ
  332. 56.7 xi0v/aether-7b-chat-v1.0
  333. 56.5 ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4
  334. 56.3 macadeliccc/Opus-Samantha-Llama-3-8B
  335. 56.3 ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1
  336. 56.3 maldv/dragonwar-7b-s1
  337. 56.3 ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4
  338. 56.3 DeepMount00/Mistral-RAG
  339. 56.2 Sao10K/L3-Solana-8B-v1
  340. 56.1 Langboat/Mengzi3-13B-Base
  341. 56.1 yam-peleg/Hebrew-Mistral-7B
  342. 56.1 HuggingFaceH4/mistral-7b-grok
  343. 55.9 failspy/Llama-3-8B-Instruct-abliterated
  344. 55.9 CreitinGameplays/ConvAI-9b
  345. 55.9 BlueNipples/TimeCrystal-l2-13B
  346. 55.6 NLUHOPOE/test-case-5
  347. 55.6 Norquinal/Mistral-7B-claude-instruct
  348. 55.5 TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k
  349. 55.5 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta
  350. 55.5 freeCS-dot-org/Zero-7B-test-3
  351. 55.2 NeverSleep/Noromaid-13b-v0.3
  352. 54.9 kyujinpy/SOLAR-Platypus-10.7B-v1
  353. 54.6 XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k
  354. 54.5 CohereForAI/aya-23-8B
  355. 54.5 vaiv/llamion-14b-chat
  356. 54.4 vicgalleorg/TruthfulQwen1.5-4B
  357. 54.3 arlineka/Brunhilde-13b-v1
  358. 54.3 ZoidBB/unraveled-7b-a1
  359. 54.2 Undi95/PsyMedRP-v1-20B
  360. 54.2 BFauber/lora_llama2-13b_10e5_r8_a16
  361. 53.9 jefferylovely/AiMaven-Orca2
  362. 53.9 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta
  363. 53.4 pleisto/yuren-13b-chatml
  364. 53.2 Technoculture/Medorca-2x7b
  365. 53.0 TwT-6/open_llm_leaderboard_demo2
  366. 52.9 bn22/DolphinMini-Mistral-7B
  367. 52.8 KatyTheCutie/EstopianMaid-13B
  368. 52.6 namirocks/tutor-model-13b-ep3
  369. 52.6 CausalLM/7B-DPO-alpha
  370. 52.6 royallab/PsyOrca2-13b-DARE
  371. 52.3 ajibawa-2023/SlimOrca-Llama-3-8B
  372. 52.2 Locutusque/Orca-2-13b-SFT-v6
  373. 52.0 llm-agents/tora-13b-v1.0
  374. 51.9 mayacinka/Open-StaMis-v02-stock
  375. 51.8 Kquant03/Medusa-7B-bf16
  376. 51.6 euclaise/Ferret_7B
  377. 51.4 KnutJaegersberg/webMistral-7B
  378. 51.4 NLUHOPOE/Mistral-7B-random-100000
  379. 51.4 ajibawa-2023/Python-Code-13B
  380. 51.3 hywu/Camelidae-8x7B
  381. 51.3 abacusai/Giraffe-beta-13b-32k
  382. 51.1 gmonsoon/MaxiCPM-3x3B-Test
  383. 50.9 TheBloke/orca_mini_v3_7B-GPTQ
  384. 50.8 Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct
  385. 50.4 gmonsoon/MiniCPM-2B-Base
  386. 50.4 Charlie911/vicuna-7b-v1.5-lora-mmlu-merged
  387. 50.0 pansophic/new_model_test
  388. 50.0 vikash06/doctorLLM
  389. 49.8 DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567
  390. 49.4 XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k
  391. 49.0 ewqr2130/llama_ppo_1e6step_4000
  392. 48.8 ericpolewski/AIRIC-The-Intern
  393. 48.6 Charlie911/vicuna-7b-v1.5-general-temporal-merged
  394. 47.9 Charlie911/zephyr-7b-beta-lora-mmlu-merged
  395. 47.8 abdulrahman-nuzha/finetuned-llama-v2.0
  396. 47.7 GeneZC/MiniChat-2-3B
  397. 47.6 ValiantLabs/Fireplace-13b
  398. 47.3 abhishek/autotrain-8kfjk-b3gva
  399. 46.8 rishiraj/smol-3b
  400. 46.6 tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora
  401. 46.6 TeeZee/Buttocks-7B-v1.0
  402. 46.0 ibivibiv/multimaster-7b
  403. 45.8 DeepMount00/Phi-3-Large-5.6b
  404. 44.7 qnguyen3/quan-1.8b-chat
  405. 44.4 Ritvik19/zephyr-2b-gemma-sft-qlora
  406. 44.3 langgptai/Qwen-sft-ls-v0.1
  407. 43.8 stabilityai/stablelm-2-1_6b
  408. 43.8 langgptai/Qwen-sft-la-v0.1
  409. 43.6 itsliupeng/openllama-7b-base
  410. 43.3 abhinand/tamil-llama-7b-instruct-v0.1
  411. 43.1 jisukim8873/falcon-7B-case-5
  412. 42.9 kalisai/Nusantara-4b-Indo-Chat
  413. 42.9 raincandy-u/Coder1.8-ORPO-TEST
  414. 42.1 pmking27/PrathameshLLM-2B
  415. 42.1 Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0
  416. 41.0 Zangs3011/falcon_7b_DolphinCoder
  417. 40.9 sartifyllc/dociproLLM-7B
  418. 40.6 Qwen/Qwen1.5-1.8B-Chat
  419. 40.6 vihangd/dopeyshearedplats-2.7b-v1
  420. 40.5 csujeong/Falcon-7B-Fintued-Finance-Stock-E
  421. 39.8 mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1
  422. 39.7 cyberagent/calm2-7b-chat
  423. 39.1 Heng666/EastAsia-4x7B-Moe-experiment
  424. 39.1 aloobun/open-llama-3b-v2-elmv3
  425. 39.1 M4-ai/NeuralReyna-Mini-1.8B-v0.3
  426. 38.8 Pierre-obi/Mistral_solar-slerp
  427. 38.4 xaviviro/FLAMA-0.5-3B
  428. 37.7 mwitiderrick/open_llama_3b_glaive_assistant_v0.1
  429. 37.7 deepseek-ai/deepseek-coder-6.7b-base
  430. 36.3 raidhon/coven_tiny_1.1b_32k_orpo_alpha
  431. 36.0 ddyuudd/merge_dolly-v2-3b_dpo_test
  432. 35.6 RESMPDEV/Qwen1.5-Wukong-0.5B
  433. 35.4 cognitivecomputations/TinyDolphin-2.8.1-1.1b
  434. 35.1 alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2
  435. 34.9 Josephgflowers/TinyLlama-Cinder-Agent-Rag
  436. 34.8 Josephgflowers/TinyLlama-Cinder-1.3B-Test.2
  437. 34.8 ppopiolek/tinyllama_eng_short
  438. 34.6 kevin009/babyllama-v0.6
  439. 34.5 l3utterfly/tinyllama-1.1b-layla-v4
  440. 34.2 vihangd/shearedplats-1.3b-v1
  441. 34.1 ewqr2130/TinyLamma-SFT
  442. 34.1 abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft
  443. 34.0 KnutJaegersberg/platypus-1_8b
  444. 34.0 KnutJaegersberg/falcon-1b-t-sft
  445. 33.9 HuggingFaceTB/cosmo-1b
  446. 33.8 ToastyPigeon/SmolPlatypus-1.5B-Sorted
  447. 33.7 nnpy/Nape-0
  448. 33.3 Ramikan-BR/tinyllama-coder-py-4bit-v10
  449. 33.1 jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha
  450. 32.7 Abhaykoul/OEvortex
  451. 32.4 Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1
  452. 31.9 Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG
  453. 30.8 gpt2-xl
  454. 30.4 raincandy-u/Quark-464M-v0.2
  455. 28.7 gemmathon/gemma-2b-ko-v0
  456. 28.6 deepseek-ai/deepseek-coder-1.3b-instruct
  457. 28.5 Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF
  458. 27.9 Sharathhebbar24/Instruct_GPT_v1
  459. 26.5 Isotonic/smol_llama-4x220M-MoE
  460. 26.4 ethzanalytics/pythia-31m
  461. 26.3 Sharathhebbar24/math_gpt2
  462. 26.2 Felladrin/Minueza-32M-UltraChat
  463. 25.8 wannaphong/numfalm-3b
  464. 25.5 Facebook/OPT-125M
  1. 1 SF-Foundation/Ein-72B-v0.12 Held-out reconstruction 79.0
  2. 2 Mixtral 8x22B Held-out reconstruction 76.7
  3. 3 MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3 Held-out reconstruction 76.0
  4. 4 TomGrc/FusionNet_34Bx2_MoE_v0.1 Held-out reconstruction 74.5
  5. 5 yam-peleg/Experiment24-7B Held-out reconstruction 74.4
  6. 6 allknowingroger/Neuralmultiverse-7B-slerp Held-out reconstruction 74.3
  7. 7 ammarali32/multi_verse_model Held-out reconstruction 74.3
  8. 8 allknowingroger/Calmex26merge-12B-MoE Held-out reconstruction 74.2
  9. 9 yam-peleg/Experiment29-7B Held-out reconstruction 74.2
  10. 10 CultriX/NeuralTrix-bf16 Held-out reconstruction 74.2
  11. 11 eldogbbhed/NeuralBeagleJaskier Held-out reconstruction 74.2
  12. 12 Gille/StrangeMerges_32-7B-slerp Held-out reconstruction 74.1
  13. 13 fblgit/UNA-SimpleSmaug-34b-v1beta Held-out reconstruction 74.1
  14. 14 ValiantLabs/Llama3-70B-Fireplace Held-out reconstruction 74.1
  15. 15 yam-peleg/Experiment27-7B Held-out reconstruction 74.1
  16. 16 mlabonne/Zebrafish-7B Held-out reconstruction 74.0
  17. 17 allknowingroger/mergekit-slerp-zplzqvn Held-out reconstruction 74.0
  18. 18 mayacinka/yam-jom-7B Held-out reconstruction 74.0
  19. 19 MaziyarPanahi/Calme-7B-Instruct-v0.1.1 Held-out reconstruction 74.0
  20. 20 cloudyu/Mixtral_34Bx2_MoE_60B Held-out reconstruction 73.9
  21. 21 CultriX/AlphaCeption-7B-v1 Held-out reconstruction 73.9
  22. 22 automerger/PasticheInex12-7B Held-out reconstruction 73.8
  23. 23 ConvexAI/Luminex-34B-v0.1 Held-out reconstruction 73.8
  24. 24 cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B Held-out reconstruction 73.8
  25. 25 shenzhi-wang/Llama3-70B-Chinese-Chat Held-out reconstruction 73.8
  26. 26 arcee-ai/Clown-DPO-Extended Held-out reconstruction 73.8
  27. 27 eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2 Held-out reconstruction 73.8
  28. 28 automerger/ShadowYamshadow-7B Held-out reconstruction 73.7
  29. 29 daxiongshu/Pluto_24B_DPO_63 Held-out reconstruction 73.7
  30. 30 nbeerbower/slerp-bophades-truthy-math-mistral-7B Held-out reconstruction 73.7
  31. 31 Kukedlc/NeuralMaxime-7B-slerp Held-out reconstruction 73.7
  32. 32 rmdhirr/Multiparadigm_7B Held-out reconstruction 73.5
  33. 33 yam-peleg/Experiment22-7B Held-out reconstruction 73.4
  34. 34 alchemonaut/BoreanGale-70B Held-out reconstruction 73.3
  35. 35 nbeerbower/Flammen-Bophades-7B Held-out reconstruction 73.3
  36. 36 allknowingroger/Multimerge-Neurallaymons-12B-MoE Held-out reconstruction 73.3
  37. 37 MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1 Held-out reconstruction 73.3
  38. 38 YKM11/Mistral-7B-adaptv1 Held-out reconstruction 73.3
  39. 39 saltlux/luxia-21.4b-alignment-v1.0 Held-out reconstruction 73.2
  40. 40 alnrg2arg/blockchainlabs_7B_merged_test2_4 Held-out reconstruction 73.0
  41. 41 dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach Held-out reconstruction 73.0
  42. 42 Kukedlc/Neural-4-Maths-7b Held-out reconstruction 73.0
  43. 43 AiMavenAi/AiMaven-Prometheus Held-out reconstruction 73.0
  44. 44 leveldevai/TurdusDareBeagle-7B Held-out reconstruction 72.9
  45. 45 Kukedlc/Fasciculus-Arcuatus-7B-slerp Held-out reconstruction 72.8
  46. 46 FelixChao/Scorpio-7B Held-out reconstruction 72.8
  47. 47 CultriX/Wernicke-7B-dpo Held-out reconstruction 72.8
  48. 48 alnrg2arg/blockchainlabs_test3_seminar Held-out reconstruction 72.7
  49. 49 fblgit/UNA-34BeagleSimpleMath-32K-v1 Held-out reconstruction 72.7
  50. 50 Weyaxi/Cosmosis-3x34B Held-out reconstruction 72.7
  51. 51 kaitchup/TheMayonnaise Held-out reconstruction 72.6
  52. 52 YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2 Held-out reconstruction 72.6
  53. 53 AbacusResearch/jaLLAbi2-7b Held-out reconstruction 72.5
  54. 54 kekmodel/StopCarbon-10.7B-v5 Held-out reconstruction 72.5
  55. 55 leveldevai/MarcBeagle-7B Held-out reconstruction 72.4
  56. 56 CultriX/Wernicke-7B-v9 Held-out reconstruction 72.4
  57. 57 Kquant03/Samlagast-7B-laser-bf16 Held-out reconstruction 72.4
  58. 58 allknowingroger/Neuralmaath-12B-MoE Held-out reconstruction 72.2
  59. 59 zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0 Held-out reconstruction 72.2
  60. 60 mlabonne/Beagle14-7B Held-out reconstruction 72.2
  61. 61 ConvexAI/BurningBruce-003 Held-out reconstruction 72.1
  62. 62 leveldevai/MarcDareBeagle-7B Held-out reconstruction 72.1
  63. 63 dddsaty/SOLAR-Instruct-ko-Adapter-Attach Held-out reconstruction 71.9
  64. 64 h2m/mhm-8x7B-FrankenMoE-v1.0 Held-out reconstruction 71.9
  65. 65 nbeerbower/bruphin-epsilon Held-out reconstruction 71.9
  66. 66 moreh/MoMo-70B-LoRA-V1.4 Held-out reconstruction 71.9
  67. 67 SC56/Mistral-7B-orca-dpo-12h Held-out reconstruction 71.8
  68. 68 MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1 Held-out reconstruction 71.7
  69. 69 DopeorNope/SOLARC-MOE-10.7Bx4 Held-out reconstruction 71.7
  70. 70 kekmodel/StopCarbon-10.7B-v6 Held-out reconstruction 71.6
  71. 71 janai-hq/trinity-v1 Held-out reconstruction 71.6
  72. 72 ResplendentAI/DaturaCookie_7B Held-out reconstruction 71.5
  73. 73 vicgalle/NeuralBeagle-11B Held-out reconstruction 71.5
  74. 74 CultriX/MergeTrix-7B-v2 Held-out reconstruction 71.4
  75. 75 Aryanne/Westest-7B Held-out reconstruction 71.4
  76. 76 DreadPoor/SilverMaiden-7B-slerp Held-out reconstruction 71.3
  77. 77 yam-peleg/Experiment7-7B Held-out reconstruction 71.3
  78. 78 MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1 Held-out reconstruction 71.2
  79. 79 cloudyu/Mixtral_7Bx6_MoE_35B Held-out reconstruction 71.0
  80. 80 SUSTech/SUS-Chat-34B Held-out reconstruction 70.9
  81. 81 Gille/MoE-StrangeMerges-2x7B Held-out reconstruction 70.8
  82. 82 ibndias/Nous-Hermes-2-MoE-2x34B Held-out reconstruction 70.8
  83. 83 Steelskull/Umbra-v3-MoE-4x11b-2ex Held-out reconstruction 70.8
  84. 84 jsfs11/SnorkelWestBeagle-DARETIES-7B Held-out reconstruction 70.8
  85. 85 allknowingroger/StarlingMaths-12B-MoE Held-out reconstruction 70.7
  86. 86 chujiezheng/tulu-2-dpo-70b-ExPO Held-out reconstruction 70.7
  87. 87 Test157t/Prima-LelantaclesV6-7b Held-out reconstruction 70.7
  88. 88 vicgalle/test-merge-3 Held-out reconstruction 70.7
  89. 89 JaeyeonKang/CCK_Asura_v2 Held-out reconstruction 70.6
  90. 90 jan-ai/Pandora-10.7B-v1 Held-out reconstruction 70.6
  91. 91 maywell/PiVoT-SUS-RP Held-out reconstruction 70.6
  92. 92 Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B Held-out reconstruction 70.6
  93. 93 NLPark/AnFeng_v3_Avocet Held-out reconstruction 70.6
  94. 94 flammenai/flammen22-mistral-7B Held-out reconstruction 70.5
  95. 95 nbeerbower/flammen11X-mistral-7B Held-out reconstruction 70.4
  96. 96 occultml/CatMarcoro14-7B-slerp Held-out reconstruction 70.4
  97. 97 Himitsui/KuroMitsu-11B Held-out reconstruction 70.3
  98. 98 shadowml/Daredevil-7B Held-out reconstruction 70.3
  99. 99 yunconglong/7Bx4_DPO_2e Held-out reconstruction 70.3
  100. 100 Inv/Konstanta-7B Held-out reconstruction 70.2
  101. 101 ParasiticRogue/Merged-RP-Stew-V2-34B Held-out reconstruction 70.2
  102. 102 AA051610/A0127 Held-out reconstruction 70.2
  103. 103 mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp Held-out reconstruction 70.2
  104. 104 brucethemoose/Yi-34B-200K-DARE-merge-v7 Held-out reconstruction 69.9
  105. 105 DreadPoor/Chimera-7B-slerp Held-out reconstruction 69.8
  106. 106 DreadPoor/RoyalNoroichi-7B-slerp Held-out reconstruction 69.7
  107. 107 JaeyeonKang/CCK_Gony_v3.1 Held-out reconstruction 69.7
  108. 108 Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled Held-out reconstruction 69.6
  109. 109 jeiku/Cookie_7B Held-out reconstruction 69.6
  110. 110 DreadPoor/RoyalMaid-7B-slerp Held-out reconstruction 69.6
  111. 111 abacusai/Liberated-Qwen1.5-72B Held-out reconstruction 69.5
  112. 112 Aryanne/MixSwap Held-out reconstruction 69.5
  113. 113 SanjiWatsuki/Kunoichi-DPO-v2-7B Held-out reconstruction 69.4
  114. 114 giraffe176/WestMaid_HermesMonarchv0.1 Held-out reconstruction 69.4
  115. 115 cloudyu/Pluto_24B_DPO_200 Held-out reconstruction 69.2
  116. 116 APMIC/caigun-lora-model-34B-v2 Held-out reconstruction 69.2
  117. 117 ChaoticNeutrals/This_is_fine_7B Held-out reconstruction 69.1
  118. 118 saishf/Top-Western-Maid-7B Held-out reconstruction 69.1
  119. 119 YeungNLP/firefly-mixtral-8x7b-v0.1 Held-out reconstruction 69.1
  120. 120 YeungNLP/firefly-mixtral-8x7b-v1 Held-out reconstruction 69.1
  121. 121 flammenai/Mahou-1.0-mistral-7B Held-out reconstruction 68.9
  122. 122 nbeerbower/flammen2 Held-out reconstruction 68.9
  123. 123 DreadPoor/Satyr-7B-Model_Stock Held-out reconstruction 68.8
  124. 124 viethq188/LeoScorpius-7B Held-out reconstruction 68.7
  125. 125 EmbeddedLLM/Mistral-7B-Merge-14-v0.5 Held-out reconstruction 68.6
  126. 126 Locutusque/Hyperion-2.0-Yi-34B Held-out reconstruction 68.6
  127. 127 Danielbrdz/Barcenas-Llama3-8b-ORPO Held-out reconstruction 68.5
  128. 128 Nitral-AI/KukulStanta-7B Held-out reconstruction 68.5
  129. 129 one-man-army/una-neural-chat-v3-3-P1-OMA Held-out reconstruction 68.5
  130. 130 adamo1139/Yi-34B-200K-AEZAKMI-v2 Held-out reconstruction 68.4
  131. 131 Eric111/openchat-3.5-0106-128k-DPO Held-out reconstruction 68.4
  132. 132 AIDC-ai-business/Marcoroni-7B-v2 Held-out reconstruction 68.4
  133. 133 brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties Held-out reconstruction 68.4
  134. 134 sethuiyer/Eida_10.7B Held-out reconstruction 68.3
  135. 135 APMIC/caigun-lora-model-34B-v3 Held-out reconstruction 68.3
  136. 136 nisten/shqiponja-15b-v1 Held-out reconstruction 68.1
  137. 137 Weyaxi/Seraph-openchat-3.5-1210-Slerp Held-out reconstruction 68.1
  138. 138 migtissera/Tess-M-v1.3 Held-out reconstruction 68.0
  139. 139 nbeerbower/llama-3-stella-8B Held-out reconstruction 68.0
  140. 140 Q-bert/MetaMath-Cybertron Held-out reconstruction 68.0
  141. 141 PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp Held-out reconstruction 67.9
  142. 142 Sao10K/Solstice-11B-v1 Held-out reconstruction 67.9
  143. 143 Abhinav7/NeuralPipe-7B-slerp Held-out reconstruction 67.8
  144. 144 chanwit/flux-7b-v0.1 Held-out reconstruction 67.6
  145. 145 4season/sft_model_test1 Held-out reconstruction 67.5
  146. 146 Inv/MoeMoE-2x7b Held-out reconstruction 67.5
  147. 147 perlthoughts/Chupacabra-8x7B-MoE Held-out reconstruction 67.4
  148. 148 lex-hue/Delexa-7b Held-out reconstruction 67.3
  149. 149 DreadPoor/NewtoccineLake-slerp-7B Held-out reconstruction 67.3
  150. 150 DeepKarkhanis/Mistral-Passthrough-8L-10B Held-out reconstruction 67.3
  151. 151 cloudyu/Mixtral_13B_Chat Held-out reconstruction 67.2
  152. 152 Yi-1.5-9B-Chat Held-out reconstruction 67.2
  153. 153 AA051610/FT Held-out reconstruction 67.2
  154. 154 kyujinpy/PlatYi-34B-Q Held-out reconstruction 67.2
  155. 155 GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3 Held-out reconstruction 67.0
  156. 156 MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1 Held-out reconstruction 67.0
  157. 157 ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2 Held-out reconstruction 67.0
  158. 158 migtissera/Tess-34B-v1.4 Held-out reconstruction 67.0
  159. 159 Artples/L-MChat-7b Held-out reconstruction 66.9
  160. 160 vonjack/Phi-3-mini-4k-instruct-LLaMAfied Held-out reconstruction 66.9
  161. 161 ResplendentAI/Persephone_7B Held-out reconstruction 66.8
  162. 162 Azazelle/Maylin-7b Held-out reconstruction 66.8
  163. 163 CallComply/openchat-3.5-0106-32k Held-out reconstruction 66.7
  164. 164 openchat/openchat-3.5-0106 Held-out reconstruction 66.7
  165. 165 nbeerbower/llama-3-sauce-v2-8B Held-out reconstruction 66.6
  166. 166 adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA Held-out reconstruction 66.6
  167. 167 Salesforce/xLAM-v0.1-r Held-out reconstruction 66.4
  168. 168 PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp Held-out reconstruction 66.4
  169. 169 Xenon1/Eclipse-13B-dpo Held-out reconstruction 66.3
  170. 170 andysalerno/openchat-nectar-0.6 Held-out reconstruction 66.2
  171. 171 Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp Held-out reconstruction 66.2
  172. 172 argilla/DistilabelBeagle14-7B Held-out reconstruction 66.2
  173. 173 lex-hue/LexGPT-V3 Held-out reconstruction 66.2
  174. 174 mlabonne/NeuralHermes-2.5-Mistral-7B Held-out reconstruction 66.1
  175. 175 Azure99/blossom-v3_1-yi-34b Held-out reconstruction 66.1
  176. 176 vicgalle/solarized-18B-dpo Held-out reconstruction 66.1
  177. 177 Yuma42/KangalKhan-ShatteredRuby-7B Held-out reconstruction 66.0
  178. 178 mayacinka/West-Ramen-7Bx4 Held-out reconstruction 65.8
  179. 179 DeepMount00/phi_3 Held-out reconstruction 65.8
  180. 180 saucam/aqua-smaug-0.3-8B Held-out reconstruction 65.8
  181. 181 icefog72/Kunokukulemonchini-7b Held-out reconstruction 65.8
  182. 182 Azazelle/Argetsu Held-out reconstruction 65.7
  183. 183 NousResearch/Nous-Hermes-2-Mistral-7B-DPO Held-out reconstruction 65.7
  184. 184 Isotonic/Hermes-2-Pro-Mixtral-4x7B Held-out reconstruction 65.7
  185. 185 cognitivecomputations/MegaDolphin-120b Held-out reconstruction 65.6
  186. 186 tenyx/TenyxChat-7B-v1 Held-out reconstruction 65.4
  187. 187 Gille/StrangeMerges_12-7B-slerp Held-out reconstruction 65.3
  188. 188 Muhammad2003/TriMistral-7B-TIES Held-out reconstruction 65.3
  189. 189 decruz07/kellemar-DPO-7B Held-out reconstruction 65.3
  190. 190 fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged Held-out reconstruction 65.3
  191. 191 elinas/Llama-3-15B-Instruct-zeroed-ft Held-out reconstruction 65.1
  192. 192 Liangmingxin/ThetaWave-7B-sft Held-out reconstruction 65.1
  193. 193 ibivibiv/aegolius-acadicus-34b-v3 Held-out reconstruction 65.0
  194. 194 Ba2han/Llama-Phi-3_DoRA Held-out reconstruction 65.0
  195. 195 mahiatlinux/ShadowDolph-7B-v1 Held-out reconstruction 65.0
  196. 196 dozzke/hermorca Held-out reconstruction 64.9
  197. 197 kyujinpy/PlatYi-34B-Llama-Q-v2 Held-out reconstruction 64.9
  198. 198 Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp Held-out reconstruction 64.7
  199. 199 beowolx/CodeNinja-1.0-OpenChat-7B Held-out reconstruction 64.7
  200. 200 JunchengXie/Starling-LM-7B-alpha-gpt-4-80k Held-out reconstruction 64.7
  201. 201 aloobun/slerp_bun_mistral_7b_v2 Held-out reconstruction 64.6
  202. 202 Isaak-Carter/JOSIE_Beta-4-7B-slerp Held-out reconstruction 64.6
  203. 203 mahiatlinux/MasherAI-v6.1-7B-eval-test Held-out reconstruction 64.6
  204. 204 SeaLLMs/SeaLLM-7B-v2 Held-out reconstruction 64.6
  205. 205 jondurbin/bagel-dpo-7b-v0.4 Held-out reconstruction 64.5
  206. 206 nlpguy/ColorShadow-7B-v3 Held-out reconstruction 64.4
  207. 207 H-D-T/Buzz-8b-Large-v0.5 Held-out reconstruction 64.4
  208. 208 beberik/rawr Held-out reconstruction 64.3
  209. 209 TomGrc/FusionNet_passthrough_v0.1 Held-out reconstruction 64.3
  210. 210 nlpguy/StarFusion-alpha2 Held-out reconstruction 64.3
  211. 211 perlthoughts/Starling-LM-alpha-8x7B-MoE Held-out reconstruction 64.3
  212. 212 Undi95/Llama-3-Unholy-8B Held-out reconstruction 64.3
  213. 213 Starling-LM-7B-alpha Held-out reconstruction 64.3
  214. 214 ABX-AI/Quantum-Citrus-9B Held-out reconstruction 64.2
  215. 215 bababababooey/mergekit-slerp-mntqhzv Held-out reconstruction 64.2
  216. 216 freecs/ThetaWave-7B-v1 Held-out reconstruction 64.1
  217. 217 HIT-SCIR/Chinese-Mixtral-8x7B Held-out reconstruction 64.1
  218. 218 ResplendentAI/Aura_L3_8B Held-out reconstruction 64.1
  219. 219 Azazelle/Mocha-Sample-7b-ex Held-out reconstruction 64.1
  220. 220 joowon99/SOLAR-10.7B-ko_alpaca Held-out reconstruction 64.1
  221. 221 Replete-AI/Mistral-11b-v0.1 Held-out reconstruction 64.1
  222. 222 Replete-AI/Mistral-Evolved-11b-v0.1 Held-out reconstruction 64.1
  223. 223 FuseAI/FuseChat-7B-VaRM Held-out reconstruction 64.0
  224. 224 abhishek/autotrain-llama3-orpo-v2 Held-out reconstruction 64.0
  225. 225 AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1 Held-out reconstruction 63.9
  226. 226 Qwen1.5-14B Held-out reconstruction 63.7
  227. 227 Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B Held-out reconstruction 63.6
  228. 228 rombodawg/Llama-3-8B-Instruct-Coder Held-out reconstruction 63.5
  229. 229 abhishekchohan/mistral-7B-forest-merge-v0.1 Held-out reconstruction 63.3
  230. 230 hydra-project/OpenHyperion-2.5-Mistral-7B Held-out reconstruction 63.3
  231. 231 NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS Held-out reconstruction 63.3
  232. 232 cstr/phi-3-orpo-v9_16 Held-out reconstruction 63.2
  233. 233 TeeZee/Kyllene-v1.0 Held-out reconstruction 63.2
  234. 234 jeiku/Zephyr_beta_32k_7B Held-out reconstruction 63.2
  235. 235 SC99/Mistral-7B-privatemix-base-ia Held-out reconstruction 63.1
  236. 236 Steelskull/VerA-Etheria-55b Held-out reconstruction 63.0
  237. 237 HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2 Held-out reconstruction 63.0
  238. 238 grimjim/zephyr-beta-wizardLM-2-merge-7B Held-out reconstruction 62.9
  239. 239 ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2 Held-out reconstruction 62.8
  240. 240 perlthoughts/openchat-3.5-1210-32k-8x7b-MoE Held-out reconstruction 62.8
  241. 241 manishiitg/open-aditi-hi-v4 Held-out reconstruction 62.7
  242. 242 yaojialzc/Gigi-Llama3-8B-Chinese-zh Held-out reconstruction 62.7
  243. 243 ContextualAI/Contextual_KTO_Mistral_PairRM Held-out reconstruction 62.6
  244. 244 LeroyDyer/Mixtral_AI_Cyber_Child Held-out reconstruction 62.6
  245. 245 azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0 Held-out reconstruction 62.6
  246. 246 Weyaxi/Einstein-v5-v0.2-7B Held-out reconstruction 62.6
  247. 247 TeeZee/DarkSapling-7B-v2.0 Held-out reconstruction 62.4
  248. 248 liminerity/Blured-Ties-7B Held-out reconstruction 62.3
  249. 249 Joseph717171/Genstruct-10.7B Held-out reconstruction 62.2
  250. 250 NeverSleep/MiquMaid-v2-70B Held-out reconstruction 62.1
  251. 251 x2bee/POLAR-14B-v0.2 Held-out reconstruction 62.0
  252. 252 cloudyu/Mixtral_7Bx2_MoE_13B Held-out reconstruction 62.0
  253. 253 DreadPoor/ToppyEvil-7B-slerp Held-out reconstruction 61.9
  254. 254 netcat420/MFANN3bv0.6 Held-out reconstruction 61.9
  255. 255 BlueNipples/SnowLotus-v2-10.7B Held-out reconstruction 61.8
  256. 256 ewqr2130/mistral-inst-ppo Held-out reconstruction 61.8
  257. 257 922-CA/monika-ddlc-8b-v1 Held-out reconstruction 61.7
  258. 258 silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3 Held-out reconstruction 61.6
  259. 259 PulsarAI/Einstein-v3-7B Held-out reconstruction 61.5
  260. 260 jondurbin/bagel-7b-v0.4 Held-out reconstruction 61.5
  261. 261 macadeliccc/gemma-orchid-7b-dpo Held-out reconstruction 61.4
  262. 262 nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp Held-out reconstruction 61.4
  263. 263 yanolja/KoSOLAR-10.7B-v0.2 Held-out reconstruction 61.4
  264. 264 lodrick-the-lafted/Hermes-Instruct-7B-100K Held-out reconstruction 61.3
  265. 265 eswardivi/llamathon Held-out reconstruction 61.2
  266. 266 g-ronimo/llama3-8b-SlimHermes Held-out reconstruction 61.2
  267. 267 Qwen1.5-72B Held-out reconstruction 61.2
  268. 268 LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0 Held-out reconstruction 61.1
  269. 269 uukuguy/speechless-mistral-7B-v0.2-mixed-1 Held-out reconstruction 61.0
  270. 270 zelus82/Obelix-Phi2-v0 Held-out reconstruction 61.0
  271. 271 Changgil/K2S3-Mistral-7b-v1.0 Held-out reconstruction 60.8
  272. 272 dfurman/Llama-3-8B-Orpo-v0.1 Held-out reconstruction 60.8
  273. 273 Azure99/blossom-v4-mistral-7b Held-out reconstruction 60.7
  274. 274 ibm/merlinite-7b Held-out reconstruction 60.6
  275. 275 Deci/DeciLM-7B-instruct Held-out reconstruction 60.5
  276. 276 ozayezerceli/Threnystril-2x7B-moe Held-out reconstruction 60.4
  277. 277 DUAL-GPO/zephyr-7b-gpo-update4-i0 Held-out reconstruction 60.4
  278. 278 tourist800/mistral_2X7b Held-out reconstruction 60.3
  279. 279 itsliupeng/llama_9b_long Held-out reconstruction 60.1
  280. 280 uukuguy/speechless-zephyr-code-functionary-7b Held-out reconstruction 60.1
  281. 281 cloudyu/mistral_18B_instruct_v0.1 Held-out reconstruction 60.0
  282. 282 Artples/L-MChat-Small Held-out reconstruction 60.0
  283. 283 eduagarcia/mistral-orpo-mix-7k Held-out reconstruction 59.7
  284. 284 MaziyarPanahi/gemma-7b-alpaca-52k-v0.1 Held-out reconstruction 59.7
  285. 285 grayhacker91/gemma-7b-open-platypus-commercial Held-out reconstruction 59.6
  286. 286 MaziyarPanahi/phi-2-logical-sft Held-out reconstruction 59.6
  287. 287 NeuralNovel/Aeryth-7B-v0.1 Held-out reconstruction 59.6
  288. 288 Locutusque/Hercules-2.0-Mistral-7B Held-out reconstruction 59.5
  289. 289 jefferylovely/AthenaImaniMaven Held-out reconstruction 59.5
  290. 290 Alsebay/Lorge-2x7B-UAMM Held-out reconstruction 59.4
  291. 291 Syed-Hasan-8503/Llama-3-8B-NOLA Held-out reconstruction 59.4
  292. 292 bunnycore/Blackbird-Llama-3-8B Held-out reconstruction 59.4
  293. 293 Locutusque/Hyperion-2.1-Mistral-7B Held-out reconstruction 59.4
  294. 294 chlee10/T3Q-Platypus-SOLAR Held-out reconstruction 59.4
  295. 295 AlanRobotics/nanobot_v1 Held-out reconstruction 59.3
  296. 296 abhishekchohan/mistral-7B-forest-dpo Held-out reconstruction 59.2
  297. 297 airesearch/typhoon-7b-WangchanX-sft-Demo Held-out reconstruction 59.2
  298. 298 Novocoders/Mistral-NeuralDPO-v0.5 Held-out reconstruction 59.2
  299. 299 Undi95/Meta-Llama-3-8B-hf Held-out reconstruction 59.0
  300. 300 jisukim8873/mistralai-case-2-0 Held-out reconstruction 59.0
  301. 301 NotAiLOL/Yi-1.5-9B-coder Held-out reconstruction 59.0
  302. 302 WDong/Qwen1.5-7B-sft-0502 Held-out reconstruction 59.0
  303. 303 andysalerno/rainbowfish-7B-v10 Held-out reconstruction 59.0
  304. 304 Intel/neural-chat-7b-v3-1 Held-out reconstruction 59.0
  305. 305 DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1 Held-out reconstruction 58.7
  306. 306 NeuralNovel/Senzu-7B-v0.1-DPO Held-out reconstruction 58.5
  307. 307 Ichsan2895/Merak-7B-v5-PROTOTYPE1 Held-out reconstruction 58.5
  308. 308 chatty123/mistral_rank32_invert Held-out reconstruction 58.4
  309. 309 Isaak-Carter/J.O.S.I.E.3-Beta8-slerp Held-out reconstruction 58.3
  310. 310 KnutJaegersberg/Deacon-20B Held-out reconstruction 58.3
  311. 311 ABX-AI/Spicy-Laymonade-7B Held-out reconstruction 58.3
  312. 312 HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K Held-out reconstruction 58.3
  313. 313 allknowingroger/ANIMA-biodesign-7B-slerp Held-out reconstruction 58.2
  314. 314 awnr/Mistral-7B-v0.1-half-naive-A Held-out reconstruction 58.1
  315. 315 openaccess-ai-collective/mistral-7b-slimorcaboros Held-out reconstruction 58.1
  316. 316 JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k Held-out reconstruction 58.1
  317. 317 MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1 Held-out reconstruction 58.0
  318. 318 vaiv/llamion-14b-base Held-out reconstruction 58.0
  319. 319 WDong/Qwen1.5-7B-sft-0506_9_8 Held-out reconstruction 58.0
  320. 320 awnr/Mistral-7B-v0.1-signtensors-1-over-2 Held-out reconstruction 58.0
  321. 321 jrruethe/balthazar-2x10.7b-v1 Held-out reconstruction 57.9
  322. 322 jondurbin/bagel-8x7b-v0.2 Held-out reconstruction 57.8
  323. 323 huseyinatahaninan/phi-2-instruction Held-out reconstruction 57.7
  324. 324 Mollel/Swahili_Gemma Held-out reconstruction 57.6
  325. 325 Mr-Bhaskar/fbt-gemma-7b Held-out reconstruction 57.5
  326. 326 NovoCode/Novocode7b-v3 Held-out reconstruction 57.5
  327. 327 alvarobartt/mistral-7b-orpo-capybara-reproduction Held-out reconstruction 57.4
  328. 328 SuperAGI/SAM Held-out reconstruction 57.4
  329. 329 maywell/Synatra-RP-Orca-2-7b-v0.1 Held-out reconstruction 57.2
  330. 330 ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4 Held-out reconstruction 57.2
  331. 331 TheBloke/orca_mini_v3_13B-GPTQ Held-out reconstruction 56.8
  332. 332 xi0v/aether-7b-chat-v1.0 Held-out reconstruction 56.7
  333. 333 ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4 Held-out reconstruction 56.5
  334. 334 macadeliccc/Opus-Samantha-Llama-3-8B Held-out reconstruction 56.3
  335. 335 ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1 Held-out reconstruction 56.3
  336. 336 maldv/dragonwar-7b-s1 Held-out reconstruction 56.3
  337. 337 ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4 Held-out reconstruction 56.3
  338. 338 DeepMount00/Mistral-RAG Held-out reconstruction 56.3
  339. 339 Sao10K/L3-Solana-8B-v1 Held-out reconstruction 56.2
  340. 340 Langboat/Mengzi3-13B-Base Held-out reconstruction 56.1
  341. 341 yam-peleg/Hebrew-Mistral-7B Held-out reconstruction 56.1
  342. 342 HuggingFaceH4/mistral-7b-grok Held-out reconstruction 56.1
  343. 343 failspy/Llama-3-8B-Instruct-abliterated Held-out reconstruction 55.9
  344. 344 CreitinGameplays/ConvAI-9b Held-out reconstruction 55.9
  345. 345 BlueNipples/TimeCrystal-l2-13B Held-out reconstruction 55.9
  346. 346 NLUHOPOE/test-case-5 Held-out reconstruction 55.6
  347. 347 Norquinal/Mistral-7B-claude-instruct Held-out reconstruction 55.6
  348. 348 TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k Held-out reconstruction 55.5
  349. 349 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta Held-out reconstruction 55.5
  350. 350 freeCS-dot-org/Zero-7B-test-3 Held-out reconstruction 55.5
  351. 351 NeverSleep/Noromaid-13b-v0.3 Held-out reconstruction 55.2
  352. 352 kyujinpy/SOLAR-Platypus-10.7B-v1 Held-out reconstruction 54.9
  353. 353 XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k Held-out reconstruction 54.6
  354. 354 CohereForAI/aya-23-8B Held-out reconstruction 54.5
  355. 355 vaiv/llamion-14b-chat Held-out reconstruction 54.5
  356. 356 vicgalleorg/TruthfulQwen1.5-4B Held-out reconstruction 54.4
  357. 357 arlineka/Brunhilde-13b-v1 Held-out reconstruction 54.3
  358. 358 ZoidBB/unraveled-7b-a1 Held-out reconstruction 54.3
  359. 359 Undi95/PsyMedRP-v1-20B Held-out reconstruction 54.2
  360. 360 BFauber/lora_llama2-13b_10e5_r8_a16 Held-out reconstruction 54.2
  361. 361 jefferylovely/AiMaven-Orca2 Held-out reconstruction 53.9
  362. 362 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta Held-out reconstruction 53.9
  363. 363 pleisto/yuren-13b-chatml Held-out reconstruction 53.4
  364. 364 Technoculture/Medorca-2x7b Held-out reconstruction 53.2
  365. 365 TwT-6/open_llm_leaderboard_demo2 Held-out reconstruction 53.0
  366. 366 bn22/DolphinMini-Mistral-7B Held-out reconstruction 52.9
  367. 367 KatyTheCutie/EstopianMaid-13B Held-out reconstruction 52.8
  368. 368 namirocks/tutor-model-13b-ep3 Held-out reconstruction 52.6
  369. 369 CausalLM/7B-DPO-alpha Held-out reconstruction 52.6
  370. 370 royallab/PsyOrca2-13b-DARE Held-out reconstruction 52.6
  371. 371 ajibawa-2023/SlimOrca-Llama-3-8B Held-out reconstruction 52.3
  372. 372 Locutusque/Orca-2-13b-SFT-v6 Held-out reconstruction 52.2
  373. 373 llm-agents/tora-13b-v1.0 Held-out reconstruction 52.0
  374. 374 mayacinka/Open-StaMis-v02-stock Held-out reconstruction 51.9
  375. 375 Kquant03/Medusa-7B-bf16 Held-out reconstruction 51.8
  376. 376 euclaise/Ferret_7B Held-out reconstruction 51.6
  377. 377 KnutJaegersberg/webMistral-7B Held-out reconstruction 51.4
  378. 378 NLUHOPOE/Mistral-7B-random-100000 Held-out reconstruction 51.4
  379. 379 ajibawa-2023/Python-Code-13B Held-out reconstruction 51.4
  380. 380 hywu/Camelidae-8x7B Held-out reconstruction 51.3
  381. 381 abacusai/Giraffe-beta-13b-32k Held-out reconstruction 51.3
  382. 382 gmonsoon/MaxiCPM-3x3B-Test Held-out reconstruction 51.1
  383. 383 TheBloke/orca_mini_v3_7B-GPTQ Held-out reconstruction 50.9
  384. 384 Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct Held-out reconstruction 50.8
  385. 385 gmonsoon/MiniCPM-2B-Base Held-out reconstruction 50.4
  386. 386 Charlie911/vicuna-7b-v1.5-lora-mmlu-merged Held-out reconstruction 50.4
  387. 387 pansophic/new_model_test Held-out reconstruction 50.0
  388. 388 vikash06/doctorLLM Held-out reconstruction 50.0
  389. 389 DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567 Held-out reconstruction 49.8
  390. 390 XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k Held-out reconstruction 49.4
  391. 391 ewqr2130/llama_ppo_1e6step_4000 Held-out reconstruction 49.0
  392. 392 ericpolewski/AIRIC-The-Intern Held-out reconstruction 48.8
  393. 393 Charlie911/vicuna-7b-v1.5-general-temporal-merged Held-out reconstruction 48.6
  394. 394 Charlie911/zephyr-7b-beta-lora-mmlu-merged Held-out reconstruction 47.9
  395. 395 abdulrahman-nuzha/finetuned-llama-v2.0 Held-out reconstruction 47.8
  396. 396 GeneZC/MiniChat-2-3B Held-out reconstruction 47.7
  397. 397 ValiantLabs/Fireplace-13b Held-out reconstruction 47.6
  398. 398 abhishek/autotrain-8kfjk-b3gva Held-out reconstruction 47.3
  399. 399 rishiraj/smol-3b Held-out reconstruction 46.8
  400. 400 tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora Held-out reconstruction 46.6
  401. 401 TeeZee/Buttocks-7B-v1.0 Held-out reconstruction 46.6
  402. 402 ibivibiv/multimaster-7b Held-out reconstruction 46.0
  403. 403 DeepMount00/Phi-3-Large-5.6b Held-out reconstruction 45.8
  404. 404 qnguyen3/quan-1.8b-chat Held-out reconstruction 44.7
  405. 405 Ritvik19/zephyr-2b-gemma-sft-qlora Held-out reconstruction 44.4
  406. 406 langgptai/Qwen-sft-ls-v0.1 Held-out reconstruction 44.3
  407. 407 stabilityai/stablelm-2-1_6b Held-out reconstruction 43.8
  408. 408 langgptai/Qwen-sft-la-v0.1 Held-out reconstruction 43.8
  409. 409 itsliupeng/openllama-7b-base Held-out reconstruction 43.6
  410. 410 abhinand/tamil-llama-7b-instruct-v0.1 Held-out reconstruction 43.3
  411. 411 jisukim8873/falcon-7B-case-5 Held-out reconstruction 43.1
  412. 412 kalisai/Nusantara-4b-Indo-Chat Held-out reconstruction 42.9
  413. 413 raincandy-u/Coder1.8-ORPO-TEST Held-out reconstruction 42.9
  414. 414 pmking27/PrathameshLLM-2B Held-out reconstruction 42.1
  415. 415 Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0 Held-out reconstruction 42.1
  416. 416 Zangs3011/falcon_7b_DolphinCoder Held-out reconstruction 41.0
  417. 417 sartifyllc/dociproLLM-7B Held-out reconstruction 40.9
  418. 418 Qwen/Qwen1.5-1.8B-Chat Held-out reconstruction 40.6
  419. 419 vihangd/dopeyshearedplats-2.7b-v1 Held-out reconstruction 40.6
  420. 420 csujeong/Falcon-7B-Fintued-Finance-Stock-E Held-out reconstruction 40.5
  421. 421 mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1 Held-out reconstruction 39.8
  422. 422 cyberagent/calm2-7b-chat Held-out reconstruction 39.7
  423. 423 Heng666/EastAsia-4x7B-Moe-experiment Held-out reconstruction 39.1
  424. 424 aloobun/open-llama-3b-v2-elmv3 Held-out reconstruction 39.1
  425. 425 M4-ai/NeuralReyna-Mini-1.8B-v0.3 Held-out reconstruction 39.1
  426. 426 Pierre-obi/Mistral_solar-slerp Held-out reconstruction 38.8
  427. 427 xaviviro/FLAMA-0.5-3B Held-out reconstruction 38.4
  428. 428 mwitiderrick/open_llama_3b_glaive_assistant_v0.1 Held-out reconstruction 37.7
  429. 429 deepseek-ai/deepseek-coder-6.7b-base Held-out reconstruction 37.7
  430. 430 raidhon/coven_tiny_1.1b_32k_orpo_alpha Held-out reconstruction 36.3
  431. 431 ddyuudd/merge_dolly-v2-3b_dpo_test Held-out reconstruction 36.0
  432. 432 RESMPDEV/Qwen1.5-Wukong-0.5B Held-out reconstruction 35.6
  433. 433 cognitivecomputations/TinyDolphin-2.8.1-1.1b Held-out reconstruction 35.4
  434. 434 alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2 Held-out reconstruction 35.1
  435. 435 Josephgflowers/TinyLlama-Cinder-Agent-Rag Held-out reconstruction 34.9
  436. 436 Josephgflowers/TinyLlama-Cinder-1.3B-Test.2 Held-out reconstruction 34.8
  437. 437 ppopiolek/tinyllama_eng_short Held-out reconstruction 34.8
  438. 438 kevin009/babyllama-v0.6 Held-out reconstruction 34.6
  439. 439 l3utterfly/tinyllama-1.1b-layla-v4 Held-out reconstruction 34.5
  440. 440 vihangd/shearedplats-1.3b-v1 Held-out reconstruction 34.2
  441. 441 ewqr2130/TinyLamma-SFT Held-out reconstruction 34.1
  442. 442 abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft Held-out reconstruction 34.1
  443. 443 KnutJaegersberg/platypus-1_8b Held-out reconstruction 34.0
  444. 444 KnutJaegersberg/falcon-1b-t-sft Held-out reconstruction 34.0
  445. 445 HuggingFaceTB/cosmo-1b Held-out reconstruction 33.9
  446. 446 ToastyPigeon/SmolPlatypus-1.5B-Sorted Held-out reconstruction 33.8
  447. 447 nnpy/Nape-0 Held-out reconstruction 33.7
  448. 448 Ramikan-BR/tinyllama-coder-py-4bit-v10 Held-out reconstruction 33.3
  449. 449 jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha Held-out reconstruction 33.1
  450. 450 Abhaykoul/OEvortex Held-out reconstruction 32.7
  451. 451 Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1 Held-out reconstruction 32.4
  452. 452 Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG Held-out reconstruction 31.9
  453. 453 gpt2-xl Held-out reconstruction 30.8
  454. 454 raincandy-u/Quark-464M-v0.2 Held-out reconstruction 30.4
  455. 455 gemmathon/gemma-2b-ko-v0 Held-out reconstruction 28.7
  456. 456 deepseek-ai/deepseek-coder-1.3b-instruct Held-out reconstruction 28.6
  457. 457 Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF Held-out reconstruction 28.5
  458. 458 Sharathhebbar24/Instruct_GPT_v1 Held-out reconstruction 27.9
  459. 459 Isotonic/smol_llama-4x220M-MoE Held-out reconstruction 26.5
  460. 460 ethzanalytics/pythia-31m Held-out reconstruction 26.4
  461. 461 Sharathhebbar24/math_gpt2 Held-out reconstruction 26.3
  462. 462 Felladrin/Minueza-32M-UltraChat Held-out reconstruction 26.2
  463. 463 wannaphong/numfalm-3b Held-out reconstruction 25.8
  464. 464 Facebook/OPT-125M Held-out reconstruction 25.5

Source: Official metabench leaderboard

#EntryScoreSettingDateSource
1 SF-Foundation/Ein-72B-v0.12 79.0 Held-out reconstruction Official leaderboard
2 Mixtral 8x22B 76.7 Held-out reconstruction Apr 2024 Official leaderboard
3 MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3 76.0 Held-out reconstruction Official leaderboard
4 TomGrc/FusionNet_34Bx2_MoE_v0.1 74.5 Held-out reconstruction Official leaderboard
5 yam-peleg/Experiment24-7B 74.4 Held-out reconstruction Official leaderboard
6 allknowingroger/Neuralmultiverse-7B-slerp 74.3 Held-out reconstruction Official leaderboard
7 ammarali32/multi_verse_model 74.3 Held-out reconstruction Official leaderboard
8 allknowingroger/Calmex26merge-12B-MoE 74.2 Held-out reconstruction Official leaderboard
9 yam-peleg/Experiment29-7B 74.2 Held-out reconstruction Official leaderboard
10 CultriX/NeuralTrix-bf16 74.2 Held-out reconstruction Official leaderboard
11 eldogbbhed/NeuralBeagleJaskier 74.2 Held-out reconstruction Official leaderboard
12 Gille/StrangeMerges_32-7B-slerp 74.1 Held-out reconstruction Official leaderboard
13 fblgit/UNA-SimpleSmaug-34b-v1beta 74.1 Held-out reconstruction Official leaderboard
14 ValiantLabs/Llama3-70B-Fireplace 74.1 Held-out reconstruction Official leaderboard
15 yam-peleg/Experiment27-7B 74.1 Held-out reconstruction Official leaderboard
16 mlabonne/Zebrafish-7B 74.0 Held-out reconstruction Official leaderboard
17 allknowingroger/mergekit-slerp-zplzqvn 74.0 Held-out reconstruction Official leaderboard
18 mayacinka/yam-jom-7B 74.0 Held-out reconstruction Official leaderboard
19 MaziyarPanahi/Calme-7B-Instruct-v0.1.1 74.0 Held-out reconstruction Official leaderboard
20 cloudyu/Mixtral_34Bx2_MoE_60B 73.9 Held-out reconstruction Official leaderboard
21 CultriX/AlphaCeption-7B-v1 73.9 Held-out reconstruction Official leaderboard
22 automerger/PasticheInex12-7B 73.8 Held-out reconstruction Official leaderboard
23 ConvexAI/Luminex-34B-v0.1 73.8 Held-out reconstruction Official leaderboard
24 cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B 73.8 Held-out reconstruction Official leaderboard
25 shenzhi-wang/Llama3-70B-Chinese-Chat 73.8 Held-out reconstruction Official leaderboard
26 arcee-ai/Clown-DPO-Extended 73.8 Held-out reconstruction Official leaderboard
27 eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2 73.8 Held-out reconstruction Official leaderboard
28 automerger/ShadowYamshadow-7B 73.7 Held-out reconstruction Official leaderboard
29 daxiongshu/Pluto_24B_DPO_63 73.7 Held-out reconstruction Official leaderboard
30 nbeerbower/slerp-bophades-truthy-math-mistral-7B 73.7 Held-out reconstruction Official leaderboard
31 Kukedlc/NeuralMaxime-7B-slerp 73.7 Held-out reconstruction Official leaderboard
32 rmdhirr/Multiparadigm_7B 73.5 Held-out reconstruction Official leaderboard
33 yam-peleg/Experiment22-7B 73.4 Held-out reconstruction Official leaderboard
34 alchemonaut/BoreanGale-70B 73.3 Held-out reconstruction Official leaderboard
35 nbeerbower/Flammen-Bophades-7B 73.3 Held-out reconstruction Official leaderboard
36 allknowingroger/Multimerge-Neurallaymons-12B-MoE 73.3 Held-out reconstruction Official leaderboard
37 MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1 73.3 Held-out reconstruction Official leaderboard
38 YKM11/Mistral-7B-adaptv1 73.3 Held-out reconstruction Official leaderboard
39 saltlux/luxia-21.4b-alignment-v1.0 73.2 Held-out reconstruction Official leaderboard
40 alnrg2arg/blockchainlabs_7B_merged_test2_4 73.0 Held-out reconstruction Official leaderboard
41 dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach 73.0 Held-out reconstruction Official leaderboard
42 Kukedlc/Neural-4-Maths-7b 73.0 Held-out reconstruction Official leaderboard
43 AiMavenAi/AiMaven-Prometheus 73.0 Held-out reconstruction Official leaderboard
44 leveldevai/TurdusDareBeagle-7B 72.9 Held-out reconstruction Official leaderboard
45 Kukedlc/Fasciculus-Arcuatus-7B-slerp 72.8 Held-out reconstruction Official leaderboard
46 FelixChao/Scorpio-7B 72.8 Held-out reconstruction Official leaderboard
47 CultriX/Wernicke-7B-dpo 72.8 Held-out reconstruction Official leaderboard
48 alnrg2arg/blockchainlabs_test3_seminar 72.7 Held-out reconstruction Official leaderboard
49 fblgit/UNA-34BeagleSimpleMath-32K-v1 72.7 Held-out reconstruction Official leaderboard
50 Weyaxi/Cosmosis-3x34B 72.7 Held-out reconstruction Official leaderboard
51 kaitchup/TheMayonnaise 72.6 Held-out reconstruction Official leaderboard
52 YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2 72.6 Held-out reconstruction Official leaderboard
53 AbacusResearch/jaLLAbi2-7b 72.5 Held-out reconstruction Official leaderboard
54 kekmodel/StopCarbon-10.7B-v5 72.5 Held-out reconstruction Official leaderboard
55 leveldevai/MarcBeagle-7B 72.4 Held-out reconstruction Official leaderboard
56 CultriX/Wernicke-7B-v9 72.4 Held-out reconstruction Official leaderboard
57 Kquant03/Samlagast-7B-laser-bf16 72.4 Held-out reconstruction Official leaderboard
58 allknowingroger/Neuralmaath-12B-MoE 72.2 Held-out reconstruction Official leaderboard
59 zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0 72.2 Held-out reconstruction Official leaderboard
60 mlabonne/Beagle14-7B 72.2 Held-out reconstruction Official leaderboard
61 ConvexAI/BurningBruce-003 72.1 Held-out reconstruction Official leaderboard
62 leveldevai/MarcDareBeagle-7B 72.1 Held-out reconstruction Official leaderboard
63 dddsaty/SOLAR-Instruct-ko-Adapter-Attach 71.9 Held-out reconstruction Official leaderboard
64 h2m/mhm-8x7B-FrankenMoE-v1.0 71.9 Held-out reconstruction Official leaderboard
65 nbeerbower/bruphin-epsilon 71.9 Held-out reconstruction Official leaderboard
66 moreh/MoMo-70B-LoRA-V1.4 71.9 Held-out reconstruction Official leaderboard
67 SC56/Mistral-7B-orca-dpo-12h 71.8 Held-out reconstruction Official leaderboard
68 MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1 71.7 Held-out reconstruction Official leaderboard
69 DopeorNope/SOLARC-MOE-10.7Bx4 71.7 Held-out reconstruction Official leaderboard
70 kekmodel/StopCarbon-10.7B-v6 71.6 Held-out reconstruction Official leaderboard
71 janai-hq/trinity-v1 71.6 Held-out reconstruction Official leaderboard
72 ResplendentAI/DaturaCookie_7B 71.5 Held-out reconstruction Official leaderboard
73 vicgalle/NeuralBeagle-11B 71.5 Held-out reconstruction Official leaderboard
74 CultriX/MergeTrix-7B-v2 71.4 Held-out reconstruction Official leaderboard
75 Aryanne/Westest-7B 71.4 Held-out reconstruction Official leaderboard
76 DreadPoor/SilverMaiden-7B-slerp 71.3 Held-out reconstruction Official leaderboard
77 yam-peleg/Experiment7-7B 71.3 Held-out reconstruction Official leaderboard
78 MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1 71.2 Held-out reconstruction Official leaderboard
79 cloudyu/Mixtral_7Bx6_MoE_35B 71.0 Held-out reconstruction Official leaderboard
80 SUSTech/SUS-Chat-34B 70.9 Held-out reconstruction Official leaderboard
81 Gille/MoE-StrangeMerges-2x7B 70.8 Held-out reconstruction Official leaderboard
82 ibndias/Nous-Hermes-2-MoE-2x34B 70.8 Held-out reconstruction Official leaderboard
83 Steelskull/Umbra-v3-MoE-4x11b-2ex 70.8 Held-out reconstruction Official leaderboard
84 jsfs11/SnorkelWestBeagle-DARETIES-7B 70.8 Held-out reconstruction Official leaderboard
85 allknowingroger/StarlingMaths-12B-MoE 70.7 Held-out reconstruction Official leaderboard
86 chujiezheng/tulu-2-dpo-70b-ExPO 70.7 Held-out reconstruction Official leaderboard
87 Test157t/Prima-LelantaclesV6-7b 70.7 Held-out reconstruction Official leaderboard
88 vicgalle/test-merge-3 70.7 Held-out reconstruction Official leaderboard
89 JaeyeonKang/CCK_Asura_v2 70.6 Held-out reconstruction Official leaderboard
90 jan-ai/Pandora-10.7B-v1 70.6 Held-out reconstruction Official leaderboard
91 maywell/PiVoT-SUS-RP 70.6 Held-out reconstruction Official leaderboard
92 Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B 70.6 Held-out reconstruction Official leaderboard
93 NLPark/AnFeng_v3_Avocet 70.6 Held-out reconstruction Official leaderboard
94 flammenai/flammen22-mistral-7B 70.5 Held-out reconstruction Official leaderboard
95 nbeerbower/flammen11X-mistral-7B 70.4 Held-out reconstruction Official leaderboard
96 occultml/CatMarcoro14-7B-slerp 70.4 Held-out reconstruction Official leaderboard
97 Himitsui/KuroMitsu-11B 70.3 Held-out reconstruction Official leaderboard
98 shadowml/Daredevil-7B 70.3 Held-out reconstruction Official leaderboard
99 yunconglong/7Bx4_DPO_2e 70.3 Held-out reconstruction Official leaderboard
100 Inv/Konstanta-7B 70.2 Held-out reconstruction Official leaderboard
101 ParasiticRogue/Merged-RP-Stew-V2-34B 70.2 Held-out reconstruction Official leaderboard
102 AA051610/A0127 70.2 Held-out reconstruction Official leaderboard
103 mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp 70.2 Held-out reconstruction Official leaderboard
104 brucethemoose/Yi-34B-200K-DARE-merge-v7 69.9 Held-out reconstruction Official leaderboard
105 DreadPoor/Chimera-7B-slerp 69.8 Held-out reconstruction Official leaderboard
106 DreadPoor/RoyalNoroichi-7B-slerp 69.7 Held-out reconstruction Official leaderboard
107 JaeyeonKang/CCK_Gony_v3.1 69.7 Held-out reconstruction Official leaderboard
108 Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled 69.6 Held-out reconstruction Official leaderboard
109 jeiku/Cookie_7B 69.6 Held-out reconstruction Official leaderboard
110 DreadPoor/RoyalMaid-7B-slerp 69.6 Held-out reconstruction Official leaderboard
111 abacusai/Liberated-Qwen1.5-72B 69.5 Held-out reconstruction Official leaderboard
112 Aryanne/MixSwap 69.5 Held-out reconstruction Official leaderboard
113 SanjiWatsuki/Kunoichi-DPO-v2-7B 69.4 Held-out reconstruction Official leaderboard
114 giraffe176/WestMaid_HermesMonarchv0.1 69.4 Held-out reconstruction Official leaderboard
115 cloudyu/Pluto_24B_DPO_200 69.2 Held-out reconstruction Official leaderboard
116 APMIC/caigun-lora-model-34B-v2 69.2 Held-out reconstruction Official leaderboard
117 ChaoticNeutrals/This_is_fine_7B 69.1 Held-out reconstruction Official leaderboard
118 saishf/Top-Western-Maid-7B 69.1 Held-out reconstruction Official leaderboard
119 YeungNLP/firefly-mixtral-8x7b-v0.1 69.1 Held-out reconstruction Official leaderboard
120 YeungNLP/firefly-mixtral-8x7b-v1 69.1 Held-out reconstruction Official leaderboard
121 flammenai/Mahou-1.0-mistral-7B 68.9 Held-out reconstruction Official leaderboard
122 nbeerbower/flammen2 68.9 Held-out reconstruction Official leaderboard
123 DreadPoor/Satyr-7B-Model_Stock 68.8 Held-out reconstruction Official leaderboard
124 viethq188/LeoScorpius-7B 68.7 Held-out reconstruction Official leaderboard
125 EmbeddedLLM/Mistral-7B-Merge-14-v0.5 68.6 Held-out reconstruction Official leaderboard
126 Locutusque/Hyperion-2.0-Yi-34B 68.6 Held-out reconstruction Official leaderboard
127 Danielbrdz/Barcenas-Llama3-8b-ORPO 68.5 Held-out reconstruction Official leaderboard
128 Nitral-AI/KukulStanta-7B 68.5 Held-out reconstruction Official leaderboard
129 one-man-army/una-neural-chat-v3-3-P1-OMA 68.5 Held-out reconstruction Official leaderboard
130 adamo1139/Yi-34B-200K-AEZAKMI-v2 68.4 Held-out reconstruction Official leaderboard
131 Eric111/openchat-3.5-0106-128k-DPO 68.4 Held-out reconstruction Official leaderboard
132 AIDC-ai-business/Marcoroni-7B-v2 68.4 Held-out reconstruction Official leaderboard
133 brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties 68.4 Held-out reconstruction Official leaderboard
134 sethuiyer/Eida_10.7B 68.3 Held-out reconstruction Official leaderboard
135 APMIC/caigun-lora-model-34B-v3 68.3 Held-out reconstruction Official leaderboard
136 nisten/shqiponja-15b-v1 68.1 Held-out reconstruction Official leaderboard
137 Weyaxi/Seraph-openchat-3.5-1210-Slerp 68.1 Held-out reconstruction Official leaderboard
138 migtissera/Tess-M-v1.3 68.0 Held-out reconstruction Official leaderboard
139 nbeerbower/llama-3-stella-8B 68.0 Held-out reconstruction Official leaderboard
140 Q-bert/MetaMath-Cybertron 68.0 Held-out reconstruction Official leaderboard
141 PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp 67.9 Held-out reconstruction Official leaderboard
142 Sao10K/Solstice-11B-v1 67.9 Held-out reconstruction Official leaderboard
143 Abhinav7/NeuralPipe-7B-slerp 67.8 Held-out reconstruction Official leaderboard
144 chanwit/flux-7b-v0.1 67.6 Held-out reconstruction Official leaderboard
145 4season/sft_model_test1 67.5 Held-out reconstruction Official leaderboard
146 Inv/MoeMoE-2x7b 67.5 Held-out reconstruction Official leaderboard
147 perlthoughts/Chupacabra-8x7B-MoE 67.4 Held-out reconstruction Official leaderboard
148 lex-hue/Delexa-7b 67.3 Held-out reconstruction Official leaderboard
149 DreadPoor/NewtoccineLake-slerp-7B 67.3 Held-out reconstruction Official leaderboard
150 DeepKarkhanis/Mistral-Passthrough-8L-10B 67.3 Held-out reconstruction Official leaderboard
151 cloudyu/Mixtral_13B_Chat 67.2 Held-out reconstruction Official leaderboard
152 Yi-1.5-9B-Chat 67.2 Held-out reconstruction May 2024 Official leaderboard
153 AA051610/FT 67.2 Held-out reconstruction Official leaderboard
154 kyujinpy/PlatYi-34B-Q 67.2 Held-out reconstruction Official leaderboard
155 GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3 67.0 Held-out reconstruction Official leaderboard
156 MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1 67.0 Held-out reconstruction Official leaderboard
157 ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2 67.0 Held-out reconstruction Official leaderboard
158 migtissera/Tess-34B-v1.4 67.0 Held-out reconstruction Official leaderboard
159 Artples/L-MChat-7b 66.9 Held-out reconstruction Official leaderboard
160 vonjack/Phi-3-mini-4k-instruct-LLaMAfied 66.9 Held-out reconstruction Official leaderboard
161 ResplendentAI/Persephone_7B 66.8 Held-out reconstruction Official leaderboard
162 Azazelle/Maylin-7b 66.8 Held-out reconstruction Official leaderboard
163 CallComply/openchat-3.5-0106-32k 66.7 Held-out reconstruction Official leaderboard
164 openchat/openchat-3.5-0106 66.7 Held-out reconstruction Official leaderboard
165 nbeerbower/llama-3-sauce-v2-8B 66.6 Held-out reconstruction Official leaderboard
166 adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA 66.6 Held-out reconstruction Official leaderboard
167 Salesforce/xLAM-v0.1-r 66.4 Held-out reconstruction Official leaderboard
168 PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp 66.4 Held-out reconstruction Official leaderboard
169 Xenon1/Eclipse-13B-dpo 66.3 Held-out reconstruction Official leaderboard
170 andysalerno/openchat-nectar-0.6 66.2 Held-out reconstruction Official leaderboard
171 Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp 66.2 Held-out reconstruction Official leaderboard
172 argilla/DistilabelBeagle14-7B 66.2 Held-out reconstruction Official leaderboard
173 lex-hue/LexGPT-V3 66.2 Held-out reconstruction Official leaderboard
174 mlabonne/NeuralHermes-2.5-Mistral-7B 66.1 Held-out reconstruction Official leaderboard
175 Azure99/blossom-v3_1-yi-34b 66.1 Held-out reconstruction Official leaderboard
176 vicgalle/solarized-18B-dpo 66.1 Held-out reconstruction Official leaderboard
177 Yuma42/KangalKhan-ShatteredRuby-7B 66.0 Held-out reconstruction Official leaderboard
178 mayacinka/West-Ramen-7Bx4 65.8 Held-out reconstruction Official leaderboard
179 DeepMount00/phi_3 65.8 Held-out reconstruction Official leaderboard
180 saucam/aqua-smaug-0.3-8B 65.8 Held-out reconstruction Official leaderboard
181 icefog72/Kunokukulemonchini-7b 65.8 Held-out reconstruction Official leaderboard
182 Azazelle/Argetsu 65.7 Held-out reconstruction Official leaderboard
183 NousResearch/Nous-Hermes-2-Mistral-7B-DPO 65.7 Held-out reconstruction Official leaderboard
184 Isotonic/Hermes-2-Pro-Mixtral-4x7B 65.7 Held-out reconstruction Official leaderboard
185 cognitivecomputations/MegaDolphin-120b 65.6 Held-out reconstruction Official leaderboard
186 tenyx/TenyxChat-7B-v1 65.4 Held-out reconstruction Official leaderboard
187 Gille/StrangeMerges_12-7B-slerp 65.3 Held-out reconstruction Official leaderboard
188 Muhammad2003/TriMistral-7B-TIES 65.3 Held-out reconstruction Official leaderboard
189 decruz07/kellemar-DPO-7B 65.3 Held-out reconstruction Official leaderboard
190 fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged 65.3 Held-out reconstruction Official leaderboard
191 elinas/Llama-3-15B-Instruct-zeroed-ft 65.1 Held-out reconstruction Official leaderboard
192 Liangmingxin/ThetaWave-7B-sft 65.1 Held-out reconstruction Official leaderboard
193 ibivibiv/aegolius-acadicus-34b-v3 65.0 Held-out reconstruction Official leaderboard
194 Ba2han/Llama-Phi-3_DoRA 65.0 Held-out reconstruction Official leaderboard
195 mahiatlinux/ShadowDolph-7B-v1 65.0 Held-out reconstruction Official leaderboard
196 dozzke/hermorca 64.9 Held-out reconstruction Official leaderboard
197 kyujinpy/PlatYi-34B-Llama-Q-v2 64.9 Held-out reconstruction Official leaderboard
198 Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp 64.7 Held-out reconstruction Official leaderboard
199 beowolx/CodeNinja-1.0-OpenChat-7B 64.7 Held-out reconstruction Official leaderboard
200 JunchengXie/Starling-LM-7B-alpha-gpt-4-80k 64.7 Held-out reconstruction Official leaderboard
201 aloobun/slerp_bun_mistral_7b_v2 64.6 Held-out reconstruction Official leaderboard
202 Isaak-Carter/JOSIE_Beta-4-7B-slerp 64.6 Held-out reconstruction Official leaderboard
203 mahiatlinux/MasherAI-v6.1-7B-eval-test 64.6 Held-out reconstruction Official leaderboard
204 SeaLLMs/SeaLLM-7B-v2 64.6 Held-out reconstruction Official leaderboard
205 jondurbin/bagel-dpo-7b-v0.4 64.5 Held-out reconstruction Official leaderboard
206 nlpguy/ColorShadow-7B-v3 64.4 Held-out reconstruction Official leaderboard
207 H-D-T/Buzz-8b-Large-v0.5 64.4 Held-out reconstruction Official leaderboard
208 beberik/rawr 64.3 Held-out reconstruction Official leaderboard
209 TomGrc/FusionNet_passthrough_v0.1 64.3 Held-out reconstruction Official leaderboard
210 nlpguy/StarFusion-alpha2 64.3 Held-out reconstruction Official leaderboard
211 perlthoughts/Starling-LM-alpha-8x7B-MoE 64.3 Held-out reconstruction Official leaderboard
212 Undi95/Llama-3-Unholy-8B 64.3 Held-out reconstruction Official leaderboard
213 Starling-LM-7B-alpha 64.3 Held-out reconstruction Nov 2023 Official leaderboard
214 ABX-AI/Quantum-Citrus-9B 64.2 Held-out reconstruction Official leaderboard
215 bababababooey/mergekit-slerp-mntqhzv 64.2 Held-out reconstruction Official leaderboard
216 freecs/ThetaWave-7B-v1 64.1 Held-out reconstruction Official leaderboard
217 HIT-SCIR/Chinese-Mixtral-8x7B 64.1 Held-out reconstruction Official leaderboard
218 ResplendentAI/Aura_L3_8B 64.1 Held-out reconstruction Official leaderboard
219 Azazelle/Mocha-Sample-7b-ex 64.1 Held-out reconstruction Official leaderboard
220 joowon99/SOLAR-10.7B-ko_alpaca 64.1 Held-out reconstruction Official leaderboard
221 Replete-AI/Mistral-11b-v0.1 64.1 Held-out reconstruction Official leaderboard
222 Replete-AI/Mistral-Evolved-11b-v0.1 64.1 Held-out reconstruction Official leaderboard
223 FuseAI/FuseChat-7B-VaRM 64.0 Held-out reconstruction Official leaderboard
224 abhishek/autotrain-llama3-orpo-v2 64.0 Held-out reconstruction Official leaderboard
225 AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1 63.9 Held-out reconstruction Official leaderboard
226 Qwen1.5-14B 63.7 Held-out reconstruction Feb 2024 Official leaderboard
227 Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B 63.6 Held-out reconstruction Official leaderboard
228 rombodawg/Llama-3-8B-Instruct-Coder 63.5 Held-out reconstruction Official leaderboard
229 abhishekchohan/mistral-7B-forest-merge-v0.1 63.3 Held-out reconstruction Official leaderboard
230 hydra-project/OpenHyperion-2.5-Mistral-7B 63.3 Held-out reconstruction Official leaderboard
231 NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS 63.3 Held-out reconstruction Official leaderboard
232 cstr/phi-3-orpo-v9_16 63.2 Held-out reconstruction Official leaderboard
233 TeeZee/Kyllene-v1.0 63.2 Held-out reconstruction Official leaderboard
234 jeiku/Zephyr_beta_32k_7B 63.2 Held-out reconstruction Official leaderboard
235 SC99/Mistral-7B-privatemix-base-ia 63.1 Held-out reconstruction Official leaderboard
236 Steelskull/VerA-Etheria-55b 63.0 Held-out reconstruction Official leaderboard
237 HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2 63.0 Held-out reconstruction Official leaderboard
238 grimjim/zephyr-beta-wizardLM-2-merge-7B 62.9 Held-out reconstruction Official leaderboard
239 ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2 62.8 Held-out reconstruction Official leaderboard
240 perlthoughts/openchat-3.5-1210-32k-8x7b-MoE 62.8 Held-out reconstruction Official leaderboard
241 manishiitg/open-aditi-hi-v4 62.7 Held-out reconstruction Official leaderboard
242 yaojialzc/Gigi-Llama3-8B-Chinese-zh 62.7 Held-out reconstruction Official leaderboard
243 ContextualAI/Contextual_KTO_Mistral_PairRM 62.6 Held-out reconstruction Official leaderboard
244 LeroyDyer/Mixtral_AI_Cyber_Child 62.6 Held-out reconstruction Official leaderboard
245 azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0 62.6 Held-out reconstruction Official leaderboard
246 Weyaxi/Einstein-v5-v0.2-7B 62.6 Held-out reconstruction Official leaderboard
247 TeeZee/DarkSapling-7B-v2.0 62.4 Held-out reconstruction Official leaderboard
248 liminerity/Blured-Ties-7B 62.3 Held-out reconstruction Official leaderboard
249 Joseph717171/Genstruct-10.7B 62.2 Held-out reconstruction Official leaderboard
250 NeverSleep/MiquMaid-v2-70B 62.1 Held-out reconstruction Official leaderboard
251 x2bee/POLAR-14B-v0.2 62.0 Held-out reconstruction Official leaderboard
252 cloudyu/Mixtral_7Bx2_MoE_13B 62.0 Held-out reconstruction Official leaderboard
253 DreadPoor/ToppyEvil-7B-slerp 61.9 Held-out reconstruction Official leaderboard
254 netcat420/MFANN3bv0.6 61.9 Held-out reconstruction Official leaderboard
255 BlueNipples/SnowLotus-v2-10.7B 61.8 Held-out reconstruction Official leaderboard
256 ewqr2130/mistral-inst-ppo 61.8 Held-out reconstruction Official leaderboard
257 922-CA/monika-ddlc-8b-v1 61.7 Held-out reconstruction Official leaderboard
258 silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3 61.6 Held-out reconstruction Official leaderboard
259 PulsarAI/Einstein-v3-7B 61.5 Held-out reconstruction Official leaderboard
260 jondurbin/bagel-7b-v0.4 61.5 Held-out reconstruction Official leaderboard
261 macadeliccc/gemma-orchid-7b-dpo 61.4 Held-out reconstruction Official leaderboard
262 nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp 61.4 Held-out reconstruction Official leaderboard
263 yanolja/KoSOLAR-10.7B-v0.2 61.4 Held-out reconstruction Official leaderboard
264 lodrick-the-lafted/Hermes-Instruct-7B-100K 61.3 Held-out reconstruction Official leaderboard
265 eswardivi/llamathon 61.2 Held-out reconstruction Official leaderboard
266 g-ronimo/llama3-8b-SlimHermes 61.2 Held-out reconstruction Official leaderboard
267 Qwen1.5-72B 61.2 Held-out reconstruction Feb 2024 Official leaderboard
268 LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0 61.1 Held-out reconstruction Official leaderboard
269 uukuguy/speechless-mistral-7B-v0.2-mixed-1 61.0 Held-out reconstruction Official leaderboard
270 zelus82/Obelix-Phi2-v0 61.0 Held-out reconstruction Official leaderboard
271 Changgil/K2S3-Mistral-7b-v1.0 60.8 Held-out reconstruction Official leaderboard
272 dfurman/Llama-3-8B-Orpo-v0.1 60.8 Held-out reconstruction Official leaderboard
273 Azure99/blossom-v4-mistral-7b 60.7 Held-out reconstruction Official leaderboard
274 ibm/merlinite-7b 60.6 Held-out reconstruction Official leaderboard
275 Deci/DeciLM-7B-instruct 60.5 Held-out reconstruction Official leaderboard
276 ozayezerceli/Threnystril-2x7B-moe 60.4 Held-out reconstruction Official leaderboard
277 DUAL-GPO/zephyr-7b-gpo-update4-i0 60.4 Held-out reconstruction Official leaderboard
278 tourist800/mistral_2X7b 60.3 Held-out reconstruction Official leaderboard
279 itsliupeng/llama_9b_long 60.1 Held-out reconstruction Official leaderboard
280 uukuguy/speechless-zephyr-code-functionary-7b 60.1 Held-out reconstruction Official leaderboard
281 cloudyu/mistral_18B_instruct_v0.1 60.0 Held-out reconstruction Official leaderboard
282 Artples/L-MChat-Small 60.0 Held-out reconstruction Official leaderboard
283 eduagarcia/mistral-orpo-mix-7k 59.7 Held-out reconstruction Official leaderboard
284 MaziyarPanahi/gemma-7b-alpaca-52k-v0.1 59.7 Held-out reconstruction Official leaderboard
285 grayhacker91/gemma-7b-open-platypus-commercial 59.6 Held-out reconstruction Official leaderboard
286 MaziyarPanahi/phi-2-logical-sft 59.6 Held-out reconstruction Official leaderboard
287 NeuralNovel/Aeryth-7B-v0.1 59.6 Held-out reconstruction Official leaderboard
288 Locutusque/Hercules-2.0-Mistral-7B 59.5 Held-out reconstruction Official leaderboard
289 jefferylovely/AthenaImaniMaven 59.5 Held-out reconstruction Official leaderboard
290 Alsebay/Lorge-2x7B-UAMM 59.4 Held-out reconstruction Official leaderboard
291 Syed-Hasan-8503/Llama-3-8B-NOLA 59.4 Held-out reconstruction Official leaderboard
292 bunnycore/Blackbird-Llama-3-8B 59.4 Held-out reconstruction Official leaderboard
293 Locutusque/Hyperion-2.1-Mistral-7B 59.4 Held-out reconstruction Official leaderboard
294 chlee10/T3Q-Platypus-SOLAR 59.4 Held-out reconstruction Official leaderboard
295 AlanRobotics/nanobot_v1 59.3 Held-out reconstruction Official leaderboard
296 abhishekchohan/mistral-7B-forest-dpo 59.2 Held-out reconstruction Official leaderboard
297 airesearch/typhoon-7b-WangchanX-sft-Demo 59.2 Held-out reconstruction Official leaderboard
298 Novocoders/Mistral-NeuralDPO-v0.5 59.2 Held-out reconstruction Official leaderboard
299 Undi95/Meta-Llama-3-8B-hf 59.0 Held-out reconstruction Official leaderboard
300 jisukim8873/mistralai-case-2-0 59.0 Held-out reconstruction Official leaderboard
301 NotAiLOL/Yi-1.5-9B-coder 59.0 Held-out reconstruction Official leaderboard
302 WDong/Qwen1.5-7B-sft-0502 59.0 Held-out reconstruction Official leaderboard
303 andysalerno/rainbowfish-7B-v10 59.0 Held-out reconstruction Official leaderboard
304 Intel/neural-chat-7b-v3-1 59.0 Held-out reconstruction Official leaderboard
305 DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1 58.7 Held-out reconstruction Official leaderboard
306 NeuralNovel/Senzu-7B-v0.1-DPO 58.5 Held-out reconstruction Official leaderboard
307 Ichsan2895/Merak-7B-v5-PROTOTYPE1 58.5 Held-out reconstruction Official leaderboard
308 chatty123/mistral_rank32_invert 58.4 Held-out reconstruction Official leaderboard
309 Isaak-Carter/J.O.S.I.E.3-Beta8-slerp 58.3 Held-out reconstruction Official leaderboard
310 KnutJaegersberg/Deacon-20B 58.3 Held-out reconstruction Official leaderboard
311 ABX-AI/Spicy-Laymonade-7B 58.3 Held-out reconstruction Official leaderboard
312 HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K 58.3 Held-out reconstruction Official leaderboard
313 allknowingroger/ANIMA-biodesign-7B-slerp 58.2 Held-out reconstruction Official leaderboard
314 awnr/Mistral-7B-v0.1-half-naive-A 58.1 Held-out reconstruction Official leaderboard
315 openaccess-ai-collective/mistral-7b-slimorcaboros 58.1 Held-out reconstruction Official leaderboard
316 JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k 58.1 Held-out reconstruction Official leaderboard
317 MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1 58.0 Held-out reconstruction Official leaderboard
318 vaiv/llamion-14b-base 58.0 Held-out reconstruction Official leaderboard
319 WDong/Qwen1.5-7B-sft-0506_9_8 58.0 Held-out reconstruction Official leaderboard
320 awnr/Mistral-7B-v0.1-signtensors-1-over-2 58.0 Held-out reconstruction Official leaderboard
321 jrruethe/balthazar-2x10.7b-v1 57.9 Held-out reconstruction Official leaderboard
322 jondurbin/bagel-8x7b-v0.2 57.8 Held-out reconstruction Official leaderboard
323 huseyinatahaninan/phi-2-instruction 57.7 Held-out reconstruction Official leaderboard
324 Mollel/Swahili_Gemma 57.6 Held-out reconstruction Official leaderboard
325 Mr-Bhaskar/fbt-gemma-7b 57.5 Held-out reconstruction Official leaderboard
326 NovoCode/Novocode7b-v3 57.5 Held-out reconstruction Official leaderboard
327 alvarobartt/mistral-7b-orpo-capybara-reproduction 57.4 Held-out reconstruction Official leaderboard
328 SuperAGI/SAM 57.4 Held-out reconstruction Official leaderboard
329 maywell/Synatra-RP-Orca-2-7b-v0.1 57.2 Held-out reconstruction Official leaderboard
330 ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4 57.2 Held-out reconstruction Official leaderboard
331 TheBloke/orca_mini_v3_13B-GPTQ 56.8 Held-out reconstruction Official leaderboard
332 xi0v/aether-7b-chat-v1.0 56.7 Held-out reconstruction Official leaderboard
333 ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4 56.5 Held-out reconstruction Official leaderboard
334 macadeliccc/Opus-Samantha-Llama-3-8B 56.3 Held-out reconstruction Official leaderboard
335 ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1 56.3 Held-out reconstruction Official leaderboard
336 maldv/dragonwar-7b-s1 56.3 Held-out reconstruction Official leaderboard
337 ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4 56.3 Held-out reconstruction Official leaderboard
338 DeepMount00/Mistral-RAG 56.3 Held-out reconstruction Official leaderboard
339 Sao10K/L3-Solana-8B-v1 56.2 Held-out reconstruction Official leaderboard
340 Langboat/Mengzi3-13B-Base 56.1 Held-out reconstruction Official leaderboard
341 yam-peleg/Hebrew-Mistral-7B 56.1 Held-out reconstruction Official leaderboard
342 HuggingFaceH4/mistral-7b-grok 56.1 Held-out reconstruction Official leaderboard
343 failspy/Llama-3-8B-Instruct-abliterated 55.9 Held-out reconstruction Official leaderboard
344 CreitinGameplays/ConvAI-9b 55.9 Held-out reconstruction Official leaderboard
345 BlueNipples/TimeCrystal-l2-13B 55.9 Held-out reconstruction Official leaderboard
346 NLUHOPOE/test-case-5 55.6 Held-out reconstruction Official leaderboard
347 Norquinal/Mistral-7B-claude-instruct 55.6 Held-out reconstruction Official leaderboard
348 TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k 55.5 Held-out reconstruction Official leaderboard
349 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta 55.5 Held-out reconstruction Official leaderboard
350 freeCS-dot-org/Zero-7B-test-3 55.5 Held-out reconstruction Official leaderboard
351 NeverSleep/Noromaid-13b-v0.3 55.2 Held-out reconstruction Official leaderboard
352 kyujinpy/SOLAR-Platypus-10.7B-v1 54.9 Held-out reconstruction Official leaderboard
353 XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k 54.6 Held-out reconstruction Official leaderboard
354 CohereForAI/aya-23-8B 54.5 Held-out reconstruction Official leaderboard
355 vaiv/llamion-14b-chat 54.5 Held-out reconstruction Official leaderboard
356 vicgalleorg/TruthfulQwen1.5-4B 54.4 Held-out reconstruction Official leaderboard
357 arlineka/Brunhilde-13b-v1 54.3 Held-out reconstruction Official leaderboard
358 ZoidBB/unraveled-7b-a1 54.3 Held-out reconstruction Official leaderboard
359 Undi95/PsyMedRP-v1-20B 54.2 Held-out reconstruction Official leaderboard
360 BFauber/lora_llama2-13b_10e5_r8_a16 54.2 Held-out reconstruction Official leaderboard
361 jefferylovely/AiMaven-Orca2 53.9 Held-out reconstruction Official leaderboard
362 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta 53.9 Held-out reconstruction Official leaderboard
363 pleisto/yuren-13b-chatml 53.4 Held-out reconstruction Official leaderboard
364 Technoculture/Medorca-2x7b 53.2 Held-out reconstruction Official leaderboard
365 TwT-6/open_llm_leaderboard_demo2 53.0 Held-out reconstruction Official leaderboard
366 bn22/DolphinMini-Mistral-7B 52.9 Held-out reconstruction Official leaderboard
367 KatyTheCutie/EstopianMaid-13B 52.8 Held-out reconstruction Official leaderboard
368 namirocks/tutor-model-13b-ep3 52.6 Held-out reconstruction Official leaderboard
369 CausalLM/7B-DPO-alpha 52.6 Held-out reconstruction Official leaderboard
370 royallab/PsyOrca2-13b-DARE 52.6 Held-out reconstruction Official leaderboard
371 ajibawa-2023/SlimOrca-Llama-3-8B 52.3 Held-out reconstruction Official leaderboard
372 Locutusque/Orca-2-13b-SFT-v6 52.2 Held-out reconstruction Official leaderboard
373 llm-agents/tora-13b-v1.0 52.0 Held-out reconstruction Official leaderboard
374 mayacinka/Open-StaMis-v02-stock 51.9 Held-out reconstruction Official leaderboard
375 Kquant03/Medusa-7B-bf16 51.8 Held-out reconstruction Official leaderboard
376 euclaise/Ferret_7B 51.6 Held-out reconstruction Official leaderboard
377 KnutJaegersberg/webMistral-7B 51.4 Held-out reconstruction Official leaderboard
378 NLUHOPOE/Mistral-7B-random-100000 51.4 Held-out reconstruction Official leaderboard
379 ajibawa-2023/Python-Code-13B 51.4 Held-out reconstruction Official leaderboard
380 hywu/Camelidae-8x7B 51.3 Held-out reconstruction Official leaderboard
381 abacusai/Giraffe-beta-13b-32k 51.3 Held-out reconstruction Official leaderboard
382 gmonsoon/MaxiCPM-3x3B-Test 51.1 Held-out reconstruction Official leaderboard
383 TheBloke/orca_mini_v3_7B-GPTQ 50.9 Held-out reconstruction Official leaderboard
384 Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct 50.8 Held-out reconstruction Official leaderboard
385 gmonsoon/MiniCPM-2B-Base 50.4 Held-out reconstruction Official leaderboard
386 Charlie911/vicuna-7b-v1.5-lora-mmlu-merged 50.4 Held-out reconstruction Official leaderboard
387 pansophic/new_model_test 50.0 Held-out reconstruction Official leaderboard
388 vikash06/doctorLLM 50.0 Held-out reconstruction Official leaderboard
389 DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567 49.8 Held-out reconstruction Official leaderboard
390 XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k 49.4 Held-out reconstruction Official leaderboard
391 ewqr2130/llama_ppo_1e6step_4000 49.0 Held-out reconstruction Official leaderboard
392 ericpolewski/AIRIC-The-Intern 48.8 Held-out reconstruction Official leaderboard
393 Charlie911/vicuna-7b-v1.5-general-temporal-merged 48.6 Held-out reconstruction Official leaderboard
394 Charlie911/zephyr-7b-beta-lora-mmlu-merged 47.9 Held-out reconstruction Official leaderboard
395 abdulrahman-nuzha/finetuned-llama-v2.0 47.8 Held-out reconstruction Official leaderboard
396 GeneZC/MiniChat-2-3B 47.7 Held-out reconstruction Official leaderboard
397 ValiantLabs/Fireplace-13b 47.6 Held-out reconstruction Official leaderboard
398 abhishek/autotrain-8kfjk-b3gva 47.3 Held-out reconstruction Official leaderboard
399 rishiraj/smol-3b 46.8 Held-out reconstruction Official leaderboard
400 tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora 46.6 Held-out reconstruction Official leaderboard
401 TeeZee/Buttocks-7B-v1.0 46.6 Held-out reconstruction Official leaderboard
402 ibivibiv/multimaster-7b 46.0 Held-out reconstruction Official leaderboard
403 DeepMount00/Phi-3-Large-5.6b 45.8 Held-out reconstruction Official leaderboard
404 qnguyen3/quan-1.8b-chat 44.7 Held-out reconstruction Official leaderboard
405 Ritvik19/zephyr-2b-gemma-sft-qlora 44.4 Held-out reconstruction Official leaderboard
406 langgptai/Qwen-sft-ls-v0.1 44.3 Held-out reconstruction Official leaderboard
407 stabilityai/stablelm-2-1_6b 43.8 Held-out reconstruction Official leaderboard
408 langgptai/Qwen-sft-la-v0.1 43.8 Held-out reconstruction Official leaderboard
409 itsliupeng/openllama-7b-base 43.6 Held-out reconstruction Official leaderboard
410 abhinand/tamil-llama-7b-instruct-v0.1 43.3 Held-out reconstruction Official leaderboard
411 jisukim8873/falcon-7B-case-5 43.1 Held-out reconstruction Official leaderboard
412 kalisai/Nusantara-4b-Indo-Chat 42.9 Held-out reconstruction Official leaderboard
413 raincandy-u/Coder1.8-ORPO-TEST 42.9 Held-out reconstruction Official leaderboard
414 pmking27/PrathameshLLM-2B 42.1 Held-out reconstruction Official leaderboard
415 Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0 42.1 Held-out reconstruction Official leaderboard
416 Zangs3011/falcon_7b_DolphinCoder 41.0 Held-out reconstruction Official leaderboard
417 sartifyllc/dociproLLM-7B 40.9 Held-out reconstruction Official leaderboard
418 Qwen/Qwen1.5-1.8B-Chat 40.6 Held-out reconstruction Official leaderboard
419 vihangd/dopeyshearedplats-2.7b-v1 40.6 Held-out reconstruction Official leaderboard
420 csujeong/Falcon-7B-Fintued-Finance-Stock-E 40.5 Held-out reconstruction Official leaderboard
421 mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1 39.8 Held-out reconstruction Official leaderboard
422 cyberagent/calm2-7b-chat 39.7 Held-out reconstruction Official leaderboard
423 Heng666/EastAsia-4x7B-Moe-experiment 39.1 Held-out reconstruction Official leaderboard
424 aloobun/open-llama-3b-v2-elmv3 39.1 Held-out reconstruction Official leaderboard
425 M4-ai/NeuralReyna-Mini-1.8B-v0.3 39.1 Held-out reconstruction Official leaderboard
426 Pierre-obi/Mistral_solar-slerp 38.8 Held-out reconstruction Official leaderboard
427 xaviviro/FLAMA-0.5-3B 38.4 Held-out reconstruction Official leaderboard
428 mwitiderrick/open_llama_3b_glaive_assistant_v0.1 37.7 Held-out reconstruction Official leaderboard
429 deepseek-ai/deepseek-coder-6.7b-base 37.7 Held-out reconstruction Official leaderboard
430 raidhon/coven_tiny_1.1b_32k_orpo_alpha 36.3 Held-out reconstruction Official leaderboard
431 ddyuudd/merge_dolly-v2-3b_dpo_test 36.0 Held-out reconstruction Official leaderboard
432 RESMPDEV/Qwen1.5-Wukong-0.5B 35.6 Held-out reconstruction Official leaderboard
433 cognitivecomputations/TinyDolphin-2.8.1-1.1b 35.4 Held-out reconstruction Official leaderboard
434 alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2 35.1 Held-out reconstruction Official leaderboard
435 Josephgflowers/TinyLlama-Cinder-Agent-Rag 34.9 Held-out reconstruction Official leaderboard
436 Josephgflowers/TinyLlama-Cinder-1.3B-Test.2 34.8 Held-out reconstruction Official leaderboard
437 ppopiolek/tinyllama_eng_short 34.8 Held-out reconstruction Official leaderboard
438 kevin009/babyllama-v0.6 34.6 Held-out reconstruction Official leaderboard
439 l3utterfly/tinyllama-1.1b-layla-v4 34.5 Held-out reconstruction Official leaderboard
440 vihangd/shearedplats-1.3b-v1 34.2 Held-out reconstruction Official leaderboard
441 ewqr2130/TinyLamma-SFT 34.1 Held-out reconstruction Official leaderboard
442 abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft 34.1 Held-out reconstruction Official leaderboard
443 KnutJaegersberg/platypus-1_8b 34.0 Held-out reconstruction Official leaderboard
444 KnutJaegersberg/falcon-1b-t-sft 34.0 Held-out reconstruction Official leaderboard
445 HuggingFaceTB/cosmo-1b 33.9 Held-out reconstruction Official leaderboard
446 ToastyPigeon/SmolPlatypus-1.5B-Sorted 33.8 Held-out reconstruction Official leaderboard
447 nnpy/Nape-0 33.7 Held-out reconstruction Official leaderboard
448 Ramikan-BR/tinyllama-coder-py-4bit-v10 33.3 Held-out reconstruction Official leaderboard
449 jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha 33.1 Held-out reconstruction Official leaderboard
450 Abhaykoul/OEvortex 32.7 Held-out reconstruction Official leaderboard
451 Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1 32.4 Held-out reconstruction Official leaderboard
452 Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG 31.9 Held-out reconstruction Official leaderboard
453 gpt2-xl 30.8 Held-out reconstruction Official leaderboard
454 raincandy-u/Quark-464M-v0.2 30.4 Held-out reconstruction Official leaderboard
455 gemmathon/gemma-2b-ko-v0 28.7 Held-out reconstruction Official leaderboard
456 deepseek-ai/deepseek-coder-1.3b-instruct 28.6 Held-out reconstruction Official leaderboard
457 Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF 28.5 Held-out reconstruction Official leaderboard
458 Sharathhebbar24/Instruct_GPT_v1 27.9 Held-out reconstruction Official leaderboard
459 Isotonic/smol_llama-4x220M-MoE 26.5 Held-out reconstruction Official leaderboard
460 ethzanalytics/pythia-31m 26.4 Held-out reconstruction Official leaderboard
461 Sharathhebbar24/math_gpt2 26.3 Held-out reconstruction Official leaderboard
462 Felladrin/Minueza-32M-UltraChat 26.2 Held-out reconstruction Official leaderboard
463 wannaphong/numfalm-3b 25.8 Held-out reconstruction Official leaderboard
464 Facebook/OPT-125M 25.5 Held-out reconstruction Official leaderboard
#ModelScoreSettingDateSource
1 Mixtral 8x22B 76.7 Held-out reconstruction Apr 2024 Official leaderboard
2 Yi-1.5-9B-Chat 67.2 Held-out reconstruction May 2024 Official leaderboard
3 Starling-LM-7B-alpha 64.3 Held-out reconstruction Nov 2023 Official leaderboard
4 Qwen1.5-14B 63.7 Held-out reconstruction Feb 2024 Official leaderboard
5 Qwen1.5-72B 61.2 Held-out reconstruction Feb 2024 Official leaderboard

Rankings by part

We read 6 parts from the benchmark’s own leaderboard, each ranking models on one part of the test, such as ARC, GSM8K and HellaSwag. Mixtral 8x22B leads every one of them. Arrows show how far a model moved from its overall rank among the models we track.

ARC

5 models we track have a score here.

  1. 1 Mixtral 8x22B 75.2
  2. 2 Qwen1.5-72B ↑3 72.3
  3. 3 Starling-LM-7B-alpha 71.3
  4. 4 Yi-1.5-9B-Chat ↓2 60.4
  5. 5 Qwen1.5-14B ↓1 50.5

Number one over time

Lab claims count from the day the card came out, independent runs from the model’s release.

Mistral AI
Own leaderboard Not tested since Jul 2024

Source: Official metabench leaderboard

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Plot with other benchmarks
On the benchmark’s own leaderboard
60.0 65.0 70.0 75.0 80.0 2024 60.0 65.0 70.0 75.0 80.0 2024

Source: Official metabench leaderboard

No lab model card reports it yet

We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.

More in Other

All 69 in Other
  • Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Claude Fable 5.2 64.6
  • Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
  • Vals Science Index In use Agents are scored on the equal average of BioMysteryBench, MysteryMechanism and Terminal-Bench-Science. GPT-6.2 Astra 68.4%
  • Decision Index Public v0.3 In use Decision models return probabilities over labeled options in public tasks covering knowledge, language, retrieval, tools, and arts. A chance-corrected weighted aggregate combines the task scores. Granite Switch 4.1 30B 51.3
  • SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
  • MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities. Qwen3-Embedding-8B 72.2%

Data audit

8 of 9 checks pass, 1 warning. Look first at the Newest score check. The newest came 2 years ago, in May 2024, for Yi-1.5-9B-Chat. Every benchmark

Catalog record 2 pass
  • Pass Task access All tasks are public.
  • Pass Confidence Checked against a primary source.
Scores 1 warning 2 pass 2 notes
  • Pass Independent runs Scores from the official leaderboard (464 entries).
  • Pass Models scored 5 models we track, plus 459 other entries on its leaderboard.
  • Warning Newest score The newest came 2 years ago, in May 2024, for Yi-1.5-9B-Chat.
  • Note Frontier models None of the top 10 has a score. The strongest tested is Mixtral 8x22B (#189).
  • Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
  • Pass Importer We read the board on github.com: 5 rows for models we track and 459 other entries at the last read.
  • Pass Last read November 20th, 2026.
  • Pass Read worked The last read worked.
Consistency 1 pass 1 note
  • Note Lab claims No model has both a lab number and an independent run.
  • Pass Known issues No published audit found problems.

How we check