metabench
Models answer selected items from established evaluations. The benchmark uses a sparse item set to estimate reasoning and knowledge with fewer questions.
- Made by
- Alex Kipnis and colleagues
- Released
- July 2024
- Kind
- Composite indices
- Level
- University
- Scored
- Checked automatically
- Answers
- Multiple choice
- Tasks
- All public
- Measures
- Capability
- Language
- English
- Interaction
- Single turn
- Items from
- Another benchmark
- Refresh
- One fixed set
- Run by
- Anyone
- Strongest model tested
-
Mixtral 8x22B #189 on the capability index
- Last model added
- May 2024
- Scores refreshed
- November 20th, 2026
SF-Foundation/Ein-72B-v0.12 tops the leaderboard with 79.0 Mixtral 8x22B leads with 76.7 among models released by May 2024
Best score per entry from the benchmark's own leaderboard, read on November 20th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Mixtral 8x22B, at 76.7. This view shows only models we track, each at its best.
The newest model with a score here came out in May 2024, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- GPT-6.2 Astra
- Claude Fable 5.2
-
Gemini 4 Carbon
- GPT-6 Astra
- and 16 more
- 79.0 SF-Foundation/Ein-72B-v0.12
- 76.7
Mixtral 8x22B
- 76.0 MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3
- 74.5 TomGrc/FusionNet_34Bx2_MoE_v0.1
- 74.4 yam-peleg/Experiment24-7B
- 74.3 allknowingroger/Neuralmultiverse-7B-slerp
- 74.3 ammarali32/multi_verse_model
- 74.2 allknowingroger/Calmex26merge-12B-MoE
- 74.2 yam-peleg/Experiment29-7B
- 74.2 CultriX/NeuralTrix-bf16
- 74.2 eldogbbhed/NeuralBeagleJaskier
- 74.1 Gille/StrangeMerges_32-7B-slerp
- 74.1 fblgit/UNA-SimpleSmaug-34b-v1beta
- 74.1 ValiantLabs/Llama3-70B-Fireplace
- 74.1 yam-peleg/Experiment27-7B
- 74.0 mlabonne/Zebrafish-7B
- 74.0 allknowingroger/mergekit-slerp-zplzqvn
- 74.0 mayacinka/yam-jom-7B
- 74.0 MaziyarPanahi/Calme-7B-Instruct-v0.1.1
- 73.9 cloudyu/Mixtral_34Bx2_MoE_60B
- 73.9 CultriX/AlphaCeption-7B-v1
- 73.8 automerger/PasticheInex12-7B
- 73.8 ConvexAI/Luminex-34B-v0.1
- 73.8 cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B
- 73.8 shenzhi-wang/Llama3-70B-Chinese-Chat
- 73.8 arcee-ai/Clown-DPO-Extended
- 73.8 eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2
- 73.7 automerger/ShadowYamshadow-7B
- 73.7 daxiongshu/Pluto_24B_DPO_63
- 73.7 nbeerbower/slerp-bophades-truthy-math-mistral-7B
- 73.7 Kukedlc/NeuralMaxime-7B-slerp
- 73.5 rmdhirr/Multiparadigm_7B
- 73.4 yam-peleg/Experiment22-7B
- 73.3 alchemonaut/BoreanGale-70B
- 73.3 nbeerbower/Flammen-Bophades-7B
- 73.3 allknowingroger/Multimerge-Neurallaymons-12B-MoE
- 73.3 MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1
- 73.3 YKM11/Mistral-7B-adaptv1
- 73.2 saltlux/luxia-21.4b-alignment-v1.0
- 73.0 alnrg2arg/blockchainlabs_7B_merged_test2_4
- 73.0 dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach
- 73.0 Kukedlc/Neural-4-Maths-7b
- 73.0 AiMavenAi/AiMaven-Prometheus
- 72.9 leveldevai/TurdusDareBeagle-7B
- 72.8 Kukedlc/Fasciculus-Arcuatus-7B-slerp
- 72.8 FelixChao/Scorpio-7B
- 72.8 CultriX/Wernicke-7B-dpo
- 72.7 alnrg2arg/blockchainlabs_test3_seminar
- 72.7 fblgit/UNA-34BeagleSimpleMath-32K-v1
- 72.7 Weyaxi/Cosmosis-3x34B
- 72.6 kaitchup/TheMayonnaise
- 72.6 YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2
- 72.5 AbacusResearch/jaLLAbi2-7b
- 72.5 kekmodel/StopCarbon-10.7B-v5
- 72.4 leveldevai/MarcBeagle-7B
- 72.4 CultriX/Wernicke-7B-v9
- 72.4 Kquant03/Samlagast-7B-laser-bf16
- 72.2 allknowingroger/Neuralmaath-12B-MoE
- 72.2 zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0
- 72.2 mlabonne/Beagle14-7B
- 72.1 ConvexAI/BurningBruce-003
- 72.1 leveldevai/MarcDareBeagle-7B
- 71.9 dddsaty/SOLAR-Instruct-ko-Adapter-Attach
- 71.9 h2m/mhm-8x7B-FrankenMoE-v1.0
- 71.9 nbeerbower/bruphin-epsilon
- 71.9 moreh/MoMo-70B-LoRA-V1.4
- 71.8 SC56/Mistral-7B-orca-dpo-12h
- 71.7 MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1
- 71.7 DopeorNope/SOLARC-MOE-10.7Bx4
- 71.6 kekmodel/StopCarbon-10.7B-v6
- 71.6 janai-hq/trinity-v1
- 71.5 ResplendentAI/DaturaCookie_7B
- 71.5 vicgalle/NeuralBeagle-11B
- 71.4 CultriX/MergeTrix-7B-v2
- 71.4 Aryanne/Westest-7B
- 71.3 DreadPoor/SilverMaiden-7B-slerp
- 71.3 yam-peleg/Experiment7-7B
- 71.2 MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1
- 71.0 cloudyu/Mixtral_7Bx6_MoE_35B
- 70.9 SUSTech/SUS-Chat-34B
- 70.8 Gille/MoE-StrangeMerges-2x7B
- 70.8 ibndias/Nous-Hermes-2-MoE-2x34B
- 70.8 Steelskull/Umbra-v3-MoE-4x11b-2ex
- 70.8 jsfs11/SnorkelWestBeagle-DARETIES-7B
- 70.7 allknowingroger/StarlingMaths-12B-MoE
- 70.7 chujiezheng/tulu-2-dpo-70b-ExPO
- 70.7 Test157t/Prima-LelantaclesV6-7b
- 70.7 vicgalle/test-merge-3
- 70.6 JaeyeonKang/CCK_Asura_v2
- 70.6 jan-ai/Pandora-10.7B-v1
- 70.6 maywell/PiVoT-SUS-RP
- 70.6 Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B
- 70.6 NLPark/AnFeng_v3_Avocet
- 70.5 flammenai/flammen22-mistral-7B
- 70.4 nbeerbower/flammen11X-mistral-7B
- 70.4 occultml/CatMarcoro14-7B-slerp
- 70.3 Himitsui/KuroMitsu-11B
- 70.3 shadowml/Daredevil-7B
- 70.3 yunconglong/7Bx4_DPO_2e
- 70.2 Inv/Konstanta-7B
- 70.2 ParasiticRogue/Merged-RP-Stew-V2-34B
- 70.2 AA051610/A0127
- 70.2 mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp
- 69.9 brucethemoose/Yi-34B-200K-DARE-merge-v7
- 69.8 DreadPoor/Chimera-7B-slerp
- 69.7 DreadPoor/RoyalNoroichi-7B-slerp
- 69.7 JaeyeonKang/CCK_Gony_v3.1
- 69.6 Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled
- 69.6 jeiku/Cookie_7B
- 69.6 DreadPoor/RoyalMaid-7B-slerp
- 69.5 abacusai/Liberated-Qwen1.5-72B
- 69.5 Aryanne/MixSwap
- 69.4 SanjiWatsuki/Kunoichi-DPO-v2-7B
- 69.4 giraffe176/WestMaid_HermesMonarchv0.1
- 69.2 cloudyu/Pluto_24B_DPO_200
- 69.2 APMIC/caigun-lora-model-34B-v2
- 69.1 ChaoticNeutrals/This_is_fine_7B
- 69.1 saishf/Top-Western-Maid-7B
- 69.1 YeungNLP/firefly-mixtral-8x7b-v0.1
- 69.1 YeungNLP/firefly-mixtral-8x7b-v1
- 68.9 flammenai/Mahou-1.0-mistral-7B
- 68.9 nbeerbower/flammen2
- 68.8 DreadPoor/Satyr-7B-Model_Stock
- 68.7 viethq188/LeoScorpius-7B
- 68.6 EmbeddedLLM/Mistral-7B-Merge-14-v0.5
- 68.6 Locutusque/Hyperion-2.0-Yi-34B
- 68.5 Danielbrdz/Barcenas-Llama3-8b-ORPO
- 68.5 Nitral-AI/KukulStanta-7B
- 68.5 one-man-army/una-neural-chat-v3-3-P1-OMA
- 68.4 adamo1139/Yi-34B-200K-AEZAKMI-v2
- 68.4 Eric111/openchat-3.5-0106-128k-DPO
- 68.4 AIDC-ai-business/Marcoroni-7B-v2
- 68.4 brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties
- 68.3 sethuiyer/Eida_10.7B
- 68.3 APMIC/caigun-lora-model-34B-v3
- 68.1 nisten/shqiponja-15b-v1
- 68.1 Weyaxi/Seraph-openchat-3.5-1210-Slerp
- 68.0 migtissera/Tess-M-v1.3
- 68.0 nbeerbower/llama-3-stella-8B
- 68.0 Q-bert/MetaMath-Cybertron
- 67.9 PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp
- 67.9 Sao10K/Solstice-11B-v1
- 67.8 Abhinav7/NeuralPipe-7B-slerp
- 67.6 chanwit/flux-7b-v0.1
- 67.5 4season/sft_model_test1
- 67.5 Inv/MoeMoE-2x7b
- 67.4 perlthoughts/Chupacabra-8x7B-MoE
- 67.3 lex-hue/Delexa-7b
- 67.3 DreadPoor/NewtoccineLake-slerp-7B
- 67.3 DeepKarkhanis/Mistral-Passthrough-8L-10B
- 67.2 cloudyu/Mixtral_13B_Chat
- 67.2
Yi-1.5-9B-Chat
- 67.2 AA051610/FT
- 67.2 kyujinpy/PlatYi-34B-Q
- 67.0 GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3
- 67.0 MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1
- 67.0 ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2
- 67.0 migtissera/Tess-34B-v1.4
- 66.9 Artples/L-MChat-7b
- 66.9 vonjack/Phi-3-mini-4k-instruct-LLaMAfied
- 66.8 ResplendentAI/Persephone_7B
- 66.8 Azazelle/Maylin-7b
- 66.7 CallComply/openchat-3.5-0106-32k
- 66.7 openchat/openchat-3.5-0106
- 66.6 nbeerbower/llama-3-sauce-v2-8B
- 66.6 adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA
- 66.4 Salesforce/xLAM-v0.1-r
- 66.4 PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp
- 66.3 Xenon1/Eclipse-13B-dpo
- 66.2 andysalerno/openchat-nectar-0.6
- 66.2 Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp
- 66.2 argilla/DistilabelBeagle14-7B
- 66.2 lex-hue/LexGPT-V3
- 66.1 mlabonne/NeuralHermes-2.5-Mistral-7B
- 66.1 Azure99/blossom-v3_1-yi-34b
- 66.1 vicgalle/solarized-18B-dpo
- 66.0 Yuma42/KangalKhan-ShatteredRuby-7B
- 65.8 mayacinka/West-Ramen-7Bx4
- 65.8 DeepMount00/phi_3
- 65.8 saucam/aqua-smaug-0.3-8B
- 65.8 icefog72/Kunokukulemonchini-7b
- 65.7 Azazelle/Argetsu
- 65.7 NousResearch/Nous-Hermes-2-Mistral-7B-DPO
- 65.7 Isotonic/Hermes-2-Pro-Mixtral-4x7B
- 65.6 cognitivecomputations/MegaDolphin-120b
- 65.4 tenyx/TenyxChat-7B-v1
- 65.3 Gille/StrangeMerges_12-7B-slerp
- 65.3 Muhammad2003/TriMistral-7B-TIES
- 65.3 decruz07/kellemar-DPO-7B
- 65.3 fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged
- 65.1 elinas/Llama-3-15B-Instruct-zeroed-ft
- 65.1 Liangmingxin/ThetaWave-7B-sft
- 65.0 ibivibiv/aegolius-acadicus-34b-v3
- 65.0 Ba2han/Llama-Phi-3_DoRA
- 65.0 mahiatlinux/ShadowDolph-7B-v1
- 64.9 dozzke/hermorca
- 64.9 kyujinpy/PlatYi-34B-Llama-Q-v2
- 64.7 Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp
- 64.7 beowolx/CodeNinja-1.0-OpenChat-7B
- 64.7 JunchengXie/Starling-LM-7B-alpha-gpt-4-80k
- 64.6 aloobun/slerp_bun_mistral_7b_v2
- 64.6 Isaak-Carter/JOSIE_Beta-4-7B-slerp
- 64.6 mahiatlinux/MasherAI-v6.1-7B-eval-test
- 64.6 SeaLLMs/SeaLLM-7B-v2
- 64.5 jondurbin/bagel-dpo-7b-v0.4
- 64.4 nlpguy/ColorShadow-7B-v3
- 64.4 H-D-T/Buzz-8b-Large-v0.5
- 64.3 beberik/rawr
- 64.3 TomGrc/FusionNet_passthrough_v0.1
- 64.3 nlpguy/StarFusion-alpha2
- 64.3 perlthoughts/Starling-LM-alpha-8x7B-MoE
- 64.3 Undi95/Llama-3-Unholy-8B
- 64.3
Starling-LM-7B-alpha
- 64.2 ABX-AI/Quantum-Citrus-9B
- 64.2 bababababooey/mergekit-slerp-mntqhzv
- 64.1 freecs/ThetaWave-7B-v1
- 64.1 HIT-SCIR/Chinese-Mixtral-8x7B
- 64.1 ResplendentAI/Aura_L3_8B
- 64.1 Azazelle/Mocha-Sample-7b-ex
- 64.1 joowon99/SOLAR-10.7B-ko_alpaca
- 64.1 Replete-AI/Mistral-11b-v0.1
- 64.1 Replete-AI/Mistral-Evolved-11b-v0.1
- 64.0 FuseAI/FuseChat-7B-VaRM
- 64.0 abhishek/autotrain-llama3-orpo-v2
- 63.9 AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1
- 63.7
Qwen1.5-14B
- 63.6 Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B
- 63.5 rombodawg/Llama-3-8B-Instruct-Coder
- 63.3 abhishekchohan/mistral-7B-forest-merge-v0.1
- 63.3 hydra-project/OpenHyperion-2.5-Mistral-7B
- 63.3 NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS
- 63.2 cstr/phi-3-orpo-v9_16
- 63.2 TeeZee/Kyllene-v1.0
- 63.2 jeiku/Zephyr_beta_32k_7B
- 63.1 SC99/Mistral-7B-privatemix-base-ia
- 63.0 Steelskull/VerA-Etheria-55b
- 63.0 HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2
- 62.9 grimjim/zephyr-beta-wizardLM-2-merge-7B
- 62.8 ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2
- 62.8 perlthoughts/openchat-3.5-1210-32k-8x7b-MoE
- 62.7 manishiitg/open-aditi-hi-v4
- 62.7 yaojialzc/Gigi-Llama3-8B-Chinese-zh
- 62.6 ContextualAI/Contextual_KTO_Mistral_PairRM
- 62.6 LeroyDyer/Mixtral_AI_Cyber_Child
- 62.6 azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0
- 62.6 Weyaxi/Einstein-v5-v0.2-7B
- 62.4 TeeZee/DarkSapling-7B-v2.0
- 62.3 liminerity/Blured-Ties-7B
- 62.2 Joseph717171/Genstruct-10.7B
- 62.1 NeverSleep/MiquMaid-v2-70B
- 62.0 x2bee/POLAR-14B-v0.2
- 62.0 cloudyu/Mixtral_7Bx2_MoE_13B
- 61.9 DreadPoor/ToppyEvil-7B-slerp
- 61.9 netcat420/MFANN3bv0.6
- 61.8 BlueNipples/SnowLotus-v2-10.7B
- 61.8 ewqr2130/mistral-inst-ppo
- 61.7 922-CA/monika-ddlc-8b-v1
- 61.6 silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3
- 61.5 PulsarAI/Einstein-v3-7B
- 61.5 jondurbin/bagel-7b-v0.4
- 61.4 macadeliccc/gemma-orchid-7b-dpo
- 61.4 nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp
- 61.4 yanolja/KoSOLAR-10.7B-v0.2
- 61.3 lodrick-the-lafted/Hermes-Instruct-7B-100K
- 61.2 eswardivi/llamathon
- 61.2 g-ronimo/llama3-8b-SlimHermes
- 61.2
Qwen1.5-72B
- 61.1 LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0
- 61.0 uukuguy/speechless-mistral-7B-v0.2-mixed-1
- 61.0 zelus82/Obelix-Phi2-v0
- 60.8 Changgil/K2S3-Mistral-7b-v1.0
- 60.8 dfurman/Llama-3-8B-Orpo-v0.1
- 60.7 Azure99/blossom-v4-mistral-7b
- 60.6 ibm/merlinite-7b
- 60.5 Deci/DeciLM-7B-instruct
- 60.4 ozayezerceli/Threnystril-2x7B-moe
- 60.4 DUAL-GPO/zephyr-7b-gpo-update4-i0
- 60.3 tourist800/mistral_2X7b
- 60.1 itsliupeng/llama_9b_long
- 60.1 uukuguy/speechless-zephyr-code-functionary-7b
- 60.0 cloudyu/mistral_18B_instruct_v0.1
- 60.0 Artples/L-MChat-Small
- 59.7 eduagarcia/mistral-orpo-mix-7k
- 59.7 MaziyarPanahi/gemma-7b-alpaca-52k-v0.1
- 59.6 grayhacker91/gemma-7b-open-platypus-commercial
- 59.6 MaziyarPanahi/phi-2-logical-sft
- 59.6 NeuralNovel/Aeryth-7B-v0.1
- 59.5 Locutusque/Hercules-2.0-Mistral-7B
- 59.5 jefferylovely/AthenaImaniMaven
- 59.4 Alsebay/Lorge-2x7B-UAMM
- 59.4 Syed-Hasan-8503/Llama-3-8B-NOLA
- 59.4 bunnycore/Blackbird-Llama-3-8B
- 59.4 Locutusque/Hyperion-2.1-Mistral-7B
- 59.4 chlee10/T3Q-Platypus-SOLAR
- 59.3 AlanRobotics/nanobot_v1
- 59.2 abhishekchohan/mistral-7B-forest-dpo
- 59.2 airesearch/typhoon-7b-WangchanX-sft-Demo
- 59.2 Novocoders/Mistral-NeuralDPO-v0.5
- 59.0 Undi95/Meta-Llama-3-8B-hf
- 59.0 jisukim8873/mistralai-case-2-0
- 59.0 NotAiLOL/Yi-1.5-9B-coder
- 59.0 WDong/Qwen1.5-7B-sft-0502
- 59.0 andysalerno/rainbowfish-7B-v10
- 59.0 Intel/neural-chat-7b-v3-1
- 58.7 DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1
- 58.5 NeuralNovel/Senzu-7B-v0.1-DPO
- 58.5 Ichsan2895/Merak-7B-v5-PROTOTYPE1
- 58.4 chatty123/mistral_rank32_invert
- 58.3 Isaak-Carter/J.O.S.I.E.3-Beta8-slerp
- 58.3 KnutJaegersberg/Deacon-20B
- 58.3 ABX-AI/Spicy-Laymonade-7B
- 58.3 HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K
- 58.2 allknowingroger/ANIMA-biodesign-7B-slerp
- 58.1 awnr/Mistral-7B-v0.1-half-naive-A
- 58.1 openaccess-ai-collective/mistral-7b-slimorcaboros
- 58.1 JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k
- 58.0 MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1
- 58.0 vaiv/llamion-14b-base
- 58.0 WDong/Qwen1.5-7B-sft-0506_9_8
- 58.0 awnr/Mistral-7B-v0.1-signtensors-1-over-2
- 57.9 jrruethe/balthazar-2x10.7b-v1
- 57.8 jondurbin/bagel-8x7b-v0.2
- 57.7 huseyinatahaninan/phi-2-instruction
- 57.6 Mollel/Swahili_Gemma
- 57.5 Mr-Bhaskar/fbt-gemma-7b
- 57.5 NovoCode/Novocode7b-v3
- 57.4 alvarobartt/mistral-7b-orpo-capybara-reproduction
- 57.4 SuperAGI/SAM
- 57.2 maywell/Synatra-RP-Orca-2-7b-v0.1
- 57.2 ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4
- 56.8 TheBloke/orca_mini_v3_13B-GPTQ
- 56.7 xi0v/aether-7b-chat-v1.0
- 56.5 ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4
- 56.3 macadeliccc/Opus-Samantha-Llama-3-8B
- 56.3 ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1
- 56.3 maldv/dragonwar-7b-s1
- 56.3 ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4
- 56.3 DeepMount00/Mistral-RAG
- 56.2 Sao10K/L3-Solana-8B-v1
- 56.1 Langboat/Mengzi3-13B-Base
- 56.1 yam-peleg/Hebrew-Mistral-7B
- 56.1 HuggingFaceH4/mistral-7b-grok
- 55.9 failspy/Llama-3-8B-Instruct-abliterated
- 55.9 CreitinGameplays/ConvAI-9b
- 55.9 BlueNipples/TimeCrystal-l2-13B
- 55.6 NLUHOPOE/test-case-5
- 55.6 Norquinal/Mistral-7B-claude-instruct
- 55.5 TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k
- 55.5 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta
- 55.5 freeCS-dot-org/Zero-7B-test-3
- 55.2 NeverSleep/Noromaid-13b-v0.3
- 54.9 kyujinpy/SOLAR-Platypus-10.7B-v1
- 54.6 XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k
- 54.5 CohereForAI/aya-23-8B
- 54.5 vaiv/llamion-14b-chat
- 54.4 vicgalleorg/TruthfulQwen1.5-4B
- 54.3 arlineka/Brunhilde-13b-v1
- 54.3 ZoidBB/unraveled-7b-a1
- 54.2 Undi95/PsyMedRP-v1-20B
- 54.2 BFauber/lora_llama2-13b_10e5_r8_a16
- 53.9 jefferylovely/AiMaven-Orca2
- 53.9 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta
- 53.4 pleisto/yuren-13b-chatml
- 53.2 Technoculture/Medorca-2x7b
- 53.0 TwT-6/open_llm_leaderboard_demo2
- 52.9 bn22/DolphinMini-Mistral-7B
- 52.8 KatyTheCutie/EstopianMaid-13B
- 52.6 namirocks/tutor-model-13b-ep3
- 52.6 CausalLM/7B-DPO-alpha
- 52.6 royallab/PsyOrca2-13b-DARE
- 52.3 ajibawa-2023/SlimOrca-Llama-3-8B
- 52.2 Locutusque/Orca-2-13b-SFT-v6
- 52.0 llm-agents/tora-13b-v1.0
- 51.9 mayacinka/Open-StaMis-v02-stock
- 51.8 Kquant03/Medusa-7B-bf16
- 51.6 euclaise/Ferret_7B
- 51.4 KnutJaegersberg/webMistral-7B
- 51.4 NLUHOPOE/Mistral-7B-random-100000
- 51.4 ajibawa-2023/Python-Code-13B
- 51.3 hywu/Camelidae-8x7B
- 51.3 abacusai/Giraffe-beta-13b-32k
- 51.1 gmonsoon/MaxiCPM-3x3B-Test
- 50.9 TheBloke/orca_mini_v3_7B-GPTQ
- 50.8 Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct
- 50.4 gmonsoon/MiniCPM-2B-Base
- 50.4 Charlie911/vicuna-7b-v1.5-lora-mmlu-merged
- 50.0 pansophic/new_model_test
- 50.0 vikash06/doctorLLM
- 49.8 DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567
- 49.4 XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k
- 49.0 ewqr2130/llama_ppo_1e6step_4000
- 48.8 ericpolewski/AIRIC-The-Intern
- 48.6 Charlie911/vicuna-7b-v1.5-general-temporal-merged
- 47.9 Charlie911/zephyr-7b-beta-lora-mmlu-merged
- 47.8 abdulrahman-nuzha/finetuned-llama-v2.0
- 47.7 GeneZC/MiniChat-2-3B
- 47.6 ValiantLabs/Fireplace-13b
- 47.3 abhishek/autotrain-8kfjk-b3gva
- 46.8 rishiraj/smol-3b
- 46.6 tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora
- 46.6 TeeZee/Buttocks-7B-v1.0
- 46.0 ibivibiv/multimaster-7b
- 45.8 DeepMount00/Phi-3-Large-5.6b
- 44.7 qnguyen3/quan-1.8b-chat
- 44.4 Ritvik19/zephyr-2b-gemma-sft-qlora
- 44.3 langgptai/Qwen-sft-ls-v0.1
- 43.8 stabilityai/stablelm-2-1_6b
- 43.8 langgptai/Qwen-sft-la-v0.1
- 43.6 itsliupeng/openllama-7b-base
- 43.3 abhinand/tamil-llama-7b-instruct-v0.1
- 43.1 jisukim8873/falcon-7B-case-5
- 42.9 kalisai/Nusantara-4b-Indo-Chat
- 42.9 raincandy-u/Coder1.8-ORPO-TEST
- 42.1 pmking27/PrathameshLLM-2B
- 42.1 Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0
- 41.0 Zangs3011/falcon_7b_DolphinCoder
- 40.9 sartifyllc/dociproLLM-7B
- 40.6 Qwen/Qwen1.5-1.8B-Chat
- 40.6 vihangd/dopeyshearedplats-2.7b-v1
- 40.5 csujeong/Falcon-7B-Fintued-Finance-Stock-E
- 39.8 mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1
- 39.7 cyberagent/calm2-7b-chat
- 39.1 Heng666/EastAsia-4x7B-Moe-experiment
- 39.1 aloobun/open-llama-3b-v2-elmv3
- 39.1 M4-ai/NeuralReyna-Mini-1.8B-v0.3
- 38.8 Pierre-obi/Mistral_solar-slerp
- 38.4 xaviviro/FLAMA-0.5-3B
- 37.7 mwitiderrick/open_llama_3b_glaive_assistant_v0.1
- 37.7 deepseek-ai/deepseek-coder-6.7b-base
- 36.3 raidhon/coven_tiny_1.1b_32k_orpo_alpha
- 36.0 ddyuudd/merge_dolly-v2-3b_dpo_test
- 35.6 RESMPDEV/Qwen1.5-Wukong-0.5B
- 35.4 cognitivecomputations/TinyDolphin-2.8.1-1.1b
- 35.1 alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2
- 34.9 Josephgflowers/TinyLlama-Cinder-Agent-Rag
- 34.8 Josephgflowers/TinyLlama-Cinder-1.3B-Test.2
- 34.8 ppopiolek/tinyllama_eng_short
- 34.6 kevin009/babyllama-v0.6
- 34.5 l3utterfly/tinyllama-1.1b-layla-v4
- 34.2 vihangd/shearedplats-1.3b-v1
- 34.1 ewqr2130/TinyLamma-SFT
- 34.1 abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft
- 34.0 KnutJaegersberg/platypus-1_8b
- 34.0 KnutJaegersberg/falcon-1b-t-sft
- 33.9 HuggingFaceTB/cosmo-1b
- 33.8 ToastyPigeon/SmolPlatypus-1.5B-Sorted
- 33.7 nnpy/Nape-0
- 33.3 Ramikan-BR/tinyllama-coder-py-4bit-v10
- 33.1 jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha
- 32.7 Abhaykoul/OEvortex
- 32.4 Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1
- 31.9 Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG
- 30.8 gpt2-xl
- 30.4 raincandy-u/Quark-464M-v0.2
- 28.7 gemmathon/gemma-2b-ko-v0
- 28.6 deepseek-ai/deepseek-coder-1.3b-instruct
- 28.5 Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF
- 27.9 Sharathhebbar24/Instruct_GPT_v1
- 26.5 Isotonic/smol_llama-4x220M-MoE
- 26.4 ethzanalytics/pythia-31m
- 26.3 Sharathhebbar24/math_gpt2
- 26.2 Felladrin/Minueza-32M-UltraChat
- 25.8 wannaphong/numfalm-3b
- 25.5 Facebook/OPT-125M
- 1 SF-Foundation/Ein-72B-v0.12 Held-out reconstruction 79.0
- 2
Mixtral 8x22B Held-out reconstruction 76.7
- 3 MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3 Held-out reconstruction 76.0
- 4 TomGrc/FusionNet_34Bx2_MoE_v0.1 Held-out reconstruction 74.5
- 5 yam-peleg/Experiment24-7B Held-out reconstruction 74.4
- 6 allknowingroger/Neuralmultiverse-7B-slerp Held-out reconstruction 74.3
- 7 ammarali32/multi_verse_model Held-out reconstruction 74.3
- 8 allknowingroger/Calmex26merge-12B-MoE Held-out reconstruction 74.2
- 9 yam-peleg/Experiment29-7B Held-out reconstruction 74.2
- 10 CultriX/NeuralTrix-bf16 Held-out reconstruction 74.2
- 11 eldogbbhed/NeuralBeagleJaskier Held-out reconstruction 74.2
- 12 Gille/StrangeMerges_32-7B-slerp Held-out reconstruction 74.1
- 13 fblgit/UNA-SimpleSmaug-34b-v1beta Held-out reconstruction 74.1
- 14 ValiantLabs/Llama3-70B-Fireplace Held-out reconstruction 74.1
- 15 yam-peleg/Experiment27-7B Held-out reconstruction 74.1
- 16 mlabonne/Zebrafish-7B Held-out reconstruction 74.0
- 17 allknowingroger/mergekit-slerp-zplzqvn Held-out reconstruction 74.0
- 18 mayacinka/yam-jom-7B Held-out reconstruction 74.0
- 19 MaziyarPanahi/Calme-7B-Instruct-v0.1.1 Held-out reconstruction 74.0
- 20 cloudyu/Mixtral_34Bx2_MoE_60B Held-out reconstruction 73.9
- 21 CultriX/AlphaCeption-7B-v1 Held-out reconstruction 73.9
- 22 automerger/PasticheInex12-7B Held-out reconstruction 73.8
- 23 ConvexAI/Luminex-34B-v0.1 Held-out reconstruction 73.8
- 24 cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B Held-out reconstruction 73.8
- 25 shenzhi-wang/Llama3-70B-Chinese-Chat Held-out reconstruction 73.8
- 26 arcee-ai/Clown-DPO-Extended Held-out reconstruction 73.8
- 27 eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2 Held-out reconstruction 73.8
- 28 automerger/ShadowYamshadow-7B Held-out reconstruction 73.7
- 29 daxiongshu/Pluto_24B_DPO_63 Held-out reconstruction 73.7
- 30 nbeerbower/slerp-bophades-truthy-math-mistral-7B Held-out reconstruction 73.7
- 31 Kukedlc/NeuralMaxime-7B-slerp Held-out reconstruction 73.7
- 32 rmdhirr/Multiparadigm_7B Held-out reconstruction 73.5
- 33 yam-peleg/Experiment22-7B Held-out reconstruction 73.4
- 34 alchemonaut/BoreanGale-70B Held-out reconstruction 73.3
- 35 nbeerbower/Flammen-Bophades-7B Held-out reconstruction 73.3
- 36 allknowingroger/Multimerge-Neurallaymons-12B-MoE Held-out reconstruction 73.3
- 37 MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1 Held-out reconstruction 73.3
- 38 YKM11/Mistral-7B-adaptv1 Held-out reconstruction 73.3
- 39 saltlux/luxia-21.4b-alignment-v1.0 Held-out reconstruction 73.2
- 40 alnrg2arg/blockchainlabs_7B_merged_test2_4 Held-out reconstruction 73.0
- 41 dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach Held-out reconstruction 73.0
- 42 Kukedlc/Neural-4-Maths-7b Held-out reconstruction 73.0
- 43 AiMavenAi/AiMaven-Prometheus Held-out reconstruction 73.0
- 44 leveldevai/TurdusDareBeagle-7B Held-out reconstruction 72.9
- 45 Kukedlc/Fasciculus-Arcuatus-7B-slerp Held-out reconstruction 72.8
- 46 FelixChao/Scorpio-7B Held-out reconstruction 72.8
- 47 CultriX/Wernicke-7B-dpo Held-out reconstruction 72.8
- 48 alnrg2arg/blockchainlabs_test3_seminar Held-out reconstruction 72.7
- 49 fblgit/UNA-34BeagleSimpleMath-32K-v1 Held-out reconstruction 72.7
- 50 Weyaxi/Cosmosis-3x34B Held-out reconstruction 72.7
- 51 kaitchup/TheMayonnaise Held-out reconstruction 72.6
- 52 YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2 Held-out reconstruction 72.6
- 53 AbacusResearch/jaLLAbi2-7b Held-out reconstruction 72.5
- 54 kekmodel/StopCarbon-10.7B-v5 Held-out reconstruction 72.5
- 55 leveldevai/MarcBeagle-7B Held-out reconstruction 72.4
- 56 CultriX/Wernicke-7B-v9 Held-out reconstruction 72.4
- 57 Kquant03/Samlagast-7B-laser-bf16 Held-out reconstruction 72.4
- 58 allknowingroger/Neuralmaath-12B-MoE Held-out reconstruction 72.2
- 59 zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0 Held-out reconstruction 72.2
- 60 mlabonne/Beagle14-7B Held-out reconstruction 72.2
- 61 ConvexAI/BurningBruce-003 Held-out reconstruction 72.1
- 62 leveldevai/MarcDareBeagle-7B Held-out reconstruction 72.1
- 63 dddsaty/SOLAR-Instruct-ko-Adapter-Attach Held-out reconstruction 71.9
- 64 h2m/mhm-8x7B-FrankenMoE-v1.0 Held-out reconstruction 71.9
- 65 nbeerbower/bruphin-epsilon Held-out reconstruction 71.9
- 66 moreh/MoMo-70B-LoRA-V1.4 Held-out reconstruction 71.9
- 67 SC56/Mistral-7B-orca-dpo-12h Held-out reconstruction 71.8
- 68 MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1 Held-out reconstruction 71.7
- 69 DopeorNope/SOLARC-MOE-10.7Bx4 Held-out reconstruction 71.7
- 70 kekmodel/StopCarbon-10.7B-v6 Held-out reconstruction 71.6
- 71 janai-hq/trinity-v1 Held-out reconstruction 71.6
- 72 ResplendentAI/DaturaCookie_7B Held-out reconstruction 71.5
- 73 vicgalle/NeuralBeagle-11B Held-out reconstruction 71.5
- 74 CultriX/MergeTrix-7B-v2 Held-out reconstruction 71.4
- 75 Aryanne/Westest-7B Held-out reconstruction 71.4
- 76 DreadPoor/SilverMaiden-7B-slerp Held-out reconstruction 71.3
- 77 yam-peleg/Experiment7-7B Held-out reconstruction 71.3
- 78 MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1 Held-out reconstruction 71.2
- 79 cloudyu/Mixtral_7Bx6_MoE_35B Held-out reconstruction 71.0
- 80 SUSTech/SUS-Chat-34B Held-out reconstruction 70.9
- 81 Gille/MoE-StrangeMerges-2x7B Held-out reconstruction 70.8
- 82 ibndias/Nous-Hermes-2-MoE-2x34B Held-out reconstruction 70.8
- 83 Steelskull/Umbra-v3-MoE-4x11b-2ex Held-out reconstruction 70.8
- 84 jsfs11/SnorkelWestBeagle-DARETIES-7B Held-out reconstruction 70.8
- 85 allknowingroger/StarlingMaths-12B-MoE Held-out reconstruction 70.7
- 86 chujiezheng/tulu-2-dpo-70b-ExPO Held-out reconstruction 70.7
- 87 Test157t/Prima-LelantaclesV6-7b Held-out reconstruction 70.7
- 88 vicgalle/test-merge-3 Held-out reconstruction 70.7
- 89 JaeyeonKang/CCK_Asura_v2 Held-out reconstruction 70.6
- 90 jan-ai/Pandora-10.7B-v1 Held-out reconstruction 70.6
- 91 maywell/PiVoT-SUS-RP Held-out reconstruction 70.6
- 92 Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B Held-out reconstruction 70.6
- 93 NLPark/AnFeng_v3_Avocet Held-out reconstruction 70.6
- 94 flammenai/flammen22-mistral-7B Held-out reconstruction 70.5
- 95 nbeerbower/flammen11X-mistral-7B Held-out reconstruction 70.4
- 96 occultml/CatMarcoro14-7B-slerp Held-out reconstruction 70.4
- 97 Himitsui/KuroMitsu-11B Held-out reconstruction 70.3
- 98 shadowml/Daredevil-7B Held-out reconstruction 70.3
- 99 yunconglong/7Bx4_DPO_2e Held-out reconstruction 70.3
- 100 Inv/Konstanta-7B Held-out reconstruction 70.2
- 101 ParasiticRogue/Merged-RP-Stew-V2-34B Held-out reconstruction 70.2
- 102 AA051610/A0127 Held-out reconstruction 70.2
- 103 mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp Held-out reconstruction 70.2
- 104 brucethemoose/Yi-34B-200K-DARE-merge-v7 Held-out reconstruction 69.9
- 105 DreadPoor/Chimera-7B-slerp Held-out reconstruction 69.8
- 106 DreadPoor/RoyalNoroichi-7B-slerp Held-out reconstruction 69.7
- 107 JaeyeonKang/CCK_Gony_v3.1 Held-out reconstruction 69.7
- 108 Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled Held-out reconstruction 69.6
- 109 jeiku/Cookie_7B Held-out reconstruction 69.6
- 110 DreadPoor/RoyalMaid-7B-slerp Held-out reconstruction 69.6
- 111 abacusai/Liberated-Qwen1.5-72B Held-out reconstruction 69.5
- 112 Aryanne/MixSwap Held-out reconstruction 69.5
- 113 SanjiWatsuki/Kunoichi-DPO-v2-7B Held-out reconstruction 69.4
- 114 giraffe176/WestMaid_HermesMonarchv0.1 Held-out reconstruction 69.4
- 115 cloudyu/Pluto_24B_DPO_200 Held-out reconstruction 69.2
- 116 APMIC/caigun-lora-model-34B-v2 Held-out reconstruction 69.2
- 117 ChaoticNeutrals/This_is_fine_7B Held-out reconstruction 69.1
- 118 saishf/Top-Western-Maid-7B Held-out reconstruction 69.1
- 119 YeungNLP/firefly-mixtral-8x7b-v0.1 Held-out reconstruction 69.1
- 120 YeungNLP/firefly-mixtral-8x7b-v1 Held-out reconstruction 69.1
- 121 flammenai/Mahou-1.0-mistral-7B Held-out reconstruction 68.9
- 122 nbeerbower/flammen2 Held-out reconstruction 68.9
- 123 DreadPoor/Satyr-7B-Model_Stock Held-out reconstruction 68.8
- 124 viethq188/LeoScorpius-7B Held-out reconstruction 68.7
- 125 EmbeddedLLM/Mistral-7B-Merge-14-v0.5 Held-out reconstruction 68.6
- 126 Locutusque/Hyperion-2.0-Yi-34B Held-out reconstruction 68.6
- 127 Danielbrdz/Barcenas-Llama3-8b-ORPO Held-out reconstruction 68.5
- 128 Nitral-AI/KukulStanta-7B Held-out reconstruction 68.5
- 129 one-man-army/una-neural-chat-v3-3-P1-OMA Held-out reconstruction 68.5
- 130 adamo1139/Yi-34B-200K-AEZAKMI-v2 Held-out reconstruction 68.4
- 131 Eric111/openchat-3.5-0106-128k-DPO Held-out reconstruction 68.4
- 132 AIDC-ai-business/Marcoroni-7B-v2 Held-out reconstruction 68.4
- 133 brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties Held-out reconstruction 68.4
- 134 sethuiyer/Eida_10.7B Held-out reconstruction 68.3
- 135 APMIC/caigun-lora-model-34B-v3 Held-out reconstruction 68.3
- 136 nisten/shqiponja-15b-v1 Held-out reconstruction 68.1
- 137 Weyaxi/Seraph-openchat-3.5-1210-Slerp Held-out reconstruction 68.1
- 138 migtissera/Tess-M-v1.3 Held-out reconstruction 68.0
- 139 nbeerbower/llama-3-stella-8B Held-out reconstruction 68.0
- 140 Q-bert/MetaMath-Cybertron Held-out reconstruction 68.0
- 141 PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp Held-out reconstruction 67.9
- 142 Sao10K/Solstice-11B-v1 Held-out reconstruction 67.9
- 143 Abhinav7/NeuralPipe-7B-slerp Held-out reconstruction 67.8
- 144 chanwit/flux-7b-v0.1 Held-out reconstruction 67.6
- 145 4season/sft_model_test1 Held-out reconstruction 67.5
- 146 Inv/MoeMoE-2x7b Held-out reconstruction 67.5
- 147 perlthoughts/Chupacabra-8x7B-MoE Held-out reconstruction 67.4
- 148 lex-hue/Delexa-7b Held-out reconstruction 67.3
- 149 DreadPoor/NewtoccineLake-slerp-7B Held-out reconstruction 67.3
- 150 DeepKarkhanis/Mistral-Passthrough-8L-10B Held-out reconstruction 67.3
- 151 cloudyu/Mixtral_13B_Chat Held-out reconstruction 67.2
- 152
Yi-1.5-9B-Chat Held-out reconstruction 67.2
- 153 AA051610/FT Held-out reconstruction 67.2
- 154 kyujinpy/PlatYi-34B-Q Held-out reconstruction 67.2
- 155 GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3 Held-out reconstruction 67.0
- 156 MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1 Held-out reconstruction 67.0
- 157 ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2 Held-out reconstruction 67.0
- 158 migtissera/Tess-34B-v1.4 Held-out reconstruction 67.0
- 159 Artples/L-MChat-7b Held-out reconstruction 66.9
- 160 vonjack/Phi-3-mini-4k-instruct-LLaMAfied Held-out reconstruction 66.9
- 161 ResplendentAI/Persephone_7B Held-out reconstruction 66.8
- 162 Azazelle/Maylin-7b Held-out reconstruction 66.8
- 163 CallComply/openchat-3.5-0106-32k Held-out reconstruction 66.7
- 164 openchat/openchat-3.5-0106 Held-out reconstruction 66.7
- 165 nbeerbower/llama-3-sauce-v2-8B Held-out reconstruction 66.6
- 166 adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA Held-out reconstruction 66.6
- 167 Salesforce/xLAM-v0.1-r Held-out reconstruction 66.4
- 168 PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp Held-out reconstruction 66.4
- 169 Xenon1/Eclipse-13B-dpo Held-out reconstruction 66.3
- 170 andysalerno/openchat-nectar-0.6 Held-out reconstruction 66.2
- 171 Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp Held-out reconstruction 66.2
- 172 argilla/DistilabelBeagle14-7B Held-out reconstruction 66.2
- 173 lex-hue/LexGPT-V3 Held-out reconstruction 66.2
- 174 mlabonne/NeuralHermes-2.5-Mistral-7B Held-out reconstruction 66.1
- 175 Azure99/blossom-v3_1-yi-34b Held-out reconstruction 66.1
- 176 vicgalle/solarized-18B-dpo Held-out reconstruction 66.1
- 177 Yuma42/KangalKhan-ShatteredRuby-7B Held-out reconstruction 66.0
- 178 mayacinka/West-Ramen-7Bx4 Held-out reconstruction 65.8
- 179 DeepMount00/phi_3 Held-out reconstruction 65.8
- 180 saucam/aqua-smaug-0.3-8B Held-out reconstruction 65.8
- 181 icefog72/Kunokukulemonchini-7b Held-out reconstruction 65.8
- 182 Azazelle/Argetsu Held-out reconstruction 65.7
- 183 NousResearch/Nous-Hermes-2-Mistral-7B-DPO Held-out reconstruction 65.7
- 184 Isotonic/Hermes-2-Pro-Mixtral-4x7B Held-out reconstruction 65.7
- 185 cognitivecomputations/MegaDolphin-120b Held-out reconstruction 65.6
- 186 tenyx/TenyxChat-7B-v1 Held-out reconstruction 65.4
- 187 Gille/StrangeMerges_12-7B-slerp Held-out reconstruction 65.3
- 188 Muhammad2003/TriMistral-7B-TIES Held-out reconstruction 65.3
- 189 decruz07/kellemar-DPO-7B Held-out reconstruction 65.3
- 190 fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged Held-out reconstruction 65.3
- 191 elinas/Llama-3-15B-Instruct-zeroed-ft Held-out reconstruction 65.1
- 192 Liangmingxin/ThetaWave-7B-sft Held-out reconstruction 65.1
- 193 ibivibiv/aegolius-acadicus-34b-v3 Held-out reconstruction 65.0
- 194 Ba2han/Llama-Phi-3_DoRA Held-out reconstruction 65.0
- 195 mahiatlinux/ShadowDolph-7B-v1 Held-out reconstruction 65.0
- 196 dozzke/hermorca Held-out reconstruction 64.9
- 197 kyujinpy/PlatYi-34B-Llama-Q-v2 Held-out reconstruction 64.9
- 198 Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp Held-out reconstruction 64.7
- 199 beowolx/CodeNinja-1.0-OpenChat-7B Held-out reconstruction 64.7
- 200 JunchengXie/Starling-LM-7B-alpha-gpt-4-80k Held-out reconstruction 64.7
- 201 aloobun/slerp_bun_mistral_7b_v2 Held-out reconstruction 64.6
- 202 Isaak-Carter/JOSIE_Beta-4-7B-slerp Held-out reconstruction 64.6
- 203 mahiatlinux/MasherAI-v6.1-7B-eval-test Held-out reconstruction 64.6
- 204 SeaLLMs/SeaLLM-7B-v2 Held-out reconstruction 64.6
- 205 jondurbin/bagel-dpo-7b-v0.4 Held-out reconstruction 64.5
- 206 nlpguy/ColorShadow-7B-v3 Held-out reconstruction 64.4
- 207 H-D-T/Buzz-8b-Large-v0.5 Held-out reconstruction 64.4
- 208 beberik/rawr Held-out reconstruction 64.3
- 209 TomGrc/FusionNet_passthrough_v0.1 Held-out reconstruction 64.3
- 210 nlpguy/StarFusion-alpha2 Held-out reconstruction 64.3
- 211 perlthoughts/Starling-LM-alpha-8x7B-MoE Held-out reconstruction 64.3
- 212 Undi95/Llama-3-Unholy-8B Held-out reconstruction 64.3
- 213
Starling-LM-7B-alpha Held-out reconstruction 64.3
- 214 ABX-AI/Quantum-Citrus-9B Held-out reconstruction 64.2
- 215 bababababooey/mergekit-slerp-mntqhzv Held-out reconstruction 64.2
- 216 freecs/ThetaWave-7B-v1 Held-out reconstruction 64.1
- 217 HIT-SCIR/Chinese-Mixtral-8x7B Held-out reconstruction 64.1
- 218 ResplendentAI/Aura_L3_8B Held-out reconstruction 64.1
- 219 Azazelle/Mocha-Sample-7b-ex Held-out reconstruction 64.1
- 220 joowon99/SOLAR-10.7B-ko_alpaca Held-out reconstruction 64.1
- 221 Replete-AI/Mistral-11b-v0.1 Held-out reconstruction 64.1
- 222 Replete-AI/Mistral-Evolved-11b-v0.1 Held-out reconstruction 64.1
- 223 FuseAI/FuseChat-7B-VaRM Held-out reconstruction 64.0
- 224 abhishek/autotrain-llama3-orpo-v2 Held-out reconstruction 64.0
- 225 AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1 Held-out reconstruction 63.9
- 226
Qwen1.5-14B Held-out reconstruction 63.7
- 227 Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B Held-out reconstruction 63.6
- 228 rombodawg/Llama-3-8B-Instruct-Coder Held-out reconstruction 63.5
- 229 abhishekchohan/mistral-7B-forest-merge-v0.1 Held-out reconstruction 63.3
- 230 hydra-project/OpenHyperion-2.5-Mistral-7B Held-out reconstruction 63.3
- 231 NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS Held-out reconstruction 63.3
- 232 cstr/phi-3-orpo-v9_16 Held-out reconstruction 63.2
- 233 TeeZee/Kyllene-v1.0 Held-out reconstruction 63.2
- 234 jeiku/Zephyr_beta_32k_7B Held-out reconstruction 63.2
- 235 SC99/Mistral-7B-privatemix-base-ia Held-out reconstruction 63.1
- 236 Steelskull/VerA-Etheria-55b Held-out reconstruction 63.0
- 237 HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2 Held-out reconstruction 63.0
- 238 grimjim/zephyr-beta-wizardLM-2-merge-7B Held-out reconstruction 62.9
- 239 ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2 Held-out reconstruction 62.8
- 240 perlthoughts/openchat-3.5-1210-32k-8x7b-MoE Held-out reconstruction 62.8
- 241 manishiitg/open-aditi-hi-v4 Held-out reconstruction 62.7
- 242 yaojialzc/Gigi-Llama3-8B-Chinese-zh Held-out reconstruction 62.7
- 243 ContextualAI/Contextual_KTO_Mistral_PairRM Held-out reconstruction 62.6
- 244 LeroyDyer/Mixtral_AI_Cyber_Child Held-out reconstruction 62.6
- 245 azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0 Held-out reconstruction 62.6
- 246 Weyaxi/Einstein-v5-v0.2-7B Held-out reconstruction 62.6
- 247 TeeZee/DarkSapling-7B-v2.0 Held-out reconstruction 62.4
- 248 liminerity/Blured-Ties-7B Held-out reconstruction 62.3
- 249 Joseph717171/Genstruct-10.7B Held-out reconstruction 62.2
- 250 NeverSleep/MiquMaid-v2-70B Held-out reconstruction 62.1
- 251 x2bee/POLAR-14B-v0.2 Held-out reconstruction 62.0
- 252 cloudyu/Mixtral_7Bx2_MoE_13B Held-out reconstruction 62.0
- 253 DreadPoor/ToppyEvil-7B-slerp Held-out reconstruction 61.9
- 254 netcat420/MFANN3bv0.6 Held-out reconstruction 61.9
- 255 BlueNipples/SnowLotus-v2-10.7B Held-out reconstruction 61.8
- 256 ewqr2130/mistral-inst-ppo Held-out reconstruction 61.8
- 257 922-CA/monika-ddlc-8b-v1 Held-out reconstruction 61.7
- 258 silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3 Held-out reconstruction 61.6
- 259 PulsarAI/Einstein-v3-7B Held-out reconstruction 61.5
- 260 jondurbin/bagel-7b-v0.4 Held-out reconstruction 61.5
- 261 macadeliccc/gemma-orchid-7b-dpo Held-out reconstruction 61.4
- 262 nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp Held-out reconstruction 61.4
- 263 yanolja/KoSOLAR-10.7B-v0.2 Held-out reconstruction 61.4
- 264 lodrick-the-lafted/Hermes-Instruct-7B-100K Held-out reconstruction 61.3
- 265 eswardivi/llamathon Held-out reconstruction 61.2
- 266 g-ronimo/llama3-8b-SlimHermes Held-out reconstruction 61.2
- 267
Qwen1.5-72B Held-out reconstruction 61.2
- 268 LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0 Held-out reconstruction 61.1
- 269 uukuguy/speechless-mistral-7B-v0.2-mixed-1 Held-out reconstruction 61.0
- 270 zelus82/Obelix-Phi2-v0 Held-out reconstruction 61.0
- 271 Changgil/K2S3-Mistral-7b-v1.0 Held-out reconstruction 60.8
- 272 dfurman/Llama-3-8B-Orpo-v0.1 Held-out reconstruction 60.8
- 273 Azure99/blossom-v4-mistral-7b Held-out reconstruction 60.7
- 274 ibm/merlinite-7b Held-out reconstruction 60.6
- 275 Deci/DeciLM-7B-instruct Held-out reconstruction 60.5
- 276 ozayezerceli/Threnystril-2x7B-moe Held-out reconstruction 60.4
- 277 DUAL-GPO/zephyr-7b-gpo-update4-i0 Held-out reconstruction 60.4
- 278 tourist800/mistral_2X7b Held-out reconstruction 60.3
- 279 itsliupeng/llama_9b_long Held-out reconstruction 60.1
- 280 uukuguy/speechless-zephyr-code-functionary-7b Held-out reconstruction 60.1
- 281 cloudyu/mistral_18B_instruct_v0.1 Held-out reconstruction 60.0
- 282 Artples/L-MChat-Small Held-out reconstruction 60.0
- 283 eduagarcia/mistral-orpo-mix-7k Held-out reconstruction 59.7
- 284 MaziyarPanahi/gemma-7b-alpaca-52k-v0.1 Held-out reconstruction 59.7
- 285 grayhacker91/gemma-7b-open-platypus-commercial Held-out reconstruction 59.6
- 286 MaziyarPanahi/phi-2-logical-sft Held-out reconstruction 59.6
- 287 NeuralNovel/Aeryth-7B-v0.1 Held-out reconstruction 59.6
- 288 Locutusque/Hercules-2.0-Mistral-7B Held-out reconstruction 59.5
- 289 jefferylovely/AthenaImaniMaven Held-out reconstruction 59.5
- 290 Alsebay/Lorge-2x7B-UAMM Held-out reconstruction 59.4
- 291 Syed-Hasan-8503/Llama-3-8B-NOLA Held-out reconstruction 59.4
- 292 bunnycore/Blackbird-Llama-3-8B Held-out reconstruction 59.4
- 293 Locutusque/Hyperion-2.1-Mistral-7B Held-out reconstruction 59.4
- 294 chlee10/T3Q-Platypus-SOLAR Held-out reconstruction 59.4
- 295 AlanRobotics/nanobot_v1 Held-out reconstruction 59.3
- 296 abhishekchohan/mistral-7B-forest-dpo Held-out reconstruction 59.2
- 297 airesearch/typhoon-7b-WangchanX-sft-Demo Held-out reconstruction 59.2
- 298 Novocoders/Mistral-NeuralDPO-v0.5 Held-out reconstruction 59.2
- 299 Undi95/Meta-Llama-3-8B-hf Held-out reconstruction 59.0
- 300 jisukim8873/mistralai-case-2-0 Held-out reconstruction 59.0
- 301 NotAiLOL/Yi-1.5-9B-coder Held-out reconstruction 59.0
- 302 WDong/Qwen1.5-7B-sft-0502 Held-out reconstruction 59.0
- 303 andysalerno/rainbowfish-7B-v10 Held-out reconstruction 59.0
- 304 Intel/neural-chat-7b-v3-1 Held-out reconstruction 59.0
- 305 DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1 Held-out reconstruction 58.7
- 306 NeuralNovel/Senzu-7B-v0.1-DPO Held-out reconstruction 58.5
- 307 Ichsan2895/Merak-7B-v5-PROTOTYPE1 Held-out reconstruction 58.5
- 308 chatty123/mistral_rank32_invert Held-out reconstruction 58.4
- 309 Isaak-Carter/J.O.S.I.E.3-Beta8-slerp Held-out reconstruction 58.3
- 310 KnutJaegersberg/Deacon-20B Held-out reconstruction 58.3
- 311 ABX-AI/Spicy-Laymonade-7B Held-out reconstruction 58.3
- 312 HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K Held-out reconstruction 58.3
- 313 allknowingroger/ANIMA-biodesign-7B-slerp Held-out reconstruction 58.2
- 314 awnr/Mistral-7B-v0.1-half-naive-A Held-out reconstruction 58.1
- 315 openaccess-ai-collective/mistral-7b-slimorcaboros Held-out reconstruction 58.1
- 316 JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k Held-out reconstruction 58.1
- 317 MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1 Held-out reconstruction 58.0
- 318 vaiv/llamion-14b-base Held-out reconstruction 58.0
- 319 WDong/Qwen1.5-7B-sft-0506_9_8 Held-out reconstruction 58.0
- 320 awnr/Mistral-7B-v0.1-signtensors-1-over-2 Held-out reconstruction 58.0
- 321 jrruethe/balthazar-2x10.7b-v1 Held-out reconstruction 57.9
- 322 jondurbin/bagel-8x7b-v0.2 Held-out reconstruction 57.8
- 323 huseyinatahaninan/phi-2-instruction Held-out reconstruction 57.7
- 324 Mollel/Swahili_Gemma Held-out reconstruction 57.6
- 325 Mr-Bhaskar/fbt-gemma-7b Held-out reconstruction 57.5
- 326 NovoCode/Novocode7b-v3 Held-out reconstruction 57.5
- 327 alvarobartt/mistral-7b-orpo-capybara-reproduction Held-out reconstruction 57.4
- 328 SuperAGI/SAM Held-out reconstruction 57.4
- 329 maywell/Synatra-RP-Orca-2-7b-v0.1 Held-out reconstruction 57.2
- 330 ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4 Held-out reconstruction 57.2
- 331 TheBloke/orca_mini_v3_13B-GPTQ Held-out reconstruction 56.8
- 332 xi0v/aether-7b-chat-v1.0 Held-out reconstruction 56.7
- 333 ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4 Held-out reconstruction 56.5
- 334 macadeliccc/Opus-Samantha-Llama-3-8B Held-out reconstruction 56.3
- 335 ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1 Held-out reconstruction 56.3
- 336 maldv/dragonwar-7b-s1 Held-out reconstruction 56.3
- 337 ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4 Held-out reconstruction 56.3
- 338 DeepMount00/Mistral-RAG Held-out reconstruction 56.3
- 339 Sao10K/L3-Solana-8B-v1 Held-out reconstruction 56.2
- 340 Langboat/Mengzi3-13B-Base Held-out reconstruction 56.1
- 341 yam-peleg/Hebrew-Mistral-7B Held-out reconstruction 56.1
- 342 HuggingFaceH4/mistral-7b-grok Held-out reconstruction 56.1
- 343 failspy/Llama-3-8B-Instruct-abliterated Held-out reconstruction 55.9
- 344 CreitinGameplays/ConvAI-9b Held-out reconstruction 55.9
- 345 BlueNipples/TimeCrystal-l2-13B Held-out reconstruction 55.9
- 346 NLUHOPOE/test-case-5 Held-out reconstruction 55.6
- 347 Norquinal/Mistral-7B-claude-instruct Held-out reconstruction 55.6
- 348 TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k Held-out reconstruction 55.5
- 349 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta Held-out reconstruction 55.5
- 350 freeCS-dot-org/Zero-7B-test-3 Held-out reconstruction 55.5
- 351 NeverSleep/Noromaid-13b-v0.3 Held-out reconstruction 55.2
- 352 kyujinpy/SOLAR-Platypus-10.7B-v1 Held-out reconstruction 54.9
- 353 XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k Held-out reconstruction 54.6
- 354 CohereForAI/aya-23-8B Held-out reconstruction 54.5
- 355 vaiv/llamion-14b-chat Held-out reconstruction 54.5
- 356 vicgalleorg/TruthfulQwen1.5-4B Held-out reconstruction 54.4
- 357 arlineka/Brunhilde-13b-v1 Held-out reconstruction 54.3
- 358 ZoidBB/unraveled-7b-a1 Held-out reconstruction 54.3
- 359 Undi95/PsyMedRP-v1-20B Held-out reconstruction 54.2
- 360 BFauber/lora_llama2-13b_10e5_r8_a16 Held-out reconstruction 54.2
- 361 jefferylovely/AiMaven-Orca2 Held-out reconstruction 53.9
- 362 ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta Held-out reconstruction 53.9
- 363 pleisto/yuren-13b-chatml Held-out reconstruction 53.4
- 364 Technoculture/Medorca-2x7b Held-out reconstruction 53.2
- 365 TwT-6/open_llm_leaderboard_demo2 Held-out reconstruction 53.0
- 366 bn22/DolphinMini-Mistral-7B Held-out reconstruction 52.9
- 367 KatyTheCutie/EstopianMaid-13B Held-out reconstruction 52.8
- 368 namirocks/tutor-model-13b-ep3 Held-out reconstruction 52.6
- 369 CausalLM/7B-DPO-alpha Held-out reconstruction 52.6
- 370 royallab/PsyOrca2-13b-DARE Held-out reconstruction 52.6
- 371 ajibawa-2023/SlimOrca-Llama-3-8B Held-out reconstruction 52.3
- 372 Locutusque/Orca-2-13b-SFT-v6 Held-out reconstruction 52.2
- 373 llm-agents/tora-13b-v1.0 Held-out reconstruction 52.0
- 374 mayacinka/Open-StaMis-v02-stock Held-out reconstruction 51.9
- 375 Kquant03/Medusa-7B-bf16 Held-out reconstruction 51.8
- 376 euclaise/Ferret_7B Held-out reconstruction 51.6
- 377 KnutJaegersberg/webMistral-7B Held-out reconstruction 51.4
- 378 NLUHOPOE/Mistral-7B-random-100000 Held-out reconstruction 51.4
- 379 ajibawa-2023/Python-Code-13B Held-out reconstruction 51.4
- 380 hywu/Camelidae-8x7B Held-out reconstruction 51.3
- 381 abacusai/Giraffe-beta-13b-32k Held-out reconstruction 51.3
- 382 gmonsoon/MaxiCPM-3x3B-Test Held-out reconstruction 51.1
- 383 TheBloke/orca_mini_v3_7B-GPTQ Held-out reconstruction 50.9
- 384 Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct Held-out reconstruction 50.8
- 385 gmonsoon/MiniCPM-2B-Base Held-out reconstruction 50.4
- 386 Charlie911/vicuna-7b-v1.5-lora-mmlu-merged Held-out reconstruction 50.4
- 387 pansophic/new_model_test Held-out reconstruction 50.0
- 388 vikash06/doctorLLM Held-out reconstruction 50.0
- 389 DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567 Held-out reconstruction 49.8
- 390 XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k Held-out reconstruction 49.4
- 391 ewqr2130/llama_ppo_1e6step_4000 Held-out reconstruction 49.0
- 392 ericpolewski/AIRIC-The-Intern Held-out reconstruction 48.8
- 393 Charlie911/vicuna-7b-v1.5-general-temporal-merged Held-out reconstruction 48.6
- 394 Charlie911/zephyr-7b-beta-lora-mmlu-merged Held-out reconstruction 47.9
- 395 abdulrahman-nuzha/finetuned-llama-v2.0 Held-out reconstruction 47.8
- 396 GeneZC/MiniChat-2-3B Held-out reconstruction 47.7
- 397 ValiantLabs/Fireplace-13b Held-out reconstruction 47.6
- 398 abhishek/autotrain-8kfjk-b3gva Held-out reconstruction 47.3
- 399 rishiraj/smol-3b Held-out reconstruction 46.8
- 400 tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora Held-out reconstruction 46.6
- 401 TeeZee/Buttocks-7B-v1.0 Held-out reconstruction 46.6
- 402 ibivibiv/multimaster-7b Held-out reconstruction 46.0
- 403 DeepMount00/Phi-3-Large-5.6b Held-out reconstruction 45.8
- 404 qnguyen3/quan-1.8b-chat Held-out reconstruction 44.7
- 405 Ritvik19/zephyr-2b-gemma-sft-qlora Held-out reconstruction 44.4
- 406 langgptai/Qwen-sft-ls-v0.1 Held-out reconstruction 44.3
- 407 stabilityai/stablelm-2-1_6b Held-out reconstruction 43.8
- 408 langgptai/Qwen-sft-la-v0.1 Held-out reconstruction 43.8
- 409 itsliupeng/openllama-7b-base Held-out reconstruction 43.6
- 410 abhinand/tamil-llama-7b-instruct-v0.1 Held-out reconstruction 43.3
- 411 jisukim8873/falcon-7B-case-5 Held-out reconstruction 43.1
- 412 kalisai/Nusantara-4b-Indo-Chat Held-out reconstruction 42.9
- 413 raincandy-u/Coder1.8-ORPO-TEST Held-out reconstruction 42.9
- 414 pmking27/PrathameshLLM-2B Held-out reconstruction 42.1
- 415 Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0 Held-out reconstruction 42.1
- 416 Zangs3011/falcon_7b_DolphinCoder Held-out reconstruction 41.0
- 417 sartifyllc/dociproLLM-7B Held-out reconstruction 40.9
- 418 Qwen/Qwen1.5-1.8B-Chat Held-out reconstruction 40.6
- 419 vihangd/dopeyshearedplats-2.7b-v1 Held-out reconstruction 40.6
- 420 csujeong/Falcon-7B-Fintued-Finance-Stock-E Held-out reconstruction 40.5
- 421 mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1 Held-out reconstruction 39.8
- 422 cyberagent/calm2-7b-chat Held-out reconstruction 39.7
- 423 Heng666/EastAsia-4x7B-Moe-experiment Held-out reconstruction 39.1
- 424 aloobun/open-llama-3b-v2-elmv3 Held-out reconstruction 39.1
- 425 M4-ai/NeuralReyna-Mini-1.8B-v0.3 Held-out reconstruction 39.1
- 426 Pierre-obi/Mistral_solar-slerp Held-out reconstruction 38.8
- 427 xaviviro/FLAMA-0.5-3B Held-out reconstruction 38.4
- 428 mwitiderrick/open_llama_3b_glaive_assistant_v0.1 Held-out reconstruction 37.7
- 429 deepseek-ai/deepseek-coder-6.7b-base Held-out reconstruction 37.7
- 430 raidhon/coven_tiny_1.1b_32k_orpo_alpha Held-out reconstruction 36.3
- 431 ddyuudd/merge_dolly-v2-3b_dpo_test Held-out reconstruction 36.0
- 432 RESMPDEV/Qwen1.5-Wukong-0.5B Held-out reconstruction 35.6
- 433 cognitivecomputations/TinyDolphin-2.8.1-1.1b Held-out reconstruction 35.4
- 434 alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2 Held-out reconstruction 35.1
- 435 Josephgflowers/TinyLlama-Cinder-Agent-Rag Held-out reconstruction 34.9
- 436 Josephgflowers/TinyLlama-Cinder-1.3B-Test.2 Held-out reconstruction 34.8
- 437 ppopiolek/tinyllama_eng_short Held-out reconstruction 34.8
- 438 kevin009/babyllama-v0.6 Held-out reconstruction 34.6
- 439 l3utterfly/tinyllama-1.1b-layla-v4 Held-out reconstruction 34.5
- 440 vihangd/shearedplats-1.3b-v1 Held-out reconstruction 34.2
- 441 ewqr2130/TinyLamma-SFT Held-out reconstruction 34.1
- 442 abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft Held-out reconstruction 34.1
- 443 KnutJaegersberg/platypus-1_8b Held-out reconstruction 34.0
- 444 KnutJaegersberg/falcon-1b-t-sft Held-out reconstruction 34.0
- 445 HuggingFaceTB/cosmo-1b Held-out reconstruction 33.9
- 446 ToastyPigeon/SmolPlatypus-1.5B-Sorted Held-out reconstruction 33.8
- 447 nnpy/Nape-0 Held-out reconstruction 33.7
- 448 Ramikan-BR/tinyllama-coder-py-4bit-v10 Held-out reconstruction 33.3
- 449 jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha Held-out reconstruction 33.1
- 450 Abhaykoul/OEvortex Held-out reconstruction 32.7
- 451 Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1 Held-out reconstruction 32.4
- 452 Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG Held-out reconstruction 31.9
- 453 gpt2-xl Held-out reconstruction 30.8
- 454 raincandy-u/Quark-464M-v0.2 Held-out reconstruction 30.4
- 455 gemmathon/gemma-2b-ko-v0 Held-out reconstruction 28.7
- 456 deepseek-ai/deepseek-coder-1.3b-instruct Held-out reconstruction 28.6
- 457 Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF Held-out reconstruction 28.5
- 458 Sharathhebbar24/Instruct_GPT_v1 Held-out reconstruction 27.9
- 459 Isotonic/smol_llama-4x220M-MoE Held-out reconstruction 26.5
- 460 ethzanalytics/pythia-31m Held-out reconstruction 26.4
- 461 Sharathhebbar24/math_gpt2 Held-out reconstruction 26.3
- 462 Felladrin/Minueza-32M-UltraChat Held-out reconstruction 26.2
- 463 wannaphong/numfalm-3b Held-out reconstruction 25.8
- 464 Facebook/OPT-125M Held-out reconstruction 25.5
Source: Official metabench leaderboard
Source: Official metabench leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | SF-Foundation/Ein-72B-v0.12 | 79.0 | Held-out reconstruction | Official leaderboard | |
| 2 | | 76.7 | Held-out reconstruction | Apr 2024 | Official leaderboard |
| 3 | MaziyarPanahi/Llama-3-70B-Instruct-DPO-v0.3 | 76.0 | Held-out reconstruction | Official leaderboard | |
| 4 | TomGrc/FusionNet_34Bx2_MoE_v0.1 | 74.5 | Held-out reconstruction | Official leaderboard | |
| 5 | yam-peleg/Experiment24-7B | 74.4 | Held-out reconstruction | Official leaderboard | |
| 6 | allknowingroger/Neuralmultiverse-7B-slerp | 74.3 | Held-out reconstruction | Official leaderboard | |
| 7 | ammarali32/multi_verse_model | 74.3 | Held-out reconstruction | Official leaderboard | |
| 8 | allknowingroger/Calmex26merge-12B-MoE | 74.2 | Held-out reconstruction | Official leaderboard | |
| 9 | yam-peleg/Experiment29-7B | 74.2 | Held-out reconstruction | Official leaderboard | |
| 10 | CultriX/NeuralTrix-bf16 | 74.2 | Held-out reconstruction | Official leaderboard | |
| 11 | eldogbbhed/NeuralBeagleJaskier | 74.2 | Held-out reconstruction | Official leaderboard | |
| 12 | Gille/StrangeMerges_32-7B-slerp | 74.1 | Held-out reconstruction | Official leaderboard | |
| 13 | fblgit/UNA-SimpleSmaug-34b-v1beta | 74.1 | Held-out reconstruction | Official leaderboard | |
| 14 | ValiantLabs/Llama3-70B-Fireplace | 74.1 | Held-out reconstruction | Official leaderboard | |
| 15 | yam-peleg/Experiment27-7B | 74.1 | Held-out reconstruction | Official leaderboard | |
| 16 | mlabonne/Zebrafish-7B | 74.0 | Held-out reconstruction | Official leaderboard | |
| 17 | allknowingroger/mergekit-slerp-zplzqvn | 74.0 | Held-out reconstruction | Official leaderboard | |
| 18 | mayacinka/yam-jom-7B | 74.0 | Held-out reconstruction | Official leaderboard | |
| 19 | MaziyarPanahi/Calme-7B-Instruct-v0.1.1 | 74.0 | Held-out reconstruction | Official leaderboard | |
| 20 | cloudyu/Mixtral_34Bx2_MoE_60B | 73.9 | Held-out reconstruction | Official leaderboard | |
| 21 | CultriX/AlphaCeption-7B-v1 | 73.9 | Held-out reconstruction | Official leaderboard | |
| 22 | automerger/PasticheInex12-7B | 73.8 | Held-out reconstruction | Official leaderboard | |
| 23 | ConvexAI/Luminex-34B-v0.1 | 73.8 | Held-out reconstruction | Official leaderboard | |
| 24 | cloudyu/Truthful_DPO_cloudyu_Mixtral_34Bx2_MoE_60B | 73.8 | Held-out reconstruction | Official leaderboard | |
| 25 | shenzhi-wang/Llama3-70B-Chinese-Chat | 73.8 | Held-out reconstruction | Official leaderboard | |
| 26 | arcee-ai/Clown-DPO-Extended | 73.8 | Held-out reconstruction | Official leaderboard | |
| 27 | eren23/ogno-monarch-jaskier-merge-7b-OH-PREF-DPO-v2 | 73.8 | Held-out reconstruction | Official leaderboard | |
| 28 | automerger/ShadowYamshadow-7B | 73.7 | Held-out reconstruction | Official leaderboard | |
| 29 | daxiongshu/Pluto_24B_DPO_63 | 73.7 | Held-out reconstruction | Official leaderboard | |
| 30 | nbeerbower/slerp-bophades-truthy-math-mistral-7B | 73.7 | Held-out reconstruction | Official leaderboard | |
| 31 | Kukedlc/NeuralMaxime-7B-slerp | 73.7 | Held-out reconstruction | Official leaderboard | |
| 32 | rmdhirr/Multiparadigm_7B | 73.5 | Held-out reconstruction | Official leaderboard | |
| 33 | yam-peleg/Experiment22-7B | 73.4 | Held-out reconstruction | Official leaderboard | |
| 34 | alchemonaut/BoreanGale-70B | 73.3 | Held-out reconstruction | Official leaderboard | |
| 35 | nbeerbower/Flammen-Bophades-7B | 73.3 | Held-out reconstruction | Official leaderboard | |
| 36 | allknowingroger/Multimerge-Neurallaymons-12B-MoE | 73.3 | Held-out reconstruction | Official leaderboard | |
| 37 | MaziyarPanahi/TheTop-5x7B-Instruct-T-v0.1 | 73.3 | Held-out reconstruction | Official leaderboard | |
| 38 | YKM11/Mistral-7B-adaptv1 | 73.3 | Held-out reconstruction | Official leaderboard | |
| 39 | saltlux/luxia-21.4b-alignment-v1.0 | 73.2 | Held-out reconstruction | Official leaderboard | |
| 40 | alnrg2arg/blockchainlabs_7B_merged_test2_4 | 73.0 | Held-out reconstruction | Official leaderboard | |
| 41 | dddsaty/FusionNet_7Bx2_MoE_Ko_DPO_Adapter_Attach | 73.0 | Held-out reconstruction | Official leaderboard | |
| 42 | Kukedlc/Neural-4-Maths-7b | 73.0 | Held-out reconstruction | Official leaderboard | |
| 43 | AiMavenAi/AiMaven-Prometheus | 73.0 | Held-out reconstruction | Official leaderboard | |
| 44 | leveldevai/TurdusDareBeagle-7B | 72.9 | Held-out reconstruction | Official leaderboard | |
| 45 | Kukedlc/Fasciculus-Arcuatus-7B-slerp | 72.8 | Held-out reconstruction | Official leaderboard | |
| 46 | FelixChao/Scorpio-7B | 72.8 | Held-out reconstruction | Official leaderboard | |
| 47 | CultriX/Wernicke-7B-dpo | 72.8 | Held-out reconstruction | Official leaderboard | |
| 48 | alnrg2arg/blockchainlabs_test3_seminar | 72.7 | Held-out reconstruction | Official leaderboard | |
| 49 | fblgit/UNA-34BeagleSimpleMath-32K-v1 | 72.7 | Held-out reconstruction | Official leaderboard | |
| 50 | Weyaxi/Cosmosis-3x34B | 72.7 | Held-out reconstruction | Official leaderboard | |
| 51 | kaitchup/TheMayonnaise | 72.6 | Held-out reconstruction | Official leaderboard | |
| 52 | YouKnwMe/Mistral-7b-instruct-v0.2-private-eds2 | 72.6 | Held-out reconstruction | Official leaderboard | |
| 53 | AbacusResearch/jaLLAbi2-7b | 72.5 | Held-out reconstruction | Official leaderboard | |
| 54 | kekmodel/StopCarbon-10.7B-v5 | 72.5 | Held-out reconstruction | Official leaderboard | |
| 55 | leveldevai/MarcBeagle-7B | 72.4 | Held-out reconstruction | Official leaderboard | |
| 56 | CultriX/Wernicke-7B-v9 | 72.4 | Held-out reconstruction | Official leaderboard | |
| 57 | Kquant03/Samlagast-7B-laser-bf16 | 72.4 | Held-out reconstruction | Official leaderboard | |
| 58 | allknowingroger/Neuralmaath-12B-MoE | 72.2 | Held-out reconstruction | Official leaderboard | |
| 59 | zhengr/MixTAO-7Bx2-MoE-Instruct-v4.0 | 72.2 | Held-out reconstruction | Official leaderboard | |
| 60 | mlabonne/Beagle14-7B | 72.2 | Held-out reconstruction | Official leaderboard | |
| 61 | ConvexAI/BurningBruce-003 | 72.1 | Held-out reconstruction | Official leaderboard | |
| 62 | leveldevai/MarcDareBeagle-7B | 72.1 | Held-out reconstruction | Official leaderboard | |
| 63 | dddsaty/SOLAR-Instruct-ko-Adapter-Attach | 71.9 | Held-out reconstruction | Official leaderboard | |
| 64 | h2m/mhm-8x7B-FrankenMoE-v1.0 | 71.9 | Held-out reconstruction | Official leaderboard | |
| 65 | nbeerbower/bruphin-epsilon | 71.9 | Held-out reconstruction | Official leaderboard | |
| 66 | moreh/MoMo-70B-LoRA-V1.4 | 71.9 | Held-out reconstruction | Official leaderboard | |
| 67 | SC56/Mistral-7B-orca-dpo-12h | 71.8 | Held-out reconstruction | Official leaderboard | |
| 68 | MaziyarPanahi/TheTop-5x7B-Instruct-S5-v0.1 | 71.7 | Held-out reconstruction | Official leaderboard | |
| 69 | DopeorNope/SOLARC-MOE-10.7Bx4 | 71.7 | Held-out reconstruction | Official leaderboard | |
| 70 | kekmodel/StopCarbon-10.7B-v6 | 71.6 | Held-out reconstruction | Official leaderboard | |
| 71 | janai-hq/trinity-v1 | 71.6 | Held-out reconstruction | Official leaderboard | |
| 72 | ResplendentAI/DaturaCookie_7B | 71.5 | Held-out reconstruction | Official leaderboard | |
| 73 | vicgalle/NeuralBeagle-11B | 71.5 | Held-out reconstruction | Official leaderboard | |
| 74 | CultriX/MergeTrix-7B-v2 | 71.4 | Held-out reconstruction | Official leaderboard | |
| 75 | Aryanne/Westest-7B | 71.4 | Held-out reconstruction | Official leaderboard | |
| 76 | DreadPoor/SilverMaiden-7B-slerp | 71.3 | Held-out reconstruction | Official leaderboard | |
| 77 | yam-peleg/Experiment7-7B | 71.3 | Held-out reconstruction | Official leaderboard | |
| 78 | MaziyarPanahi/TheTop-5x7B-Instruct-S3-v0.1 | 71.2 | Held-out reconstruction | Official leaderboard | |
| 79 | cloudyu/Mixtral_7Bx6_MoE_35B | 71.0 | Held-out reconstruction | Official leaderboard | |
| 80 | SUSTech/SUS-Chat-34B | 70.9 | Held-out reconstruction | Official leaderboard | |
| 81 | Gille/MoE-StrangeMerges-2x7B | 70.8 | Held-out reconstruction | Official leaderboard | |
| 82 | ibndias/Nous-Hermes-2-MoE-2x34B | 70.8 | Held-out reconstruction | Official leaderboard | |
| 83 | Steelskull/Umbra-v3-MoE-4x11b-2ex | 70.8 | Held-out reconstruction | Official leaderboard | |
| 84 | jsfs11/SnorkelWestBeagle-DARETIES-7B | 70.8 | Held-out reconstruction | Official leaderboard | |
| 85 | allknowingroger/StarlingMaths-12B-MoE | 70.7 | Held-out reconstruction | Official leaderboard | |
| 86 | chujiezheng/tulu-2-dpo-70b-ExPO | 70.7 | Held-out reconstruction | Official leaderboard | |
| 87 | Test157t/Prima-LelantaclesV6-7b | 70.7 | Held-out reconstruction | Official leaderboard | |
| 88 | vicgalle/test-merge-3 | 70.7 | Held-out reconstruction | Official leaderboard | |
| 89 | JaeyeonKang/CCK_Asura_v2 | 70.6 | Held-out reconstruction | Official leaderboard | |
| 90 | jan-ai/Pandora-10.7B-v1 | 70.6 | Held-out reconstruction | Official leaderboard | |
| 91 | maywell/PiVoT-SUS-RP | 70.6 | Held-out reconstruction | Official leaderboard | |
| 92 | Eric111/openchat-3.5-0106-128k-DPO_dpo-binarized-NeuralTrix-7B | 70.6 | Held-out reconstruction | Official leaderboard | |
| 93 | NLPark/AnFeng_v3_Avocet | 70.6 | Held-out reconstruction | Official leaderboard | |
| 94 | flammenai/flammen22-mistral-7B | 70.5 | Held-out reconstruction | Official leaderboard | |
| 95 | nbeerbower/flammen11X-mistral-7B | 70.4 | Held-out reconstruction | Official leaderboard | |
| 96 | occultml/CatMarcoro14-7B-slerp | 70.4 | Held-out reconstruction | Official leaderboard | |
| 97 | Himitsui/KuroMitsu-11B | 70.3 | Held-out reconstruction | Official leaderboard | |
| 98 | shadowml/Daredevil-7B | 70.3 | Held-out reconstruction | Official leaderboard | |
| 99 | yunconglong/7Bx4_DPO_2e | 70.3 | Held-out reconstruction | Official leaderboard | |
| 100 | Inv/Konstanta-7B | 70.2 | Held-out reconstruction | Official leaderboard | |
| 101 | ParasiticRogue/Merged-RP-Stew-V2-34B | 70.2 | Held-out reconstruction | Official leaderboard | |
| 102 | AA051610/A0127 | 70.2 | Held-out reconstruction | Official leaderboard | |
| 103 | mvpmaster/kellemar-KrishnaHercules-0.1-7b-slerp | 70.2 | Held-out reconstruction | Official leaderboard | |
| 104 | brucethemoose/Yi-34B-200K-DARE-merge-v7 | 69.9 | Held-out reconstruction | Official leaderboard | |
| 105 | DreadPoor/Chimera-7B-slerp | 69.8 | Held-out reconstruction | Official leaderboard | |
| 106 | DreadPoor/RoyalNoroichi-7B-slerp | 69.7 | Held-out reconstruction | Official leaderboard | |
| 107 | JaeyeonKang/CCK_Gony_v3.1 | 69.7 | Held-out reconstruction | Official leaderboard | |
| 108 | Aratako/Mixtral-8x7B-Instruct-v0.1-upscaled | 69.6 | Held-out reconstruction | Official leaderboard | |
| 109 | jeiku/Cookie_7B | 69.6 | Held-out reconstruction | Official leaderboard | |
| 110 | DreadPoor/RoyalMaid-7B-slerp | 69.6 | Held-out reconstruction | Official leaderboard | |
| 111 | abacusai/Liberated-Qwen1.5-72B | 69.5 | Held-out reconstruction | Official leaderboard | |
| 112 | Aryanne/MixSwap | 69.5 | Held-out reconstruction | Official leaderboard | |
| 113 | SanjiWatsuki/Kunoichi-DPO-v2-7B | 69.4 | Held-out reconstruction | Official leaderboard | |
| 114 | giraffe176/WestMaid_HermesMonarchv0.1 | 69.4 | Held-out reconstruction | Official leaderboard | |
| 115 | cloudyu/Pluto_24B_DPO_200 | 69.2 | Held-out reconstruction | Official leaderboard | |
| 116 | APMIC/caigun-lora-model-34B-v2 | 69.2 | Held-out reconstruction | Official leaderboard | |
| 117 | ChaoticNeutrals/This_is_fine_7B | 69.1 | Held-out reconstruction | Official leaderboard | |
| 118 | saishf/Top-Western-Maid-7B | 69.1 | Held-out reconstruction | Official leaderboard | |
| 119 | YeungNLP/firefly-mixtral-8x7b-v0.1 | 69.1 | Held-out reconstruction | Official leaderboard | |
| 120 | YeungNLP/firefly-mixtral-8x7b-v1 | 69.1 | Held-out reconstruction | Official leaderboard | |
| 121 | flammenai/Mahou-1.0-mistral-7B | 68.9 | Held-out reconstruction | Official leaderboard | |
| 122 | nbeerbower/flammen2 | 68.9 | Held-out reconstruction | Official leaderboard | |
| 123 | DreadPoor/Satyr-7B-Model_Stock | 68.8 | Held-out reconstruction | Official leaderboard | |
| 124 | viethq188/LeoScorpius-7B | 68.7 | Held-out reconstruction | Official leaderboard | |
| 125 | EmbeddedLLM/Mistral-7B-Merge-14-v0.5 | 68.6 | Held-out reconstruction | Official leaderboard | |
| 126 | Locutusque/Hyperion-2.0-Yi-34B | 68.6 | Held-out reconstruction | Official leaderboard | |
| 127 | Danielbrdz/Barcenas-Llama3-8b-ORPO | 68.5 | Held-out reconstruction | Official leaderboard | |
| 128 | Nitral-AI/KukulStanta-7B | 68.5 | Held-out reconstruction | Official leaderboard | |
| 129 | one-man-army/una-neural-chat-v3-3-P1-OMA | 68.5 | Held-out reconstruction | Official leaderboard | |
| 130 | adamo1139/Yi-34B-200K-AEZAKMI-v2 | 68.4 | Held-out reconstruction | Official leaderboard | |
| 131 | Eric111/openchat-3.5-0106-128k-DPO | 68.4 | Held-out reconstruction | Official leaderboard | |
| 132 | AIDC-ai-business/Marcoroni-7B-v2 | 68.4 | Held-out reconstruction | Official leaderboard | |
| 133 | brucethemoose/CapyTessBorosYi-34B-200K-DARE-Ties | 68.4 | Held-out reconstruction | Official leaderboard | |
| 134 | sethuiyer/Eida_10.7B | 68.3 | Held-out reconstruction | Official leaderboard | |
| 135 | APMIC/caigun-lora-model-34B-v3 | 68.3 | Held-out reconstruction | Official leaderboard | |
| 136 | nisten/shqiponja-15b-v1 | 68.1 | Held-out reconstruction | Official leaderboard | |
| 137 | Weyaxi/Seraph-openchat-3.5-1210-Slerp | 68.1 | Held-out reconstruction | Official leaderboard | |
| 138 | migtissera/Tess-M-v1.3 | 68.0 | Held-out reconstruction | Official leaderboard | |
| 139 | nbeerbower/llama-3-stella-8B | 68.0 | Held-out reconstruction | Official leaderboard | |
| 140 | Q-bert/MetaMath-Cybertron | 68.0 | Held-out reconstruction | Official leaderboard | |
| 141 | PulsarAI/MetaMath-OpenHermes-2.5-neural-chat-v3-3-Slerp | 67.9 | Held-out reconstruction | Official leaderboard | |
| 142 | Sao10K/Solstice-11B-v1 | 67.9 | Held-out reconstruction | Official leaderboard | |
| 143 | Abhinav7/NeuralPipe-7B-slerp | 67.8 | Held-out reconstruction | Official leaderboard | |
| 144 | chanwit/flux-7b-v0.1 | 67.6 | Held-out reconstruction | Official leaderboard | |
| 145 | 4season/sft_model_test1 | 67.5 | Held-out reconstruction | Official leaderboard | |
| 146 | Inv/MoeMoE-2x7b | 67.5 | Held-out reconstruction | Official leaderboard | |
| 147 | perlthoughts/Chupacabra-8x7B-MoE | 67.4 | Held-out reconstruction | Official leaderboard | |
| 148 | lex-hue/Delexa-7b | 67.3 | Held-out reconstruction | Official leaderboard | |
| 149 | DreadPoor/NewtoccineLake-slerp-7B | 67.3 | Held-out reconstruction | Official leaderboard | |
| 150 | DeepKarkhanis/Mistral-Passthrough-8L-10B | 67.3 | Held-out reconstruction | Official leaderboard | |
| 151 | cloudyu/Mixtral_13B_Chat | 67.2 | Held-out reconstruction | Official leaderboard | |
| 152 | | 67.2 | Held-out reconstruction | May 2024 | Official leaderboard |
| 153 | AA051610/FT | 67.2 | Held-out reconstruction | Official leaderboard | |
| 154 | kyujinpy/PlatYi-34B-Q | 67.2 | Held-out reconstruction | Official leaderboard | |
| 155 | GeorgiaTech/0.0_llama_nodpo_3iters_bs128_531lr_iter_3 | 67.0 | Held-out reconstruction | Official leaderboard | |
| 156 | MaziyarPanahi/Phi-3-mini-4k-instruct-v0.1 | 67.0 | Held-out reconstruction | Official leaderboard | |
| 157 | ZhangShenao/0.0005_llama_4iters_bs128_5551lr_iter_2 | 67.0 | Held-out reconstruction | Official leaderboard | |
| 158 | migtissera/Tess-34B-v1.4 | 67.0 | Held-out reconstruction | Official leaderboard | |
| 159 | Artples/L-MChat-7b | 66.9 | Held-out reconstruction | Official leaderboard | |
| 160 | vonjack/Phi-3-mini-4k-instruct-LLaMAfied | 66.9 | Held-out reconstruction | Official leaderboard | |
| 161 | ResplendentAI/Persephone_7B | 66.8 | Held-out reconstruction | Official leaderboard | |
| 162 | Azazelle/Maylin-7b | 66.8 | Held-out reconstruction | Official leaderboard | |
| 163 | CallComply/openchat-3.5-0106-32k | 66.7 | Held-out reconstruction | Official leaderboard | |
| 164 | openchat/openchat-3.5-0106 | 66.7 | Held-out reconstruction | Official leaderboard | |
| 165 | nbeerbower/llama-3-sauce-v2-8B | 66.6 | Held-out reconstruction | Official leaderboard | |
| 166 | adamo1139/Yi-34b-200K-rawrr-v2-run-0902-LoRA | 66.6 | Held-out reconstruction | Official leaderboard | |
| 167 | Salesforce/xLAM-v0.1-r | 66.4 | Held-out reconstruction | Official leaderboard | |
| 168 | PistachioAlt/Synatra-MCS-7B-v0.3-RP-Slerp | 66.4 | Held-out reconstruction | Official leaderboard | |
| 169 | Xenon1/Eclipse-13B-dpo | 66.3 | Held-out reconstruction | Official leaderboard | |
| 170 | andysalerno/openchat-nectar-0.6 | 66.2 | Held-out reconstruction | Official leaderboard | |
| 171 | Weyaxi/Newton-OpenHermes-2.5-neural-chat-v3-3-Slerp | 66.2 | Held-out reconstruction | Official leaderboard | |
| 172 | argilla/DistilabelBeagle14-7B | 66.2 | Held-out reconstruction | Official leaderboard | |
| 173 | lex-hue/LexGPT-V3 | 66.2 | Held-out reconstruction | Official leaderboard | |
| 174 | mlabonne/NeuralHermes-2.5-Mistral-7B | 66.1 | Held-out reconstruction | Official leaderboard | |
| 175 | Azure99/blossom-v3_1-yi-34b | 66.1 | Held-out reconstruction | Official leaderboard | |
| 176 | vicgalle/solarized-18B-dpo | 66.1 | Held-out reconstruction | Official leaderboard | |
| 177 | Yuma42/KangalKhan-ShatteredRuby-7B | 66.0 | Held-out reconstruction | Official leaderboard | |
| 178 | mayacinka/West-Ramen-7Bx4 | 65.8 | Held-out reconstruction | Official leaderboard | |
| 179 | DeepMount00/phi_3 | 65.8 | Held-out reconstruction | Official leaderboard | |
| 180 | saucam/aqua-smaug-0.3-8B | 65.8 | Held-out reconstruction | Official leaderboard | |
| 181 | icefog72/Kunokukulemonchini-7b | 65.8 | Held-out reconstruction | Official leaderboard | |
| 182 | Azazelle/Argetsu | 65.7 | Held-out reconstruction | Official leaderboard | |
| 183 | NousResearch/Nous-Hermes-2-Mistral-7B-DPO | 65.7 | Held-out reconstruction | Official leaderboard | |
| 184 | Isotonic/Hermes-2-Pro-Mixtral-4x7B | 65.7 | Held-out reconstruction | Official leaderboard | |
| 185 | cognitivecomputations/MegaDolphin-120b | 65.6 | Held-out reconstruction | Official leaderboard | |
| 186 | tenyx/TenyxChat-7B-v1 | 65.4 | Held-out reconstruction | Official leaderboard | |
| 187 | Gille/StrangeMerges_12-7B-slerp | 65.3 | Held-out reconstruction | Official leaderboard | |
| 188 | Muhammad2003/TriMistral-7B-TIES | 65.3 | Held-out reconstruction | Official leaderboard | |
| 189 | decruz07/kellemar-DPO-7B | 65.3 | Held-out reconstruction | Official leaderboard | |
| 190 | fzzhang/Marcoroni-neural-chat-7B-v2_gsm8k_merged | 65.3 | Held-out reconstruction | Official leaderboard | |
| 191 | elinas/Llama-3-15B-Instruct-zeroed-ft | 65.1 | Held-out reconstruction | Official leaderboard | |
| 192 | Liangmingxin/ThetaWave-7B-sft | 65.1 | Held-out reconstruction | Official leaderboard | |
| 193 | ibivibiv/aegolius-acadicus-34b-v3 | 65.0 | Held-out reconstruction | Official leaderboard | |
| 194 | Ba2han/Llama-Phi-3_DoRA | 65.0 | Held-out reconstruction | Official leaderboard | |
| 195 | mahiatlinux/ShadowDolph-7B-v1 | 65.0 | Held-out reconstruction | Official leaderboard | |
| 196 | dozzke/hermorca | 64.9 | Held-out reconstruction | Official leaderboard | |
| 197 | kyujinpy/PlatYi-34B-Llama-Q-v2 | 64.9 | Held-out reconstruction | Official leaderboard | |
| 198 | Isaak-Carter/J.O.S.I.E.3-Beta12-7B-slerp | 64.7 | Held-out reconstruction | Official leaderboard | |
| 199 | beowolx/CodeNinja-1.0-OpenChat-7B | 64.7 | Held-out reconstruction | Official leaderboard | |
| 200 | JunchengXie/Starling-LM-7B-alpha-gpt-4-80k | 64.7 | Held-out reconstruction | Official leaderboard | |
| 201 | aloobun/slerp_bun_mistral_7b_v2 | 64.6 | Held-out reconstruction | Official leaderboard | |
| 202 | Isaak-Carter/JOSIE_Beta-4-7B-slerp | 64.6 | Held-out reconstruction | Official leaderboard | |
| 203 | mahiatlinux/MasherAI-v6.1-7B-eval-test | 64.6 | Held-out reconstruction | Official leaderboard | |
| 204 | SeaLLMs/SeaLLM-7B-v2 | 64.6 | Held-out reconstruction | Official leaderboard | |
| 205 | jondurbin/bagel-dpo-7b-v0.4 | 64.5 | Held-out reconstruction | Official leaderboard | |
| 206 | nlpguy/ColorShadow-7B-v3 | 64.4 | Held-out reconstruction | Official leaderboard | |
| 207 | H-D-T/Buzz-8b-Large-v0.5 | 64.4 | Held-out reconstruction | Official leaderboard | |
| 208 | beberik/rawr | 64.3 | Held-out reconstruction | Official leaderboard | |
| 209 | TomGrc/FusionNet_passthrough_v0.1 | 64.3 | Held-out reconstruction | Official leaderboard | |
| 210 | nlpguy/StarFusion-alpha2 | 64.3 | Held-out reconstruction | Official leaderboard | |
| 211 | perlthoughts/Starling-LM-alpha-8x7B-MoE | 64.3 | Held-out reconstruction | Official leaderboard | |
| 212 | Undi95/Llama-3-Unholy-8B | 64.3 | Held-out reconstruction | Official leaderboard | |
| 213 | | 64.3 | Held-out reconstruction | Nov 2023 | Official leaderboard |
| 214 | ABX-AI/Quantum-Citrus-9B | 64.2 | Held-out reconstruction | Official leaderboard | |
| 215 | bababababooey/mergekit-slerp-mntqhzv | 64.2 | Held-out reconstruction | Official leaderboard | |
| 216 | freecs/ThetaWave-7B-v1 | 64.1 | Held-out reconstruction | Official leaderboard | |
| 217 | HIT-SCIR/Chinese-Mixtral-8x7B | 64.1 | Held-out reconstruction | Official leaderboard | |
| 218 | ResplendentAI/Aura_L3_8B | 64.1 | Held-out reconstruction | Official leaderboard | |
| 219 | Azazelle/Mocha-Sample-7b-ex | 64.1 | Held-out reconstruction | Official leaderboard | |
| 220 | joowon99/SOLAR-10.7B-ko_alpaca | 64.1 | Held-out reconstruction | Official leaderboard | |
| 221 | Replete-AI/Mistral-11b-v0.1 | 64.1 | Held-out reconstruction | Official leaderboard | |
| 222 | Replete-AI/Mistral-Evolved-11b-v0.1 | 64.1 | Held-out reconstruction | Official leaderboard | |
| 223 | FuseAI/FuseChat-7B-VaRM | 64.0 | Held-out reconstruction | Official leaderboard | |
| 224 | abhishek/autotrain-llama3-orpo-v2 | 64.0 | Held-out reconstruction | Official leaderboard | |
| 225 | AwanLLM/Awanllm-Llama-3-8B-Instruct-ORPO-v0.1 | 63.9 | Held-out reconstruction | Official leaderboard | |
| 226 | | 63.7 | Held-out reconstruction | Feb 2024 | Official leaderboard |
| 227 | Nitral-AI/Eris_PrimeV4.20-Vision-32k-7B | 63.6 | Held-out reconstruction | Official leaderboard | |
| 228 | rombodawg/Llama-3-8B-Instruct-Coder | 63.5 | Held-out reconstruction | Official leaderboard | |
| 229 | abhishekchohan/mistral-7B-forest-merge-v0.1 | 63.3 | Held-out reconstruction | Official leaderboard | |
| 230 | hydra-project/OpenHyperion-2.5-Mistral-7B | 63.3 | Held-out reconstruction | Official leaderboard | |
| 231 | NeverSleep/Llama-3-Lumimaid-8B-v0.1-OAS | 63.3 | Held-out reconstruction | Official leaderboard | |
| 232 | cstr/phi-3-orpo-v9_16 | 63.2 | Held-out reconstruction | Official leaderboard | |
| 233 | TeeZee/Kyllene-v1.0 | 63.2 | Held-out reconstruction | Official leaderboard | |
| 234 | jeiku/Zephyr_beta_32k_7B | 63.2 | Held-out reconstruction | Official leaderboard | |
| 235 | SC99/Mistral-7B-privatemix-base-ia | 63.1 | Held-out reconstruction | Official leaderboard | |
| 236 | Steelskull/VerA-Etheria-55b | 63.0 | Held-out reconstruction | Official leaderboard | |
| 237 | HenryJJ/dolphin-2.6-mistral-7b-dpo-orca-v2 | 63.0 | Held-out reconstruction | Official leaderboard | |
| 238 | grimjim/zephyr-beta-wizardLM-2-merge-7B | 62.9 | Held-out reconstruction | Official leaderboard | |
| 239 | ChaoticNeutrals/Nyanade_Stunna-Maid-7B-v0.2 | 62.8 | Held-out reconstruction | Official leaderboard | |
| 240 | perlthoughts/openchat-3.5-1210-32k-8x7b-MoE | 62.8 | Held-out reconstruction | Official leaderboard | |
| 241 | manishiitg/open-aditi-hi-v4 | 62.7 | Held-out reconstruction | Official leaderboard | |
| 242 | yaojialzc/Gigi-Llama3-8B-Chinese-zh | 62.7 | Held-out reconstruction | Official leaderboard | |
| 243 | ContextualAI/Contextual_KTO_Mistral_PairRM | 62.6 | Held-out reconstruction | Official leaderboard | |
| 244 | LeroyDyer/Mixtral_AI_Cyber_Child | 62.6 | Held-out reconstruction | Official leaderboard | |
| 245 | azarafrooz/Mistral-7B-Instruct-v0.2-sp-v0 | 62.6 | Held-out reconstruction | Official leaderboard | |
| 246 | Weyaxi/Einstein-v5-v0.2-7B | 62.6 | Held-out reconstruction | Official leaderboard | |
| 247 | TeeZee/DarkSapling-7B-v2.0 | 62.4 | Held-out reconstruction | Official leaderboard | |
| 248 | liminerity/Blured-Ties-7B | 62.3 | Held-out reconstruction | Official leaderboard | |
| 249 | Joseph717171/Genstruct-10.7B | 62.2 | Held-out reconstruction | Official leaderboard | |
| 250 | NeverSleep/MiquMaid-v2-70B | 62.1 | Held-out reconstruction | Official leaderboard | |
| 251 | x2bee/POLAR-14B-v0.2 | 62.0 | Held-out reconstruction | Official leaderboard | |
| 252 | cloudyu/Mixtral_7Bx2_MoE_13B | 62.0 | Held-out reconstruction | Official leaderboard | |
| 253 | DreadPoor/ToppyEvil-7B-slerp | 61.9 | Held-out reconstruction | Official leaderboard | |
| 254 | netcat420/MFANN3bv0.6 | 61.9 | Held-out reconstruction | Official leaderboard | |
| 255 | BlueNipples/SnowLotus-v2-10.7B | 61.8 | Held-out reconstruction | Official leaderboard | |
| 256 | ewqr2130/mistral-inst-ppo | 61.8 | Held-out reconstruction | Official leaderboard | |
| 257 | 922-CA/monika-ddlc-8b-v1 | 61.7 | Held-out reconstruction | Official leaderboard | |
| 258 | silvercoder45/Mistral-7b-instruct-v0.2-summ-sft-bf16-e3 | 61.6 | Held-out reconstruction | Official leaderboard | |
| 259 | PulsarAI/Einstein-v3-7B | 61.5 | Held-out reconstruction | Official leaderboard | |
| 260 | jondurbin/bagel-7b-v0.4 | 61.5 | Held-out reconstruction | Official leaderboard | |
| 261 | macadeliccc/gemma-orchid-7b-dpo | 61.4 | Held-out reconstruction | Official leaderboard | |
| 262 | nasiruddin15/Mistral-dolphin-2.8-grok-instract-2-7B-slerp | 61.4 | Held-out reconstruction | Official leaderboard | |
| 263 | yanolja/KoSOLAR-10.7B-v0.2 | 61.4 | Held-out reconstruction | Official leaderboard | |
| 264 | lodrick-the-lafted/Hermes-Instruct-7B-100K | 61.3 | Held-out reconstruction | Official leaderboard | |
| 265 | eswardivi/llamathon | 61.2 | Held-out reconstruction | Official leaderboard | |
| 266 | g-ronimo/llama3-8b-SlimHermes | 61.2 | Held-out reconstruction | Official leaderboard | |
| 267 | | 61.2 | Held-out reconstruction | Feb 2024 | Official leaderboard |
| 268 | LeroyDyer/Mixtral_AI_Cyber_Matrix_2_0 | 61.1 | Held-out reconstruction | Official leaderboard | |
| 269 | uukuguy/speechless-mistral-7B-v0.2-mixed-1 | 61.0 | Held-out reconstruction | Official leaderboard | |
| 270 | zelus82/Obelix-Phi2-v0 | 61.0 | Held-out reconstruction | Official leaderboard | |
| 271 | Changgil/K2S3-Mistral-7b-v1.0 | 60.8 | Held-out reconstruction | Official leaderboard | |
| 272 | dfurman/Llama-3-8B-Orpo-v0.1 | 60.8 | Held-out reconstruction | Official leaderboard | |
| 273 | Azure99/blossom-v4-mistral-7b | 60.7 | Held-out reconstruction | Official leaderboard | |
| 274 | ibm/merlinite-7b | 60.6 | Held-out reconstruction | Official leaderboard | |
| 275 | Deci/DeciLM-7B-instruct | 60.5 | Held-out reconstruction | Official leaderboard | |
| 276 | ozayezerceli/Threnystril-2x7B-moe | 60.4 | Held-out reconstruction | Official leaderboard | |
| 277 | DUAL-GPO/zephyr-7b-gpo-update4-i0 | 60.4 | Held-out reconstruction | Official leaderboard | |
| 278 | tourist800/mistral_2X7b | 60.3 | Held-out reconstruction | Official leaderboard | |
| 279 | itsliupeng/llama_9b_long | 60.1 | Held-out reconstruction | Official leaderboard | |
| 280 | uukuguy/speechless-zephyr-code-functionary-7b | 60.1 | Held-out reconstruction | Official leaderboard | |
| 281 | cloudyu/mistral_18B_instruct_v0.1 | 60.0 | Held-out reconstruction | Official leaderboard | |
| 282 | Artples/L-MChat-Small | 60.0 | Held-out reconstruction | Official leaderboard | |
| 283 | eduagarcia/mistral-orpo-mix-7k | 59.7 | Held-out reconstruction | Official leaderboard | |
| 284 | MaziyarPanahi/gemma-7b-alpaca-52k-v0.1 | 59.7 | Held-out reconstruction | Official leaderboard | |
| 285 | grayhacker91/gemma-7b-open-platypus-commercial | 59.6 | Held-out reconstruction | Official leaderboard | |
| 286 | MaziyarPanahi/phi-2-logical-sft | 59.6 | Held-out reconstruction | Official leaderboard | |
| 287 | NeuralNovel/Aeryth-7B-v0.1 | 59.6 | Held-out reconstruction | Official leaderboard | |
| 288 | Locutusque/Hercules-2.0-Mistral-7B | 59.5 | Held-out reconstruction | Official leaderboard | |
| 289 | jefferylovely/AthenaImaniMaven | 59.5 | Held-out reconstruction | Official leaderboard | |
| 290 | Alsebay/Lorge-2x7B-UAMM | 59.4 | Held-out reconstruction | Official leaderboard | |
| 291 | Syed-Hasan-8503/Llama-3-8B-NOLA | 59.4 | Held-out reconstruction | Official leaderboard | |
| 292 | bunnycore/Blackbird-Llama-3-8B | 59.4 | Held-out reconstruction | Official leaderboard | |
| 293 | Locutusque/Hyperion-2.1-Mistral-7B | 59.4 | Held-out reconstruction | Official leaderboard | |
| 294 | chlee10/T3Q-Platypus-SOLAR | 59.4 | Held-out reconstruction | Official leaderboard | |
| 295 | AlanRobotics/nanobot_v1 | 59.3 | Held-out reconstruction | Official leaderboard | |
| 296 | abhishekchohan/mistral-7B-forest-dpo | 59.2 | Held-out reconstruction | Official leaderboard | |
| 297 | airesearch/typhoon-7b-WangchanX-sft-Demo | 59.2 | Held-out reconstruction | Official leaderboard | |
| 298 | Novocoders/Mistral-NeuralDPO-v0.5 | 59.2 | Held-out reconstruction | Official leaderboard | |
| 299 | Undi95/Meta-Llama-3-8B-hf | 59.0 | Held-out reconstruction | Official leaderboard | |
| 300 | jisukim8873/mistralai-case-2-0 | 59.0 | Held-out reconstruction | Official leaderboard | |
| 301 | NotAiLOL/Yi-1.5-9B-coder | 59.0 | Held-out reconstruction | Official leaderboard | |
| 302 | WDong/Qwen1.5-7B-sft-0502 | 59.0 | Held-out reconstruction | Official leaderboard | |
| 303 | andysalerno/rainbowfish-7B-v10 | 59.0 | Held-out reconstruction | Official leaderboard | |
| 304 | Intel/neural-chat-7b-v3-1 | 59.0 | Held-out reconstruction | Official leaderboard | |
| 305 | DUAL-GPO-2/phi-2-gpo-renew2-b0.001-v2-i1 | 58.7 | Held-out reconstruction | Official leaderboard | |
| 306 | NeuralNovel/Senzu-7B-v0.1-DPO | 58.5 | Held-out reconstruction | Official leaderboard | |
| 307 | Ichsan2895/Merak-7B-v5-PROTOTYPE1 | 58.5 | Held-out reconstruction | Official leaderboard | |
| 308 | chatty123/mistral_rank32_invert | 58.4 | Held-out reconstruction | Official leaderboard | |
| 309 | Isaak-Carter/J.O.S.I.E.3-Beta8-slerp | 58.3 | Held-out reconstruction | Official leaderboard | |
| 310 | KnutJaegersberg/Deacon-20B | 58.3 | Held-out reconstruction | Official leaderboard | |
| 311 | ABX-AI/Spicy-Laymonade-7B | 58.3 | Held-out reconstruction | Official leaderboard | |
| 312 | HenryJJ/Instruct_Mistral-7B-v0.1_Dolly15K | 58.3 | Held-out reconstruction | Official leaderboard | |
| 313 | allknowingroger/ANIMA-biodesign-7B-slerp | 58.2 | Held-out reconstruction | Official leaderboard | |
| 314 | awnr/Mistral-7B-v0.1-half-naive-A | 58.1 | Held-out reconstruction | Official leaderboard | |
| 315 | openaccess-ai-collective/mistral-7b-slimorcaboros | 58.1 | Held-out reconstruction | Official leaderboard | |
| 316 | JCX-kcuf/Mistral-7B-v0.1-gpt-4-20k | 58.1 | Held-out reconstruction | Official leaderboard | |
| 317 | MaziyarPanahi/Yarn-Mistral-7b-64k-Mistral-7B-Instruct-v0.1 | 58.0 | Held-out reconstruction | Official leaderboard | |
| 318 | vaiv/llamion-14b-base | 58.0 | Held-out reconstruction | Official leaderboard | |
| 319 | WDong/Qwen1.5-7B-sft-0506_9_8 | 58.0 | Held-out reconstruction | Official leaderboard | |
| 320 | awnr/Mistral-7B-v0.1-signtensors-1-over-2 | 58.0 | Held-out reconstruction | Official leaderboard | |
| 321 | jrruethe/balthazar-2x10.7b-v1 | 57.9 | Held-out reconstruction | Official leaderboard | |
| 322 | jondurbin/bagel-8x7b-v0.2 | 57.8 | Held-out reconstruction | Official leaderboard | |
| 323 | huseyinatahaninan/phi-2-instruction | 57.7 | Held-out reconstruction | Official leaderboard | |
| 324 | Mollel/Swahili_Gemma | 57.6 | Held-out reconstruction | Official leaderboard | |
| 325 | Mr-Bhaskar/fbt-gemma-7b | 57.5 | Held-out reconstruction | Official leaderboard | |
| 326 | NovoCode/Novocode7b-v3 | 57.5 | Held-out reconstruction | Official leaderboard | |
| 327 | alvarobartt/mistral-7b-orpo-capybara-reproduction | 57.4 | Held-out reconstruction | Official leaderboard | |
| 328 | SuperAGI/SAM | 57.4 | Held-out reconstruction | Official leaderboard | |
| 329 | maywell/Synatra-RP-Orca-2-7b-v0.1 | 57.2 | Held-out reconstruction | Official leaderboard | |
| 330 | ZhangShenao/0.0_zephyr_withdpo_4iters_bs128_5551lr_iter_4 | 57.2 | Held-out reconstruction | Official leaderboard | |
| 331 | TheBloke/orca_mini_v3_13B-GPTQ | 56.8 | Held-out reconstruction | Official leaderboard | |
| 332 | xi0v/aether-7b-chat-v1.0 | 56.7 | Held-out reconstruction | Official leaderboard | |
| 333 | ShenaoZhang/0.001_zephyr_5551_4iters_bs256_iter_4 | 56.5 | Held-out reconstruction | Official leaderboard | |
| 334 | macadeliccc/Opus-Samantha-Llama-3-8B | 56.3 | Held-out reconstruction | Official leaderboard | |
| 335 | ewqr2130/alignment-handbook-zephyr-7b-sft-full-dpo-5e7-cont1 | 56.3 | Held-out reconstruction | Official leaderboard | |
| 336 | maldv/dragonwar-7b-s1 | 56.3 | Held-out reconstruction | Official leaderboard | |
| 337 | ShenaoZhang/0.001_4iters_bs256_nodpo_only4w_iter_4 | 56.3 | Held-out reconstruction | Official leaderboard | |
| 338 | DeepMount00/Mistral-RAG | 56.3 | Held-out reconstruction | Official leaderboard | |
| 339 | Sao10K/L3-Solana-8B-v1 | 56.2 | Held-out reconstruction | Official leaderboard | |
| 340 | Langboat/Mengzi3-13B-Base | 56.1 | Held-out reconstruction | Official leaderboard | |
| 341 | yam-peleg/Hebrew-Mistral-7B | 56.1 | Held-out reconstruction | Official leaderboard | |
| 342 | HuggingFaceH4/mistral-7b-grok | 56.1 | Held-out reconstruction | Official leaderboard | |
| 343 | failspy/Llama-3-8B-Instruct-abliterated | 55.9 | Held-out reconstruction | Official leaderboard | |
| 344 | CreitinGameplays/ConvAI-9b | 55.9 | Held-out reconstruction | Official leaderboard | |
| 345 | BlueNipples/TimeCrystal-l2-13B | 55.9 | Held-out reconstruction | Official leaderboard | |
| 346 | NLUHOPOE/test-case-5 | 55.6 | Held-out reconstruction | Official leaderboard | |
| 347 | Norquinal/Mistral-7B-claude-instruct | 55.6 | Held-out reconstruction | Official leaderboard | |
| 348 | TeeZee/GALAXY_v03_slimorca_1_epoch_50k_DPO_1_epoch_30k | 55.5 | Held-out reconstruction | Official leaderboard | |
| 349 | ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDRejected-SFTChosen-Zephyr-7b-beta | 55.5 | Held-out reconstruction | Official leaderboard | |
| 350 | freeCS-dot-org/Zero-7B-test-3 | 55.5 | Held-out reconstruction | Official leaderboard | |
| 351 | NeverSleep/Noromaid-13b-v0.3 | 55.2 | Held-out reconstruction | Official leaderboard | |
| 352 | kyujinpy/SOLAR-Platypus-10.7B-v1 | 54.9 | Held-out reconstruction | Official leaderboard | |
| 353 | XuanXuanXuanXuan/Llama-2-13b-hf-gpt-4-80k | 54.6 | Held-out reconstruction | Official leaderboard | |
| 354 | CohereForAI/aya-23-8B | 54.5 | Held-out reconstruction | Official leaderboard | |
| 355 | vaiv/llamion-14b-chat | 54.5 | Held-out reconstruction | Official leaderboard | |
| 356 | vicgalleorg/TruthfulQwen1.5-4B | 54.4 | Held-out reconstruction | Official leaderboard | |
| 357 | arlineka/Brunhilde-13b-v1 | 54.3 | Held-out reconstruction | Official leaderboard | |
| 358 | ZoidBB/unraveled-7b-a1 | 54.3 | Held-out reconstruction | Official leaderboard | |
| 359 | Undi95/PsyMedRP-v1-20B | 54.2 | Held-out reconstruction | Official leaderboard | |
| 360 | BFauber/lora_llama2-13b_10e5_r8_a16 | 54.2 | Held-out reconstruction | Official leaderboard | |
| 361 | jefferylovely/AiMaven-Orca2 | 53.9 | Held-out reconstruction | Official leaderboard | |
| 362 | ArianAskari/SOLID-SFT-DPO-MixQV2-SOLIDChosen-SFTRejected-Zephyr-7b-beta | 53.9 | Held-out reconstruction | Official leaderboard | |
| 363 | pleisto/yuren-13b-chatml | 53.4 | Held-out reconstruction | Official leaderboard | |
| 364 | Technoculture/Medorca-2x7b | 53.2 | Held-out reconstruction | Official leaderboard | |
| 365 | TwT-6/open_llm_leaderboard_demo2 | 53.0 | Held-out reconstruction | Official leaderboard | |
| 366 | bn22/DolphinMini-Mistral-7B | 52.9 | Held-out reconstruction | Official leaderboard | |
| 367 | KatyTheCutie/EstopianMaid-13B | 52.8 | Held-out reconstruction | Official leaderboard | |
| 368 | namirocks/tutor-model-13b-ep3 | 52.6 | Held-out reconstruction | Official leaderboard | |
| 369 | CausalLM/7B-DPO-alpha | 52.6 | Held-out reconstruction | Official leaderboard | |
| 370 | royallab/PsyOrca2-13b-DARE | 52.6 | Held-out reconstruction | Official leaderboard | |
| 371 | ajibawa-2023/SlimOrca-Llama-3-8B | 52.3 | Held-out reconstruction | Official leaderboard | |
| 372 | Locutusque/Orca-2-13b-SFT-v6 | 52.2 | Held-out reconstruction | Official leaderboard | |
| 373 | llm-agents/tora-13b-v1.0 | 52.0 | Held-out reconstruction | Official leaderboard | |
| 374 | mayacinka/Open-StaMis-v02-stock | 51.9 | Held-out reconstruction | Official leaderboard | |
| 375 | Kquant03/Medusa-7B-bf16 | 51.8 | Held-out reconstruction | Official leaderboard | |
| 376 | euclaise/Ferret_7B | 51.6 | Held-out reconstruction | Official leaderboard | |
| 377 | KnutJaegersberg/webMistral-7B | 51.4 | Held-out reconstruction | Official leaderboard | |
| 378 | NLUHOPOE/Mistral-7B-random-100000 | 51.4 | Held-out reconstruction | Official leaderboard | |
| 379 | ajibawa-2023/Python-Code-13B | 51.4 | Held-out reconstruction | Official leaderboard | |
| 380 | hywu/Camelidae-8x7B | 51.3 | Held-out reconstruction | Official leaderboard | |
| 381 | abacusai/Giraffe-beta-13b-32k | 51.3 | Held-out reconstruction | Official leaderboard | |
| 382 | gmonsoon/MaxiCPM-3x3B-Test | 51.1 | Held-out reconstruction | Official leaderboard | |
| 383 | TheBloke/orca_mini_v3_7B-GPTQ | 50.9 | Held-out reconstruction | Official leaderboard | |
| 384 | Telugu-LLM-Labs/Telugu-Llama2-7B-v0-Instruct | 50.8 | Held-out reconstruction | Official leaderboard | |
| 385 | gmonsoon/MiniCPM-2B-Base | 50.4 | Held-out reconstruction | Official leaderboard | |
| 386 | Charlie911/vicuna-7b-v1.5-lora-mmlu-merged | 50.4 | Held-out reconstruction | Official leaderboard | |
| 387 | pansophic/new_model_test | 50.0 | Held-out reconstruction | Official leaderboard | |
| 388 | vikash06/doctorLLM | 50.0 | Held-out reconstruction | Official leaderboard | |
| 389 | DrNicefellow/Mixtral-6x7B-Instruct-v0.1-bfloat16-Trimmed024567 | 49.8 | Held-out reconstruction | Official leaderboard | |
| 390 | XuanXuanXuanXuan/Llama-2-7b-chat-hf-gpt-3.5-80k | 49.4 | Held-out reconstruction | Official leaderboard | |
| 391 | ewqr2130/llama_ppo_1e6step_4000 | 49.0 | Held-out reconstruction | Official leaderboard | |
| 392 | ericpolewski/AIRIC-The-Intern | 48.8 | Held-out reconstruction | Official leaderboard | |
| 393 | Charlie911/vicuna-7b-v1.5-general-temporal-merged | 48.6 | Held-out reconstruction | Official leaderboard | |
| 394 | Charlie911/zephyr-7b-beta-lora-mmlu-merged | 47.9 | Held-out reconstruction | Official leaderboard | |
| 395 | abdulrahman-nuzha/finetuned-llama-v2.0 | 47.8 | Held-out reconstruction | Official leaderboard | |
| 396 | GeneZC/MiniChat-2-3B | 47.7 | Held-out reconstruction | Official leaderboard | |
| 397 | ValiantLabs/Fireplace-13b | 47.6 | Held-out reconstruction | Official leaderboard | |
| 398 | abhishek/autotrain-8kfjk-b3gva | 47.3 | Held-out reconstruction | Official leaderboard | |
| 399 | rishiraj/smol-3b | 46.8 | Held-out reconstruction | Official leaderboard | |
| 400 | tricktreat/Llama-2-7b-chat-hf-guanaco-freeze-embed-tokens-q-v-proj-lora | 46.6 | Held-out reconstruction | Official leaderboard | |
| 401 | TeeZee/Buttocks-7B-v1.0 | 46.6 | Held-out reconstruction | Official leaderboard | |
| 402 | ibivibiv/multimaster-7b | 46.0 | Held-out reconstruction | Official leaderboard | |
| 403 | DeepMount00/Phi-3-Large-5.6b | 45.8 | Held-out reconstruction | Official leaderboard | |
| 404 | qnguyen3/quan-1.8b-chat | 44.7 | Held-out reconstruction | Official leaderboard | |
| 405 | Ritvik19/zephyr-2b-gemma-sft-qlora | 44.4 | Held-out reconstruction | Official leaderboard | |
| 406 | langgptai/Qwen-sft-ls-v0.1 | 44.3 | Held-out reconstruction | Official leaderboard | |
| 407 | stabilityai/stablelm-2-1_6b | 43.8 | Held-out reconstruction | Official leaderboard | |
| 408 | langgptai/Qwen-sft-la-v0.1 | 43.8 | Held-out reconstruction | Official leaderboard | |
| 409 | itsliupeng/openllama-7b-base | 43.6 | Held-out reconstruction | Official leaderboard | |
| 410 | abhinand/tamil-llama-7b-instruct-v0.1 | 43.3 | Held-out reconstruction | Official leaderboard | |
| 411 | jisukim8873/falcon-7B-case-5 | 43.1 | Held-out reconstruction | Official leaderboard | |
| 412 | kalisai/Nusantara-4b-Indo-Chat | 42.9 | Held-out reconstruction | Official leaderboard | |
| 413 | raincandy-u/Coder1.8-ORPO-TEST | 42.9 | Held-out reconstruction | Official leaderboard | |
| 414 | pmking27/PrathameshLLM-2B | 42.1 | Held-out reconstruction | Official leaderboard | |
| 415 | Telugu-LLM-Labs/Indic-gemma-2b-finetuned-sft-Navarasa-2.0 | 42.1 | Held-out reconstruction | Official leaderboard | |
| 416 | Zangs3011/falcon_7b_DolphinCoder | 41.0 | Held-out reconstruction | Official leaderboard | |
| 417 | sartifyllc/dociproLLM-7B | 40.9 | Held-out reconstruction | Official leaderboard | |
| 418 | Qwen/Qwen1.5-1.8B-Chat | 40.6 | Held-out reconstruction | Official leaderboard | |
| 419 | vihangd/dopeyshearedplats-2.7b-v1 | 40.6 | Held-out reconstruction | Official leaderboard | |
| 420 | csujeong/Falcon-7B-Fintued-Finance-Stock-E | 40.5 | Held-out reconstruction | Official leaderboard | |
| 421 | mwitiderrick/shearedplats-2.7b-v2-instruct-v0.1 | 39.8 | Held-out reconstruction | Official leaderboard | |
| 422 | cyberagent/calm2-7b-chat | 39.7 | Held-out reconstruction | Official leaderboard | |
| 423 | Heng666/EastAsia-4x7B-Moe-experiment | 39.1 | Held-out reconstruction | Official leaderboard | |
| 424 | aloobun/open-llama-3b-v2-elmv3 | 39.1 | Held-out reconstruction | Official leaderboard | |
| 425 | M4-ai/NeuralReyna-Mini-1.8B-v0.3 | 39.1 | Held-out reconstruction | Official leaderboard | |
| 426 | Pierre-obi/Mistral_solar-slerp | 38.8 | Held-out reconstruction | Official leaderboard | |
| 427 | xaviviro/FLAMA-0.5-3B | 38.4 | Held-out reconstruction | Official leaderboard | |
| 428 | mwitiderrick/open_llama_3b_glaive_assistant_v0.1 | 37.7 | Held-out reconstruction | Official leaderboard | |
| 429 | deepseek-ai/deepseek-coder-6.7b-base | 37.7 | Held-out reconstruction | Official leaderboard | |
| 430 | raidhon/coven_tiny_1.1b_32k_orpo_alpha | 36.3 | Held-out reconstruction | Official leaderboard | |
| 431 | ddyuudd/merge_dolly-v2-3b_dpo_test | 36.0 | Held-out reconstruction | Official leaderboard | |
| 432 | RESMPDEV/Qwen1.5-Wukong-0.5B | 35.6 | Held-out reconstruction | Official leaderboard | |
| 433 | cognitivecomputations/TinyDolphin-2.8.1-1.1b | 35.4 | Held-out reconstruction | Official leaderboard | |
| 434 | alnrg2arg/blockchainlabs_tinyllama_fusion_LHK_yunkong_v2 | 35.1 | Held-out reconstruction | Official leaderboard | |
| 435 | Josephgflowers/TinyLlama-Cinder-Agent-Rag | 34.9 | Held-out reconstruction | Official leaderboard | |
| 436 | Josephgflowers/TinyLlama-Cinder-1.3B-Test.2 | 34.8 | Held-out reconstruction | Official leaderboard | |
| 437 | ppopiolek/tinyllama_eng_short | 34.8 | Held-out reconstruction | Official leaderboard | |
| 438 | kevin009/babyllama-v0.6 | 34.6 | Held-out reconstruction | Official leaderboard | |
| 439 | l3utterfly/tinyllama-1.1b-layla-v4 | 34.5 | Held-out reconstruction | Official leaderboard | |
| 440 | vihangd/shearedplats-1.3b-v1 | 34.2 | Held-out reconstruction | Official leaderboard | |
| 441 | ewqr2130/TinyLamma-SFT | 34.1 | Held-out reconstruction | Official leaderboard | |
| 442 | abhinand/TinyLlama-1.1B-OpenHermes-2.5-Chat-v0.1-sft | 34.1 | Held-out reconstruction | Official leaderboard | |
| 443 | KnutJaegersberg/platypus-1_8b | 34.0 | Held-out reconstruction | Official leaderboard | |
| 444 | KnutJaegersberg/falcon-1b-t-sft | 34.0 | Held-out reconstruction | Official leaderboard | |
| 445 | HuggingFaceTB/cosmo-1b | 33.9 | Held-out reconstruction | Official leaderboard | |
| 446 | ToastyPigeon/SmolPlatypus-1.5B-Sorted | 33.8 | Held-out reconstruction | Official leaderboard | |
| 447 | nnpy/Nape-0 | 33.7 | Held-out reconstruction | Official leaderboard | |
| 448 | Ramikan-BR/tinyllama-coder-py-4bit-v10 | 33.3 | Held-out reconstruction | Official leaderboard | |
| 449 | jeff31415/TinyLlama-1.1B-1.5T-OpenOrca-Alpha | 33.1 | Held-out reconstruction | Official leaderboard | |
| 450 | Abhaykoul/OEvortex | 32.7 | Held-out reconstruction | Official leaderboard | |
| 451 | Dans-DiscountModels/ShearedLlama-1.3b-FFT-Test1 | 32.4 | Held-out reconstruction | Official leaderboard | |
| 452 | Josephgflowers/Qllama-.5B-Base-Wiki-Chat-RAG | 31.9 | Held-out reconstruction | Official leaderboard | |
| 453 | gpt2-xl | 30.8 | Held-out reconstruction | Official leaderboard | |
| 454 | raincandy-u/Quark-464M-v0.2 | 30.4 | Held-out reconstruction | Official leaderboard | |
| 455 | gemmathon/gemma-2b-ko-v0 | 28.7 | Held-out reconstruction | Official leaderboard | |
| 456 | deepseek-ai/deepseek-coder-1.3b-instruct | 28.6 | Held-out reconstruction | Official leaderboard | |
| 457 | Josephgflowers/Tinyllama-616M-Cinder-DPO-With-GGUF | 28.5 | Held-out reconstruction | Official leaderboard | |
| 458 | Sharathhebbar24/Instruct_GPT_v1 | 27.9 | Held-out reconstruction | Official leaderboard | |
| 459 | Isotonic/smol_llama-4x220M-MoE | 26.5 | Held-out reconstruction | Official leaderboard | |
| 460 | ethzanalytics/pythia-31m | 26.4 | Held-out reconstruction | Official leaderboard | |
| 461 | Sharathhebbar24/math_gpt2 | 26.3 | Held-out reconstruction | Official leaderboard | |
| 462 | Felladrin/Minueza-32M-UltraChat | 26.2 | Held-out reconstruction | Official leaderboard | |
| 463 | wannaphong/numfalm-3b | 25.8 | Held-out reconstruction | Official leaderboard | |
| 464 | Facebook/OPT-125M | 25.5 | Held-out reconstruction | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 76.7 | Held-out reconstruction | Apr 2024 | Official leaderboard |
| 2 | | 67.2 | Held-out reconstruction | May 2024 | Official leaderboard |
| 3 | | 64.3 | Held-out reconstruction | Nov 2023 | Official leaderboard |
| 4 | | 63.7 | Held-out reconstruction | Feb 2024 | Official leaderboard |
| 5 | | 61.2 | Held-out reconstruction | Feb 2024 | Official leaderboard |
Rankings by part
We read 6 parts from the benchmark’s own leaderboard, each ranking models on one part of the test, such as ARC, GSM8K and HellaSwag. Mixtral 8x22B leads every one of them. Arrows show how far a model moved from its overall rank among the models we track.
ARC
5 models we track have a score here.
- 1
Mixtral 8x22B 75.2
- 2
Qwen1.5-72B ↑3 72.3
- 3
Starling-LM-7B-alpha 71.3
- 4
Yi-1.5-9B-Chat ↓2 60.4
- 5
Qwen1.5-14B ↓1 50.5
GSM8K
5 models we track have a score here.
- 1
Mixtral 8x22B 87.2
- 2
Yi-1.5-9B-Chat 77.6
- 3
Qwen1.5-14B ↑1 71.2
- 4
Starling-LM-7B-alpha ↓1 64.8
- 5
Qwen1.5-72B 18.4
HellaSwag
5 models we track have a score here.
- 1
Mixtral 8x22B 81.4
- 2
Starling-LM-7B-alpha ↑1 74.6
- 3
Qwen1.5-72B ↑2 72.9
- 4
Qwen1.5-14B 67.8
- 5
Yi-1.5-9B-Chat ↓3 67.8
MMLU
5 models we track have a score here.
- 1
Mixtral 8x22B 89.3
- 2
Qwen1.5-72B ↑3 86.4
- 3
Yi-1.5-9B-Chat ↓1 83.5
- 4
Qwen1.5-14B 80.6
- 5
Starling-LM-7B-alpha ↓2 70.9
TruthfulQA
5 models we track have a score here.
- 1
Mixtral 8x22B 59.1
- 2
Qwen1.5-72B ↑3 49.6
- 3
Yi-1.5-9B-Chat ↓1 35.8
- 4
Qwen1.5-14B 28.5
- 5
Starling-LM-7B-alpha ↓2 26.3
WinoGrande
5 models we track have a score here.
- 1
Mixtral 8x22B 92.5
- 2
Starling-LM-7B-alpha ↑1 86.9
- 3
Qwen1.5-72B ↑2 79.4
- 4
Yi-1.5-9B-Chat ↓2 78.5
- 5
Qwen1.5-14B ↓1 71.0
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Source: Official metabench leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Source: Official metabench leaderboard
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Other
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Claude Fable 5.2 64.6
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Vals Science Index In use Agents are scored on the equal average of BioMysteryBench, MysteryMechanism and Terminal-Bench-Science. GPT-6.2 Astra 68.4%
- Decision Index Public v0.3 In use Decision models return probabilities over labeled options in public tasks covering knowledge, language, retrieval, tools, and arts. A chance-corrected weighted aggregate combines the task scores. Granite Switch 4.1 30B 51.3
- SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
Qwen3-Embedding-8B 72.2%
Data audit
8 of 9 checks pass, 1 warning. Look first at the Newest score check. The newest came 2 years ago, in May 2024, for Yi-1.5-9B-Chat. Every benchmark
Catalog record 2 pass
- Pass Task access All tasks are public.
- Pass Confidence Checked against a primary source.
Scores 1 warning 2 pass 2 notes
- Pass Independent runs Scores from the official leaderboard (464 entries).
- Pass Models scored 5 models we track, plus 459 other entries on its leaderboard.
- Warning Newest score The newest came 2 years ago, in May 2024, for Yi-1.5-9B-Chat.
- Note Frontier models None of the top 10 has a score. The strongest tested is Mixtral 8x22B (#189).
- Note Headroom Scored as a plain number, with no fixed ceiling.
Leaderboard import 3 pass
- Pass Importer We read the board on github.com: 5 rows for models we track and 459 other entries at the last read.
- Pass Last read November 20th, 2026.
- Pass Read worked The last read worked.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.