Decision Index
karpo-decision-31B 73.9 tops its leaderboard 
Gemma 4 31B IT 67.6 leads the models we track
Not in model cards Gemma 4 31B IT 67.6 leads the models we track Decision models read a state and a typed question and return a decision. The index weights private same-skill sets and new-domain sets, equated on 21 base models.
Tracks reproductions of TypeSafe's Jev decision model. Version 0.4.1 board lists 248 entries. A separate vision board exists.
- Released
- September 2026
- Kind
- Composite indices
- Level
- Everyday
- Scored
- Checked automatically
- Answers
- Prediction
- Tasks
- Public, plus a private test set
- Strongest model tested
-
Qwen 3.8 27B #58 on the capability index - Last model added
- August 2026
- Scores refreshed
- November 12th, 2026
297
Entries on its own leaderboard, 3 models we track
karpo-decision-31B tops the leaderboard with 73.9
Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders. The best model we track is Gemma 4 31B IT, at 67.6.
The newest model with a score here came out in August 2026, and nobody has tested a newer one. Among the 20 highest-ranked models on the capability index, these have no score yet:
- Claude Fable 5.2
- Gemini 4 Carbon
- GPT-6 Astra
- Claude Opus 5.5
- and 16 more
- 73.9 karpo-decision-31B
- 73.4 GLiDE 27B
- 72.6 REAX 1.3
- 72.3 Logits Sigma-1 Duo
- 72.1 Copernicus-31B
- 71.9 KnowLine 31B Gen1.5
- 71.8 Copernicus-57B
- 71.6 FlexDM-LoRA 2.1 · Gemma-4-31B
- 71.1 Sieve 31B v3
- 70.9 OneJev1.6g-31B
- 70.5 Turion Jev 31B
- 70.3 eshbar-lulilla (Gemma 4 31B)
- 70.3 Jeffan-27B-1211
- 70.2 vLLM-SR d3-ultra (Decision 3.0, 27B)
- 70.0 Bespoke Nimble v4.1 Max (27B)
- 69.9 H2O Lightning 31B v1.3.0
- 69.8 Jeffan-31b-1710
- 69.5 Logits Sigma-1
- 69.1 liquamen (Gemma 4 31B)
- 69.0 Cerno 27B v1.1
- 68.5 WeMM-JEV-27B
- 68.4 baselabs mammoth-1 (27B)
- 68.4 Piccolo 27B
- 68.2 Ainvest-Decision-27B v1.0
- 68.1 oenogarum (Gemma 4 31B)
- 68.0 Perplexity Decider v1.2 (27B)
- 68.0 AutoTrust-JEV-27B v1.1
- 67.9 StartLux-Decision v1.1 27B
- 67.7 Perplexity Decider v1.3 (27B)
- 67.6 MISA AI 2.0 Decision Plus · oak 1.1 (31B)
- 67.6 AJev lm6q (Gemma 4 31B)
- 67.6 Gemma 4 31B IT
- 67.5 Chon-1.1-31B
- 67.5 decy-preview (31B)
- 67.3 Lychee-27B
- 67.3 vLLM-SR d3-turbo v1.1 (27B)
- 67.2 vLLM-SR d3 (27B)
- 67.0 allec-oavg (Gemma 4 31B)
- 66.9 VisionJEV 1.0.0 (27B)
- 66.7 Aleria Judge 1.1.1 (Gemma 4 31B)
- 66.6 Nace.AI Drex Max v1 (27B)
- 66.5 AnyJev Tacitus 31B
- 66.3 vera-large-2o
- 66.0 Decider 31B (NVFP4)
- 65.8 KnowLine 35B-A3B Gen1.5
- 65.7 OneShot 27B
- 65.2 Valen-Decision 1.5 27B
- 64.8 Bobcat 1.3 (31B)
- 64.8 Amos 1 Large (27B)
- 64.8 Matilda Decision v1
- 64.6 KnowLine 26B-A4B Gen2.5
- 64.4 frontier-infra Jebadiah 27B v2.1 (t1e)
- 64.2 Darwin-27B-RSI-Decision
- 63.0 deck31b (Gemma 4 31B)
- 62.7 decisio 0.6.0 (Gemma 4 31B)
- 62.5 GLiDE 9B
- 61.5 Torchcast Decision 27B
- 61.5 Jeffan-9B-1211
- 61.5 OneJev1.6-27B
- 61.1 Qwen Decision 27B noncausal LoRA
- 60.8 Quyet-1.0-Large
- 60.3 garum (Gemma 4 31B)
- 60.3 baselabs elephant-1 (9B)
- 60.1 Standard One 35B SH (v1)
- 60.1 NTele-Hybrid-27B-v1
- 60.0 Lumma-fev-27B
- 59.9 Sieve 27B v2
- 59.8 mogan-decision-31B-it
- 59.6 linne-fern 1.0 (27B)
- 59.6 Kev 27B
- 59.4 Xor 26B-A4B v1.2
- 59.2 Jev 1.13
- 59.2 Adjudex-9B v5
- 59.1 span-02 (Gemma 4 26B-A4B)
- 59.0 Cerno 9B v1.2
- 59.0 garas (Gemma 4 31B)
- 58.8 Shisa DE-2.1 (repeat)
- 58.8 Eikos-27B
- 58.8 reflex Qwen3.8-27B-FP8 (pmscr)
- 58.6 RSI-Jev v6.1 VL 27B (effort auto)
- 58.4 KnowLine 9B Gen1
- 58.4 H2O Lightning Bolt 74B v1.1
- 58.1 StartLux-Decision v1.1 9B
- 58.0 vLLM-SR Decision 2.0 Vega 27B
- 57.6 JEV-35B
- 57.4 JEV-27B
- 57.3 Piccolo 9B
- 57.0 Qwen 3.8 27B
- 56.6 Tern-35B-A3B
- 56.4 Surogate Rune 26B-A4B v3
- 56.2 SynACK Decide 26B-A4B v7
- 56.0 KnowLine 4B Gen5.5
- 55.9 Blink v0.3 26B-A4B (NVFP4)
- 55.9 Valen-Decision 1.5 9B
- 55.6 JADE
- 55.4 Dexy-Decision-9B-V2
- 55.4 Wald-26B-A4B
- 55.3 AJev lora1 (Gemma 4 26B-A4B)
- 55.1 Perplexity Decider Flash v1.3 (4B)
- 54.9 Cloudflare clef
- 54.8 StartLux-Decision v1.1 4B
- 54.7 Qwen3.6 27B
- 54.3 Perplexity Decider Flash v1.2 (4B)
- 54.3 vLLM-SR d3-flash (9B)
- 54.1 JPT-35B-A3B
- 54.0 chinese-decision-pointer-4b
- 53.9 Cerno 4B v1.2
- 53.6 Xor 1.2
- 53.5 GEV-26B-Decide
- 53.0 OneJev1.6-9B
- 53.0 vera-medium-omni
- 52.8 Senova-4B v4
- 52.8 Nace.AI Drex v2.0 (35B-A3B)
- 52.5 muria (Gemma 4 12B)
- 52.2 Jeffan-4B-2010
- 52.0 Verdin-4B v1.1
- 51.9 LatentMesh Blitz 4B v1
- 51.7 Saif 4B v2
- 51.1 vev-4b-v2
- 51.1 Bespoke Nimble 9B v3
- 50.9 frontier-infra Jebadiah 9B v2.1 (t1e)
- 50.8 decisio 0.4.0 (Qwen3.6-35B-A3B)
- 50.0 Piccolo 4B
- 50.0 vLLM-SR d3-mini (4B)
- 49.9 RSI-Jev v7.0 VL 4B
- 49.9 Valen-Decision 1.5 4B
- 49.8 Jegue 0.2 (9B)
- 49.7 RSI-Jev v7.0 VL 3B
- 49.5 JoshuaSP diffusiongemma (open-jev)
- 48.9 AJev lora7 (Gemma 4 12B)
- 48.9 OneJev1.6-4B
- 48.8 decisio 0.4.0 (Gemma 4 12B)
- 48.5 BaseDecision-Dyno (4B)
- 48.0 H2O Lightning E4B v1.0.1
- 47.7 Mica v0.5 4B
- 47.5 PurpleMIST-Flash-1.0
- 47.0 Sieve 9B v2
- 46.6 Decider 35B-A3B
- 46.6 Winnow-12B
- 46.3 Seb-9B v2
- 46.2 PurpleMIST-Mini-2.0
- 46.0 vLLM-SR Decision 2.0 Lux 9B
- 45.8 Nace.AI Drex v1.5
- 45.8 Hopper 12B (trained)
- 45.6 Trio-Spark DI (9B)
- 45.6 Jevora 9B v1.6
- 45.5 CoCo-Decision-4B 2.4
- 45.0 Cloudflare clef-omni (30B-A3B)
- 44.9 JevK5 9B v0.3.3
- 44.4 Cloudflare clef-flash
- 44.4 Jevfire
- 44.1 jiwo 4B v2
- 44.1 JPT-9B
- 43.9 ezjev 4B s2
- 43.8 Jev-Omni
- 43.7 GLiDE 2B
- 43.2 Solomon v1.1
- 42.9 Standard One 8B SH (v4)
- 42.7 Amber Hybrid 4B
- 42.1 JEV-9B
- 42.1 Bespoke Nimble 9B v2
- 41.7 Sieve 9B
- 41.0 Sieve 4B
- 40.9 Kev 9B v2
- 40.9 Nari Decision 4B v3.2
- 40.8 Aplomb 1
- 40.8 vLLM-SR Decision 2.0 Nox 4B
- 40.2 Hopper (G) 1.2
- 40.1 StartLux-Decision v1.1 2B
- 39.8 FlyMy.AI Decision 4B v1.6
- 39.8 Standard One 3B SH (v4)
- 39.6 JPT-4B
- 39.5 Amber 4B
- 38.7 Intern-Decision-4B
- 38.1 djev
- 38.1 KnowLine 2B Gen1
- 38.0 Valen-Decision 1.5 2B
- 37.6 razorback16 openjev diffusiongemma (NVFP4, vLLM)
- 37.3 NeoHorse-Jev-4B
- 36.6 JevK5 v0.3
- 36.4 GLiDE 0.8B
- 36.3 Decider 4B
- 35.9 baselabs joey-1 (2B)
- 35.5 lev
- 35.4 Lev1 3.7B
- 35.1 Jev-Style 2B v4.2
- 34.9 Kev 4B r10
- 34.8 PKU-KCL-Meteor-2B
- 34.5 Sieve 2B v3
- 34.4 LatentMesh Blitz 2B v1
- 34.4 Saracura PT-BR 4B
- 34.4 LiquidAI d1-2B
- 34.4 Cam1
- 34.3 vLLM-SR d3-nano (2B)
- 34.3 mmastrac diffusiongemma (vLLM PR 57250)
- 34.0 Kas 4B
- 33.8 GLiDE 0.4B
- 33.7 Tev1-4B-experimental
- 33.6 LiquidAI d1-Omni-2B
- 32.8 Adjudex-0.8B v5
- 32.7 Winnow-E4B
- 32.5 Aurelis-2B
- 32.5 GLiClass v4.1 edge (0.4B)
- 32.2 Jevstral 8B
- 32.2 Metask-Jev-4B
- 32.0 Ryotide Qwen v0.3.1
- 31.3 Intelif Qwen3-4B
- 31.1 LiquidAI d1-3B
- 31.1 open-jev (pngwn)
- 30.9 PKU-KCL-Meteor-0.8B
- 30.6 vera-core-2
- 30.4 Jobe
- 29.6 OneJev1.6-0.8B
- 29.4 crystal-0.8b
- 29.4 MoDe-L
- 29.3 vLLM-SR vela3-fast (Vela 3.0, 0.4B)
- 29.3 Crivo-1B
- 29.2 KnowLine 0.8B Gen1
- 29.2 Gevva E4B
- 28.9 StartLux-Decision v1.1 0.8B
- 28.8 openvons
- 27.8 Amber 0.4B v2
- 27.6 Valen-Decision 1.5 0.8B
- 26.7 SemIf
- 26.5 Saina Helm 2 Omni (0.8B)
- 26.5 MoDe-M
- 26.4 Saif 0.8B Lightning v0.3
- 26.2 vLLM-SR d3-lite (0.8B)
- 25.8 jiwo 0.8B v2
- 25.3 Saina Helm 2.0 v2
- 24.9 this-that 1.2
- 24.7 Amber 150M
- 24.5 MoDe-S
- 24.3 Gevva E2B
- 23.7 Crivo-400M
- 23.6 Decider 2B
- 23.6 vLLM-SR Decision 2.0 Sol 2B
- 23.6 jdi-ptr14-0.8b
- 22.8 mini-jev
- 22.1 vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B)
- 21.9 Sieve 2B
- 21.5 wyat-1-800m
- 20.9 Intern-Decision-2B
- 20.8 Sieve 0.8B
- 20.7 Strands Decider 2B
- 20.6 EXAONE-4.0-1.2B-JEV v0.3
- 19.9 tasksource Decider nano v5 (150M)
- 19.5 Crivo-68M
- 19.2 Amber 68M
- 18.5 JEV Ettin 150M
- 18.4 vLLM-SR Decision 2.0 Eos 0.8B
- 18.3 Crivo-150M v2
- 18.0 Bekko System One v0 400M
- 17.8 Mola-150M
- 17.7 vLLM-SR d3-edge (0.6B)
- 17.6 Mola-68M
- 17.3 JEV FLAN-T5 Large public v2 (342M)
- 17.2 DecisionTune 1.0
- 16.5 Bosun v3.1 1.7B
- 16.4 vLLM-SR Decision 2.0 Kai 0.6B
- 16.4 Dinah-1
- 16.3 Kev 0.8B r15
- 16.0 Amber 32M
- 15.6 PICK-150M v5
- 15.5 JPT-0.8B
- 15.2 JEV Ettin 400M
- 14.5 Sifr 0.8B v3.1
- 14.2 Crivo-32M v2
- 14.0 Prumo
- 13.9 Kodiak v0.2 1B (accuracy)
- 12.7 Intern-Decision-0.8B
- 12.5 Jev-Style 0.8B v3
- 12.5 Tev1-0.8B-experimental
- 12.4 Bekko System One v0 68M
- 12.0 Amber 17M
- 11.8 LiquidAI d1-omni-600M
- 11.7 Crivo-17M
- 11.7 Von 1.3
- 11.0 Bosun v3.1 0.6B
- 11.0 vera-spark
- 10.8 Lavoir
- 10.1 GLiNER2.5-Decide
- 9.2 Laya
- 8.8 JevK5 Lite
- 8.2 LFM2.5-2.6B-RLCD
- 7.8 Qwen-2.5-1B-RLCD
- 7.7 Bekko System One v0 17M
- 7.4 EmbeddingGemma 2 System-One
- 6.5 CLM-v0.1-8B
- 6.2 jeff
- 5.9 LFM2.5-350M-RLCD
- 5.2 system-one-gemma
- 5.0 DM-JEPA 1.1
- 4.8 Julia 1
- 3.5 Nirnaya 0.4B
- 3.4 Zev
- 2.0 Verdict
- 1 karpo-decision-31B 73.9
- 2 GLiDE 27B 73.4
- 3 REAX 1.3 72.6
- 4 Logits Sigma-1 Duo 72.3
- 5 Copernicus-31B 72.1
- 6 KnowLine 31B Gen1.5 71.9
- 7 Copernicus-57B 71.8
- 8 FlexDM-LoRA 2.1 · Gemma-4-31B 71.6
- 9 Sieve 31B v3 71.1
- 10 OneJev1.6g-31B 70.9
- 11 Turion Jev 31B 70.5
- 12 eshbar-lulilla (Gemma 4 31B) 70.3
- 13 Jeffan-27B-1211 70.3
- 14 vLLM-SR d3-ultra (Decision 3.0, 27B) 70.2
- 15 Bespoke Nimble v4.1 Max (27B) 70.0
- 16 H2O Lightning 31B v1.3.0 69.9
- 17 Jeffan-31b-1710 69.8
- 18 Logits Sigma-1 69.5
- 19 liquamen (Gemma 4 31B) 69.1
- 20 Cerno 27B v1.1 69.0
- 21 WeMM-JEV-27B 68.5
- 22 baselabs mammoth-1 (27B) 68.4
- 23 Piccolo 27B 68.4
- 24 Ainvest-Decision-27B v1.0 68.2
- 25 oenogarum (Gemma 4 31B) 68.1
- 26 Perplexity Decider v1.2 (27B) 68.0
- 27 AutoTrust-JEV-27B v1.1 68.0
- 28 StartLux-Decision v1.1 27B 67.9
- 29 Perplexity Decider v1.3 (27B) 67.7
- 30 MISA AI 2.0 Decision Plus · oak 1.1 (31B) 67.6
- 31 AJev lm6q (Gemma 4 31B) 67.6
- 32 Gemma 4 31B IT 67.6
- 33 Chon-1.1-31B 67.5
- 34 decy-preview (31B) 67.5
- 35 Lychee-27B 67.3
- 36 vLLM-SR d3-turbo v1.1 (27B) 67.3
- 37 vLLM-SR d3 (27B) 67.2
- 38 allec-oavg (Gemma 4 31B) 67.0
- 39 VisionJEV 1.0.0 (27B) 66.9
- 40 Aleria Judge 1.1.1 (Gemma 4 31B) 66.7
- 41 Nace.AI Drex Max v1 (27B) 66.6
- 42 AnyJev Tacitus 31B 66.5
- 43 vera-large-2o 66.3
- 44 Decider 31B (NVFP4) 66.0
- 45 KnowLine 35B-A3B Gen1.5 65.8
- 46 OneShot 27B 65.7
- 47 Valen-Decision 1.5 27B 65.2
- 48 Bobcat 1.3 (31B) 64.8
- 49 Amos 1 Large (27B) 64.8
- 50 Matilda Decision v1 64.8
- 51 KnowLine 26B-A4B Gen2.5 64.6
- 52 frontier-infra Jebadiah 27B v2.1 (t1e) 64.4
- 53 Darwin-27B-RSI-Decision 64.2
- 54 deck31b (Gemma 4 31B) 63.0
- 55 decisio 0.6.0 (Gemma 4 31B) 62.7
- 56 GLiDE 9B 62.5
- 57 Torchcast Decision 27B 61.5
- 58 Jeffan-9B-1211 61.5
- 59 OneJev1.6-27B 61.5
- 60 Qwen Decision 27B noncausal LoRA 61.1
- 61 Quyet-1.0-Large 60.8
- 62 garum (Gemma 4 31B) 60.3
- 63 baselabs elephant-1 (9B) 60.3
- 64 Standard One 35B SH (v1) 60.1
- 65 NTele-Hybrid-27B-v1 60.1
- 66 Lumma-fev-27B 60.0
- 67 Sieve 27B v2 59.9
- 68 mogan-decision-31B-it 59.8
- 69 linne-fern 1.0 (27B) 59.6
- 70 Kev 27B 59.6
- 71 Xor 26B-A4B v1.2 59.4
- 72 Jev 1.13 59.2
- 73 Adjudex-9B v5 59.2
- 74 span-02 (Gemma 4 26B-A4B) 59.1
- 75 Cerno 9B v1.2 59.0
- 76 garas (Gemma 4 31B) 59.0
- 77 Shisa DE-2.1 (repeat) 58.8
- 78 Eikos-27B 58.8
- 79 reflex Qwen3.8-27B-FP8 (pmscr) 58.8
- 80 RSI-Jev v6.1 VL 27B (effort auto) 58.6
- 81 KnowLine 9B Gen1 58.4
- 82 H2O Lightning Bolt 74B v1.1 58.4
- 83 StartLux-Decision v1.1 9B 58.1
- 84 vLLM-SR Decision 2.0 Vega 27B 58.0
- 85 JEV-35B 57.6
- 86 JEV-27B 57.4
- 87 Piccolo 9B 57.3
- 88 Qwen 3.8 27B 57.0
- 89 Tern-35B-A3B 56.6
- 90 Surogate Rune 26B-A4B v3 56.4
- 91 SynACK Decide 26B-A4B v7 56.2
- 92 KnowLine 4B Gen5.5 56.0
- 93 Blink v0.3 26B-A4B (NVFP4) 55.9
- 94 Valen-Decision 1.5 9B 55.9
- 95 JADE 55.6
- 96 Dexy-Decision-9B-V2 55.4
- 97 Wald-26B-A4B 55.4
- 98 AJev lora1 (Gemma 4 26B-A4B) 55.3
- 99 Perplexity Decider Flash v1.3 (4B) 55.1
- 100 Cloudflare clef 54.9
- 101 StartLux-Decision v1.1 4B 54.8
- 102 Qwen3.6 27B 54.7
- 103 Perplexity Decider Flash v1.2 (4B) 54.3
- 104 vLLM-SR d3-flash (9B) 54.3
- 105 JPT-35B-A3B 54.1
- 106 chinese-decision-pointer-4b 54.0
- 107 Cerno 4B v1.2 53.9
- 108 Xor 1.2 53.6
- 109 GEV-26B-Decide 53.5
- 110 OneJev1.6-9B 53.0
- 111 vera-medium-omni 53.0
- 112 Senova-4B v4 52.8
- 113 Nace.AI Drex v2.0 (35B-A3B) 52.8
- 114 muria (Gemma 4 12B) 52.5
- 115 Jeffan-4B-2010 52.2
- 116 Verdin-4B v1.1 52.0
- 117 LatentMesh Blitz 4B v1 51.9
- 118 Saif 4B v2 51.7
- 119 vev-4b-v2 51.1
- 120 Bespoke Nimble 9B v3 51.1
- 121 frontier-infra Jebadiah 9B v2.1 (t1e) 50.9
- 122 decisio 0.4.0 (Qwen3.6-35B-A3B) 50.8
- 123 Piccolo 4B 50.0
- 124 vLLM-SR d3-mini (4B) 50.0
- 125 RSI-Jev v7.0 VL 4B 49.9
- 126 Valen-Decision 1.5 4B 49.9
- 127 Jegue 0.2 (9B) 49.8
- 128 RSI-Jev v7.0 VL 3B 49.7
- 129 JoshuaSP diffusiongemma (open-jev) 49.5
- 130 AJev lora7 (Gemma 4 12B) 48.9
- 131 OneJev1.6-4B 48.9
- 132 decisio 0.4.0 (Gemma 4 12B) 48.8
- 133 BaseDecision-Dyno (4B) 48.5
- 134 H2O Lightning E4B v1.0.1 48.0
- 135 Mica v0.5 4B 47.7
- 136 PurpleMIST-Flash-1.0 47.5
- 137 Sieve 9B v2 47.0
- 138 Decider 35B-A3B 46.6
- 139 Winnow-12B 46.6
- 140 Seb-9B v2 46.3
- 141 PurpleMIST-Mini-2.0 46.2
- 142 vLLM-SR Decision 2.0 Lux 9B 46.0
- 143 Nace.AI Drex v1.5 45.8
- 144 Hopper 12B (trained) 45.8
- 145 Trio-Spark DI (9B) 45.6
- 146 Jevora 9B v1.6 45.6
- 147 CoCo-Decision-4B 2.4 45.5
- 148 Cloudflare clef-omni (30B-A3B) 45.0
- 149 JevK5 9B v0.3.3 44.9
- 150 Cloudflare clef-flash 44.4
- 151 Jevfire 44.4
- 152 jiwo 4B v2 44.1
- 153 JPT-9B 44.1
- 154 ezjev 4B s2 43.9
- 155 Jev-Omni 43.8
- 156 GLiDE 2B 43.7
- 157 Solomon v1.1 43.2
- 158 Standard One 8B SH (v4) 42.9
- 159 Amber Hybrid 4B 42.7
- 160 JEV-9B 42.1
- 161 Bespoke Nimble 9B v2 42.1
- 162 Sieve 9B 41.7
- 163 Sieve 4B 41.0
- 164 Kev 9B v2 40.9
- 165 Nari Decision 4B v3.2 40.9
- 166 Aplomb 1 40.8
- 167 vLLM-SR Decision 2.0 Nox 4B 40.8
- 168 Hopper (G) 1.2 40.2
- 169 StartLux-Decision v1.1 2B 40.1
- 170 FlyMy.AI Decision 4B v1.6 39.8
- 171 Standard One 3B SH (v4) 39.8
- 172 JPT-4B 39.6
- 173 Amber 4B 39.5
- 174 Intern-Decision-4B 38.7
- 175 djev 38.1
- 176 KnowLine 2B Gen1 38.1
- 177 Valen-Decision 1.5 2B 38.0
- 178 razorback16 openjev diffusiongemma (NVFP4, vLLM) 37.6
- 179 NeoHorse-Jev-4B 37.3
- 180 JevK5 v0.3 36.6
- 181 GLiDE 0.8B 36.4
- 182 Decider 4B 36.3
- 183 baselabs joey-1 (2B) 35.9
- 184 lev 35.5
- 185 Lev1 3.7B 35.4
- 186 Jev-Style 2B v4.2 35.1
- 187 Kev 4B r10 34.9
- 188 PKU-KCL-Meteor-2B 34.8
- 189 Sieve 2B v3 34.5
- 190 LatentMesh Blitz 2B v1 34.4
- 191 Saracura PT-BR 4B 34.4
- 192 LiquidAI d1-2B 34.4
- 193 Cam1 34.4
- 194 vLLM-SR d3-nano (2B) 34.3
- 195 mmastrac diffusiongemma (vLLM PR 57250) 34.3
- 196 Kas 4B 34.0
- 197 GLiDE 0.4B 33.8
- 198 Tev1-4B-experimental 33.7
- 199 LiquidAI d1-Omni-2B 33.6
- 200 Adjudex-0.8B v5 32.8
- 201 Winnow-E4B 32.7
- 202 Aurelis-2B 32.5
- 203 GLiClass v4.1 edge (0.4B) 32.5
- 204 Jevstral 8B 32.2
- 205 Metask-Jev-4B 32.2
- 206 Ryotide Qwen v0.3.1 32.0
- 207 Intelif Qwen3-4B 31.3
- 208 LiquidAI d1-3B 31.1
- 209 open-jev (pngwn) 31.1
- 210 PKU-KCL-Meteor-0.8B 30.9
- 211 vera-core-2 30.6
- 212 Jobe 30.4
- 213 OneJev1.6-0.8B 29.6
- 214 crystal-0.8b 29.4
- 215 MoDe-L 29.4
- 216 vLLM-SR vela3-fast (Vela 3.0, 0.4B) 29.3
- 217 Crivo-1B 29.3
- 218 KnowLine 0.8B Gen1 29.2
- 219 Gevva E4B 29.2
- 220 StartLux-Decision v1.1 0.8B 28.9
- 221 openvons 28.8
- 222 Amber 0.4B v2 27.8
- 223 Valen-Decision 1.5 0.8B 27.6
- 224 SemIf 26.7
- 225 Saina Helm 2 Omni (0.8B) 26.5
- 226 MoDe-M 26.5
- 227 Saif 0.8B Lightning v0.3 26.4
- 228 vLLM-SR d3-lite (0.8B) 26.2
- 229 jiwo 0.8B v2 25.8
- 230 Saina Helm 2.0 v2 25.3
- 231 this-that 1.2 24.9
- 232 Amber 150M 24.7
- 233 MoDe-S 24.5
- 234 Gevva E2B 24.3
- 235 Crivo-400M 23.7
- 236 Decider 2B 23.6
- 237 vLLM-SR Decision 2.0 Sol 2B 23.6
- 238 jdi-ptr14-0.8b 23.6
- 239 mini-jev 22.8
- 240 vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B) 22.1
- 241 Sieve 2B 21.9
- 242 wyat-1-800m 21.5
- 243 Intern-Decision-2B 20.9
- 244 Sieve 0.8B 20.8
- 245 Strands Decider 2B 20.7
- 246 EXAONE-4.0-1.2B-JEV v0.3 20.6
- 247 tasksource Decider nano v5 (150M) 19.9
- 248 Crivo-68M 19.5
- 249 Amber 68M 19.2
- 250 JEV Ettin 150M 18.5
- 251 vLLM-SR Decision 2.0 Eos 0.8B 18.4
- 252 Crivo-150M v2 18.3
- 253 Bekko System One v0 400M 18.0
- 254 Mola-150M 17.8
- 255 vLLM-SR d3-edge (0.6B) 17.7
- 256 Mola-68M 17.6
- 257 JEV FLAN-T5 Large public v2 (342M) 17.3
- 258 DecisionTune 1.0 17.2
- 259 Bosun v3.1 1.7B 16.5
- 260 vLLM-SR Decision 2.0 Kai 0.6B 16.4
- 261 Dinah-1 16.4
- 262 Kev 0.8B r15 16.3
- 263 Amber 32M 16.0
- 264 PICK-150M v5 15.6
- 265 JPT-0.8B 15.5
- 266 JEV Ettin 400M 15.2
- 267 Sifr 0.8B v3.1 14.5
- 268 Crivo-32M v2 14.2
- 269 Prumo 14.0
- 270 Kodiak v0.2 1B (accuracy) 13.9
- 271 Intern-Decision-0.8B 12.7
- 272 Jev-Style 0.8B v3 12.5
- 273 Tev1-0.8B-experimental 12.5
- 274 Bekko System One v0 68M 12.4
- 275 Amber 17M 12.0
- 276 LiquidAI d1-omni-600M 11.8
- 277 Crivo-17M 11.7
- 278 Von 1.3 11.7
- 279 Bosun v3.1 0.6B 11.0
- 280 vera-spark 11.0
- 281 Lavoir 10.8
- 282 GLiNER2.5-Decide 10.1
- 283 Laya 9.2
- 284 JevK5 Lite 8.8
- 285 LFM2.5-2.6B-RLCD 8.2
- 286 Qwen-2.5-1B-RLCD 7.8
- 287 Bekko System One v0 17M 7.7
- 288 EmbeddingGemma 2 System-One 7.4
- 289 CLM-v0.1-8B 6.5
- 290 jeff 6.2
- 291 LFM2.5-350M-RLCD 5.9
- 292 system-one-gemma 5.2
- 293 DM-JEPA 1.1 5.0
- 294 Julia 1 4.8
- 295 Nirnaya 0.4B 3.5
- 296 Zev 3.4
- 297 Verdict 2.0
Source: Official Decision Index leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | karpo-decision-31B | 73.9 | Official leaderboard | ||
| 2 | GLiDE 27B | 73.4 | Official leaderboard | ||
| 3 | REAX 1.3 | 72.6 | Official leaderboard | ||
| 4 | Logits Sigma-1 Duo | 72.3 | Official leaderboard | ||
| 5 | Copernicus-31B | 72.1 | Official leaderboard | ||
| 6 | KnowLine 31B Gen1.5 | 71.9 | Official leaderboard | ||
| 7 | Copernicus-57B | 71.8 | Official leaderboard | ||
| 8 | FlexDM-LoRA 2.1 · Gemma-4-31B | 71.6 | Official leaderboard | ||
| 9 | Sieve 31B v3 | 71.1 | Official leaderboard | ||
| 10 | OneJev1.6g-31B | 70.9 | Official leaderboard | ||
| 11 | Turion Jev 31B | 70.5 | Official leaderboard | ||
| 12 | eshbar-lulilla (Gemma 4 31B) | 70.3 | Official leaderboard | ||
| 13 | Jeffan-27B-1211 | 70.3 | Official leaderboard | ||
| 14 | vLLM-SR d3-ultra (Decision 3.0, 27B) | 70.2 | Official leaderboard | ||
| 15 | Bespoke Nimble v4.1 Max (27B) | 70.0 | Official leaderboard | ||
| 16 | H2O Lightning 31B v1.3.0 | 69.9 | Official leaderboard | ||
| 17 | Jeffan-31b-1710 | 69.8 | Official leaderboard | ||
| 18 | Logits Sigma-1 | 69.5 | Official leaderboard | ||
| 19 | liquamen (Gemma 4 31B) | 69.1 | Official leaderboard | ||
| 20 | Cerno 27B v1.1 | 69.0 | Official leaderboard | ||
| 21 | WeMM-JEV-27B | 68.5 | Official leaderboard | ||
| 22 | baselabs mammoth-1 (27B) | 68.4 | Official leaderboard | ||
| 23 | Piccolo 27B | 68.4 | Official leaderboard | ||
| 24 | Ainvest-Decision-27B v1.0 | 68.2 | Official leaderboard | ||
| 25 | oenogarum (Gemma 4 31B) | 68.1 | Official leaderboard | ||
| 26 | Perplexity Decider v1.2 (27B) | 68.0 | Official leaderboard | ||
| 27 | AutoTrust-JEV-27B v1.1 | 68.0 | Official leaderboard | ||
| 28 | StartLux-Decision v1.1 27B | 67.9 | Official leaderboard | ||
| 29 | Perplexity Decider v1.3 (27B) | 67.7 | Official leaderboard | ||
| 30 | MISA AI 2.0 Decision Plus · oak 1.1 (31B) | 67.6 | Official leaderboard | ||
| 31 | AJev lm6q (Gemma 4 31B) | 67.6 | Official leaderboard | ||
| 32 | Gemma 4 31B IT | 67.6 | FlexDM | Apr 2026 | Official leaderboard |
| 33 | Chon-1.1-31B | 67.5 | Official leaderboard | ||
| 34 | decy-preview (31B) | 67.5 | Official leaderboard | ||
| 35 | Lychee-27B | 67.3 | Official leaderboard | ||
| 36 | vLLM-SR d3-turbo v1.1 (27B) | 67.3 | Official leaderboard | ||
| 37 | vLLM-SR d3 (27B) | 67.2 | Official leaderboard | ||
| 38 | allec-oavg (Gemma 4 31B) | 67.0 | Official leaderboard | ||
| 39 | VisionJEV 1.0.0 (27B) | 66.9 | Official leaderboard | ||
| 40 | Aleria Judge 1.1.1 (Gemma 4 31B) | 66.7 | Official leaderboard | ||
| 41 | Nace.AI Drex Max v1 (27B) | 66.6 | Official leaderboard | ||
| 42 | AnyJev Tacitus 31B | 66.5 | Official leaderboard | ||
| 43 | vera-large-2o | 66.3 | Official leaderboard | ||
| 44 | Decider 31B (NVFP4) | 66.0 | Official leaderboard | ||
| 45 | KnowLine 35B-A3B Gen1.5 | 65.8 | Official leaderboard | ||
| 46 | OneShot 27B | 65.7 | Official leaderboard | ||
| 47 | Valen-Decision 1.5 27B | 65.2 | Official leaderboard | ||
| 48 | Bobcat 1.3 (31B) | 64.8 | Official leaderboard | ||
| 49 | Amos 1 Large (27B) | 64.8 | Official leaderboard | ||
| 50 | Matilda Decision v1 | 64.8 | Official leaderboard | ||
| 51 | KnowLine 26B-A4B Gen2.5 | 64.6 | Official leaderboard | ||
| 52 | frontier-infra Jebadiah 27B v2.1 (t1e) | 64.4 | Official leaderboard | ||
| 53 | Darwin-27B-RSI-Decision | 64.2 | Official leaderboard | ||
| 54 | deck31b (Gemma 4 31B) | 63.0 | Official leaderboard | ||
| 55 | decisio 0.6.0 (Gemma 4 31B) | 62.7 | Official leaderboard | ||
| 56 | GLiDE 9B | 62.5 | Official leaderboard | ||
| 57 | Torchcast Decision 27B | 61.5 | Official leaderboard | ||
| 58 | Jeffan-9B-1211 | 61.5 | Official leaderboard | ||
| 59 | OneJev1.6-27B | 61.5 | Official leaderboard | ||
| 60 | Qwen Decision 27B noncausal LoRA | 61.1 | Official leaderboard | ||
| 61 | Quyet-1.0-Large | 60.8 | Official leaderboard | ||
| 62 | garum (Gemma 4 31B) | 60.3 | Official leaderboard | ||
| 63 | baselabs elephant-1 (9B) | 60.3 | Official leaderboard | ||
| 64 | Standard One 35B SH (v1) | 60.1 | Official leaderboard | ||
| 65 | NTele-Hybrid-27B-v1 | 60.1 | Official leaderboard | ||
| 66 | Lumma-fev-27B | 60.0 | Official leaderboard | ||
| 67 | Sieve 27B v2 | 59.9 | Official leaderboard | ||
| 68 | mogan-decision-31B-it | 59.8 | Official leaderboard | ||
| 69 | linne-fern 1.0 (27B) | 59.6 | Official leaderboard | ||
| 70 | Kev 27B | 59.6 | Official leaderboard | ||
| 71 | Xor 26B-A4B v1.2 | 59.4 | Official leaderboard | ||
| 72 | Jev 1.13 | 59.2 | Official leaderboard | ||
| 73 | Adjudex-9B v5 | 59.2 | Official leaderboard | ||
| 74 | span-02 (Gemma 4 26B-A4B) | 59.1 | Official leaderboard | ||
| 75 | Cerno 9B v1.2 | 59.0 | Official leaderboard | ||
| 76 | garas (Gemma 4 31B) | 59.0 | Official leaderboard | ||
| 77 | Shisa DE-2.1 (repeat) | 58.8 | Official leaderboard | ||
| 78 | Eikos-27B | 58.8 | Official leaderboard | ||
| 79 | reflex Qwen3.8-27B-FP8 (pmscr) | 58.8 | Official leaderboard | ||
| 80 | RSI-Jev v6.1 VL 27B (effort auto) | 58.6 | Official leaderboard | ||
| 81 | KnowLine 9B Gen1 | 58.4 | Official leaderboard | ||
| 82 | H2O Lightning Bolt 74B v1.1 | 58.4 | Official leaderboard | ||
| 83 | StartLux-Decision v1.1 9B | 58.1 | Official leaderboard | ||
| 84 | vLLM-SR Decision 2.0 Vega 27B | 58.0 | Official leaderboard | ||
| 85 | JEV-35B | 57.6 | Official leaderboard | ||
| 86 | JEV-27B | 57.4 | Official leaderboard | ||
| 87 | Piccolo 9B | 57.3 | Official leaderboard | ||
| 88 | Qwen 3.8 27B | 57.0 | simple-jev | Aug 2026 | Official leaderboard |
| 89 | Tern-35B-A3B | 56.6 | Official leaderboard | ||
| 90 | Surogate Rune 26B-A4B v3 | 56.4 | Official leaderboard | ||
| 91 | SynACK Decide 26B-A4B v7 | 56.2 | Official leaderboard | ||
| 92 | KnowLine 4B Gen5.5 | 56.0 | Official leaderboard | ||
| 93 | Blink v0.3 26B-A4B (NVFP4) | 55.9 | Official leaderboard | ||
| 94 | Valen-Decision 1.5 9B | 55.9 | Official leaderboard | ||
| 95 | JADE | 55.6 | Official leaderboard | ||
| 96 | Dexy-Decision-9B-V2 | 55.4 | Official leaderboard | ||
| 97 | Wald-26B-A4B | 55.4 | Official leaderboard | ||
| 98 | AJev lora1 (Gemma 4 26B-A4B) | 55.3 | Official leaderboard | ||
| 99 | Perplexity Decider Flash v1.3 (4B) | 55.1 | Official leaderboard | ||
| 100 | Cloudflare clef | 54.9 | Official leaderboard | ||
| 101 | StartLux-Decision v1.1 4B | 54.8 | Official leaderboard | ||
| 102 | Qwen3.6 27B | 54.7 | Decider chat | Apr 2026 | Official leaderboard |
| 103 | Perplexity Decider Flash v1.2 (4B) | 54.3 | Official leaderboard | ||
| 104 | vLLM-SR d3-flash (9B) | 54.3 | Official leaderboard | ||
| 105 | JPT-35B-A3B | 54.1 | Official leaderboard | ||
| 106 | chinese-decision-pointer-4b | 54.0 | Official leaderboard | ||
| 107 | Cerno 4B v1.2 | 53.9 | Official leaderboard | ||
| 108 | Xor 1.2 | 53.6 | Official leaderboard | ||
| 109 | GEV-26B-Decide | 53.5 | Official leaderboard | ||
| 110 | OneJev1.6-9B | 53.0 | Official leaderboard | ||
| 111 | vera-medium-omni | 53.0 | Official leaderboard | ||
| 112 | Senova-4B v4 | 52.8 | Official leaderboard | ||
| 113 | Nace.AI Drex v2.0 (35B-A3B) | 52.8 | Official leaderboard | ||
| 114 | muria (Gemma 4 12B) | 52.5 | Official leaderboard | ||
| 115 | Jeffan-4B-2010 | 52.2 | Official leaderboard | ||
| 116 | Verdin-4B v1.1 | 52.0 | Official leaderboard | ||
| 117 | LatentMesh Blitz 4B v1 | 51.9 | Official leaderboard | ||
| 118 | Saif 4B v2 | 51.7 | Official leaderboard | ||
| 119 | vev-4b-v2 | 51.1 | Official leaderboard | ||
| 120 | Bespoke Nimble 9B v3 | 51.1 | Official leaderboard | ||
| 121 | frontier-infra Jebadiah 9B v2.1 (t1e) | 50.9 | Official leaderboard | ||
| 122 | decisio 0.4.0 (Qwen3.6-35B-A3B) | 50.8 | Official leaderboard | ||
| 123 | Piccolo 4B | 50.0 | Official leaderboard | ||
| 124 | vLLM-SR d3-mini (4B) | 50.0 | Official leaderboard | ||
| 125 | RSI-Jev v7.0 VL 4B | 49.9 | Official leaderboard | ||
| 126 | Valen-Decision 1.5 4B | 49.9 | Official leaderboard | ||
| 127 | Jegue 0.2 (9B) | 49.8 | Official leaderboard | ||
| 128 | RSI-Jev v7.0 VL 3B | 49.7 | Official leaderboard | ||
| 129 | JoshuaSP diffusiongemma (open-jev) | 49.5 | Official leaderboard | ||
| 130 | AJev lora7 (Gemma 4 12B) | 48.9 | Official leaderboard | ||
| 131 | OneJev1.6-4B | 48.9 | Official leaderboard | ||
| 132 | decisio 0.4.0 (Gemma 4 12B) | 48.8 | Official leaderboard | ||
| 133 | BaseDecision-Dyno (4B) | 48.5 | Official leaderboard | ||
| 134 | H2O Lightning E4B v1.0.1 | 48.0 | Official leaderboard | ||
| 135 | Mica v0.5 4B | 47.7 | Official leaderboard | ||
| 136 | PurpleMIST-Flash-1.0 | 47.5 | Official leaderboard | ||
| 137 | Sieve 9B v2 | 47.0 | Official leaderboard | ||
| 138 | Decider 35B-A3B | 46.6 | Official leaderboard | ||
| 139 | Winnow-12B | 46.6 | Official leaderboard | ||
| 140 | Seb-9B v2 | 46.3 | Official leaderboard | ||
| 141 | PurpleMIST-Mini-2.0 | 46.2 | Official leaderboard | ||
| 142 | vLLM-SR Decision 2.0 Lux 9B | 46.0 | Official leaderboard | ||
| 143 | Nace.AI Drex v1.5 | 45.8 | Official leaderboard | ||
| 144 | Hopper 12B (trained) | 45.8 | Official leaderboard | ||
| 145 | Trio-Spark DI (9B) | 45.6 | Official leaderboard | ||
| 146 | Jevora 9B v1.6 | 45.6 | Official leaderboard | ||
| 147 | CoCo-Decision-4B 2.4 | 45.5 | Official leaderboard | ||
| 148 | Cloudflare clef-omni (30B-A3B) | 45.0 | Official leaderboard | ||
| 149 | JevK5 9B v0.3.3 | 44.9 | Official leaderboard | ||
| 150 | Cloudflare clef-flash | 44.4 | Official leaderboard | ||
| 151 | Jevfire | 44.4 | Official leaderboard | ||
| 152 | jiwo 4B v2 | 44.1 | Official leaderboard | ||
| 153 | JPT-9B | 44.1 | Official leaderboard | ||
| 154 | ezjev 4B s2 | 43.9 | Official leaderboard | ||
| 155 | Jev-Omni | 43.8 | Official leaderboard | ||
| 156 | GLiDE 2B | 43.7 | Official leaderboard | ||
| 157 | Solomon v1.1 | 43.2 | Official leaderboard | ||
| 158 | Standard One 8B SH (v4) | 42.9 | Official leaderboard | ||
| 159 | Amber Hybrid 4B | 42.7 | Official leaderboard | ||
| 160 | JEV-9B | 42.1 | Official leaderboard | ||
| 161 | Bespoke Nimble 9B v2 | 42.1 | Official leaderboard | ||
| 162 | Sieve 9B | 41.7 | Official leaderboard | ||
| 163 | Sieve 4B | 41.0 | Official leaderboard | ||
| 164 | Kev 9B v2 | 40.9 | Official leaderboard | ||
| 165 | Nari Decision 4B v3.2 | 40.9 | Official leaderboard | ||
| 166 | Aplomb 1 | 40.8 | Official leaderboard | ||
| 167 | vLLM-SR Decision 2.0 Nox 4B | 40.8 | Official leaderboard | ||
| 168 | Hopper (G) 1.2 | 40.2 | Official leaderboard | ||
| 169 | StartLux-Decision v1.1 2B | 40.1 | Official leaderboard | ||
| 170 | FlyMy.AI Decision 4B v1.6 | 39.8 | Official leaderboard | ||
| 171 | Standard One 3B SH (v4) | 39.8 | Official leaderboard | ||
| 172 | JPT-4B | 39.6 | Official leaderboard | ||
| 173 | Amber 4B | 39.5 | Official leaderboard | ||
| 174 | Intern-Decision-4B | 38.7 | Official leaderboard | ||
| 175 | djev | 38.1 | Official leaderboard | ||
| 176 | KnowLine 2B Gen1 | 38.1 | Official leaderboard | ||
| 177 | Valen-Decision 1.5 2B | 38.0 | Official leaderboard | ||
| 178 | razorback16 openjev diffusiongemma (NVFP4, vLLM) | 37.6 | Official leaderboard | ||
| 179 | NeoHorse-Jev-4B | 37.3 | Official leaderboard | ||
| 180 | JevK5 v0.3 | 36.6 | Official leaderboard | ||
| 181 | GLiDE 0.8B | 36.4 | Official leaderboard | ||
| 182 | Decider 4B | 36.3 | Official leaderboard | ||
| 183 | baselabs joey-1 (2B) | 35.9 | Official leaderboard | ||
| 184 | lev | 35.5 | Official leaderboard | ||
| 185 | Lev1 3.7B | 35.4 | Official leaderboard | ||
| 186 | Jev-Style 2B v4.2 | 35.1 | Official leaderboard | ||
| 187 | Kev 4B r10 | 34.9 | Official leaderboard | ||
| 188 | PKU-KCL-Meteor-2B | 34.8 | Official leaderboard | ||
| 189 | Sieve 2B v3 | 34.5 | Official leaderboard | ||
| 190 | LatentMesh Blitz 2B v1 | 34.4 | Official leaderboard | ||
| 191 | Saracura PT-BR 4B | 34.4 | Official leaderboard | ||
| 192 | LiquidAI d1-2B | 34.4 | Official leaderboard | ||
| 193 | Cam1 | 34.4 | Official leaderboard | ||
| 194 | vLLM-SR d3-nano (2B) | 34.3 | Official leaderboard | ||
| 195 | mmastrac diffusiongemma (vLLM PR 57250) | 34.3 | Official leaderboard | ||
| 196 | Kas 4B | 34.0 | Official leaderboard | ||
| 197 | GLiDE 0.4B | 33.8 | Official leaderboard | ||
| 198 | Tev1-4B-experimental | 33.7 | Official leaderboard | ||
| 199 | LiquidAI d1-Omni-2B | 33.6 | Official leaderboard | ||
| 200 | Adjudex-0.8B v5 | 32.8 | Official leaderboard | ||
| 201 | Winnow-E4B | 32.7 | Official leaderboard | ||
| 202 | Aurelis-2B | 32.5 | Official leaderboard | ||
| 203 | GLiClass v4.1 edge (0.4B) | 32.5 | Official leaderboard | ||
| 204 | Jevstral 8B | 32.2 | Official leaderboard | ||
| 205 | Metask-Jev-4B | 32.2 | Official leaderboard | ||
| 206 | Ryotide Qwen v0.3.1 | 32.0 | Official leaderboard | ||
| 207 | Intelif Qwen3-4B | 31.3 | Official leaderboard | ||
| 208 | LiquidAI d1-3B | 31.1 | Official leaderboard | ||
| 209 | open-jev (pngwn) | 31.1 | Official leaderboard | ||
| 210 | PKU-KCL-Meteor-0.8B | 30.9 | Official leaderboard | ||
| 211 | vera-core-2 | 30.6 | Official leaderboard | ||
| 212 | Jobe | 30.4 | Official leaderboard | ||
| 213 | OneJev1.6-0.8B | 29.6 | Official leaderboard | ||
| 214 | crystal-0.8b | 29.4 | Official leaderboard | ||
| 215 | MoDe-L | 29.4 | Official leaderboard | ||
| 216 | vLLM-SR vela3-fast (Vela 3.0, 0.4B) | 29.3 | Official leaderboard | ||
| 217 | Crivo-1B | 29.3 | Official leaderboard | ||
| 218 | KnowLine 0.8B Gen1 | 29.2 | Official leaderboard | ||
| 219 | Gevva E4B | 29.2 | Official leaderboard | ||
| 220 | StartLux-Decision v1.1 0.8B | 28.9 | Official leaderboard | ||
| 221 | openvons | 28.8 | Official leaderboard | ||
| 222 | Amber 0.4B v2 | 27.8 | Official leaderboard | ||
| 223 | Valen-Decision 1.5 0.8B | 27.6 | Official leaderboard | ||
| 224 | SemIf | 26.7 | Official leaderboard | ||
| 225 | Saina Helm 2 Omni (0.8B) | 26.5 | Official leaderboard | ||
| 226 | MoDe-M | 26.5 | Official leaderboard | ||
| 227 | Saif 0.8B Lightning v0.3 | 26.4 | Official leaderboard | ||
| 228 | vLLM-SR d3-lite (0.8B) | 26.2 | Official leaderboard | ||
| 229 | jiwo 0.8B v2 | 25.8 | Official leaderboard | ||
| 230 | Saina Helm 2.0 v2 | 25.3 | Official leaderboard | ||
| 231 | this-that 1.2 | 24.9 | Official leaderboard | ||
| 232 | Amber 150M | 24.7 | Official leaderboard | ||
| 233 | MoDe-S | 24.5 | Official leaderboard | ||
| 234 | Gevva E2B | 24.3 | Official leaderboard | ||
| 235 | Crivo-400M | 23.7 | Official leaderboard | ||
| 236 | Decider 2B | 23.6 | Official leaderboard | ||
| 237 | vLLM-SR Decision 2.0 Sol 2B | 23.6 | Official leaderboard | ||
| 238 | jdi-ptr14-0.8b | 23.6 | Official leaderboard | ||
| 239 | mini-jev | 22.8 | Official leaderboard | ||
| 240 | vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B) | 22.1 | Official leaderboard | ||
| 241 | Sieve 2B | 21.9 | Official leaderboard | ||
| 242 | wyat-1-800m | 21.5 | Official leaderboard | ||
| 243 | Intern-Decision-2B | 20.9 | Official leaderboard | ||
| 244 | Sieve 0.8B | 20.8 | Official leaderboard | ||
| 245 | Strands Decider 2B | 20.7 | Official leaderboard | ||
| 246 | EXAONE-4.0-1.2B-JEV v0.3 | 20.6 | Official leaderboard | ||
| 247 | tasksource Decider nano v5 (150M) | 19.9 | Official leaderboard | ||
| 248 | Crivo-68M | 19.5 | Official leaderboard | ||
| 249 | Amber 68M | 19.2 | Official leaderboard | ||
| 250 | JEV Ettin 150M | 18.5 | Official leaderboard | ||
| 251 | vLLM-SR Decision 2.0 Eos 0.8B | 18.4 | Official leaderboard | ||
| 252 | Crivo-150M v2 | 18.3 | Official leaderboard | ||
| 253 | Bekko System One v0 400M | 18.0 | Official leaderboard | ||
| 254 | Mola-150M | 17.8 | Official leaderboard | ||
| 255 | vLLM-SR d3-edge (0.6B) | 17.7 | Official leaderboard | ||
| 256 | Mola-68M | 17.6 | Official leaderboard | ||
| 257 | JEV FLAN-T5 Large public v2 (342M) | 17.3 | Official leaderboard | ||
| 258 | DecisionTune 1.0 | 17.2 | Official leaderboard | ||
| 259 | Bosun v3.1 1.7B | 16.5 | Official leaderboard | ||
| 260 | vLLM-SR Decision 2.0 Kai 0.6B | 16.4 | Official leaderboard | ||
| 261 | Dinah-1 | 16.4 | Official leaderboard | ||
| 262 | Kev 0.8B r15 | 16.3 | Official leaderboard | ||
| 263 | Amber 32M | 16.0 | Official leaderboard | ||
| 264 | PICK-150M v5 | 15.6 | Official leaderboard | ||
| 265 | JPT-0.8B | 15.5 | Official leaderboard | ||
| 266 | JEV Ettin 400M | 15.2 | Official leaderboard | ||
| 267 | Sifr 0.8B v3.1 | 14.5 | Official leaderboard | ||
| 268 | Crivo-32M v2 | 14.2 | Official leaderboard | ||
| 269 | Prumo | 14.0 | Official leaderboard | ||
| 270 | Kodiak v0.2 1B (accuracy) | 13.9 | Official leaderboard | ||
| 271 | Intern-Decision-0.8B | 12.7 | Official leaderboard | ||
| 272 | Jev-Style 0.8B v3 | 12.5 | Official leaderboard | ||
| 273 | Tev1-0.8B-experimental | 12.5 | Official leaderboard | ||
| 274 | Bekko System One v0 68M | 12.4 | Official leaderboard | ||
| 275 | Amber 17M | 12.0 | Official leaderboard | ||
| 276 | LiquidAI d1-omni-600M | 11.8 | Official leaderboard | ||
| 277 | Crivo-17M | 11.7 | Official leaderboard | ||
| 278 | Von 1.3 | 11.7 | Official leaderboard | ||
| 279 | Bosun v3.1 0.6B | 11.0 | Official leaderboard | ||
| 280 | vera-spark | 11.0 | Official leaderboard | ||
| 281 | Lavoir | 10.8 | Official leaderboard | ||
| 282 | GLiNER2.5-Decide | 10.1 | Official leaderboard | ||
| 283 | Laya | 9.2 | Official leaderboard | ||
| 284 | JevK5 Lite | 8.8 | Official leaderboard | ||
| 285 | LFM2.5-2.6B-RLCD | 8.2 | Official leaderboard | ||
| 286 | Qwen-2.5-1B-RLCD | 7.8 | Official leaderboard | ||
| 287 | Bekko System One v0 17M | 7.7 | Official leaderboard | ||
| 288 | EmbeddingGemma 2 System-One | 7.4 | Official leaderboard | ||
| 289 | CLM-v0.1-8B | 6.5 | Official leaderboard | ||
| 290 | jeff | 6.2 | Official leaderboard | ||
| 291 | LFM2.5-350M-RLCD | 5.9 | Official leaderboard | ||
| 292 | system-one-gemma | 5.2 | Official leaderboard | ||
| 293 | DM-JEPA 1.1 | 5.0 | Official leaderboard | ||
| 294 | Julia 1 | 4.8 | Official leaderboard | ||
| 295 | Nirnaya 0.4B | 3.5 | Official leaderboard | ||
| 296 | Zev | 3.4 | Official leaderboard | ||
| 297 | Verdict | 2.0 | Official leaderboard |
Median latency vs Decision Index
Median time per request on one RTX PRO 6000, on a log scale; for hosted APIs it is an HTTP round trip, so not a controlled comparison. The line joins the runs that no other run beats on both measures. We redrew this chart from the numbers on the official leaderboard.
| Model | Setting | Decision Index (Full) | Median latency |
|---|---|---|---|
| karpo-decision-31B | 73.86 | 0.09 s | |
| GLiDE 27B | 73.37 | 0.12 s | |
| REAX 1.3 | 72.64 | 0.25 s | |
| Logits Sigma-1 Duo | 72.28 | 0.37 s | |
| Copernicus-31B | 72.11 | 0.15 s | |
| KnowLine 31B Gen1.5 | 71.91 | 0.2 s | |
| Copernicus-57B | 71.8 | 0.25 s | |
| FlexDM-LoRA 2.1 · Gemma-4-31B | 71.61 | 0.16 s | |
| Sieve 31B v3 | 71.1 | 0.23 s | |
| OneJev1.6g-31B | 70.86 | 0.09 s | |
| Turion Jev 31B | 70.47 | 0.14 s | |
| Jeffan-27B-1211 | 70.3 | 0.1 s | |
| eshbar-lulilla (Gemma 4 31B) | 70.3 | 0.34 s | |
| vLLM-SR d3-ultra (Decision 3.0, 27B) | 70.18 | 0.2 s | |
| Bespoke Nimble v4.1 Max (27B) | 70.03 | 0.11 s | |
| H2O Lightning 31B v1.3.0 | 69.92 | 0.14 s | |
| Jeffan-31b-1710 | 69.75 | 0.12 s | |
| Logits Sigma-1 | 69.47 | 0.12 s | |
| liquamen (Gemma 4 31B) | 69.14 | 0.32 s | |
| Cerno 27B v1.1 | 68.96 | 0.08 s | |
| WeMM-JEV-27B | 68.49 | 0.1 s | |
| baselabs mammoth-1 (27B) | 68.44 | 0.22 s | |
| Piccolo 27B | 68.4 | 0.1 s | |
| Ainvest-Decision-27B v1.0 | 68.23 | 0.1 s | |
| oenogarum (Gemma 4 31B) | 68.1 | 0.26 s | |
| Perplexity Decider v1.2 (27B) | 67.98 | 0.14 s | |
| AutoTrust-JEV-27B v1.1 | 67.95 | 0.08 s | |
| StartLux-Decision v1.1 27B | 67.92 | 0.08 s | |
| Perplexity Decider v1.3 (27B) | 67.67 | 0.14 s | |
| MISA AI 2.0 Decision Plus · oak 1.1 (31B) | 67.62 | 0.11 s | |
| AJev lm6q (Gemma 4 31B) | 67.57 | 0.14 s | |
| Gemma 4 31B IT | FlexDM | 67.56 | 0.11 s |
| Chon-1.1-31B | 67.54 | 0.17 s | |
| decy-preview (31B) | 67.48 | 0.12 s | |
| Lychee-27B | 67.35 | 0.1 s | |
| vLLM-SR d3-turbo v1.1 (27B) | 67.31 | 0.19 s | |
| vLLM-SR d3 (27B) | 67.15 | 0.1 s | |
| allec-oavg (Gemma 4 31B) | 66.96 | 0.26 s | |
| VisionJEV 1.0.0 (27B) | 66.88 | 0.09 s | |
| Aleria Judge 1.1.1 (Gemma 4 31B) | 66.67 | 0.12 s | |
| Nace.AI Drex Max v1 (27B) | 66.6 | 0.1 s | |
| AnyJev Tacitus 31B | 66.47 | 0.1 s | |
| vera-large-2o | 66.26 | 0.15 s | |
| Decider 31B (NVFP4) | 66.03 | 0.07 s | |
| KnowLine 35B-A3B Gen1.5 | 65.77 | 0.05 s | |
| OneShot 27B | 65.74 | 0.13 s | |
| Valen-Decision 1.5 27B | 65.21 | 0.11 s | |
| Bobcat 1.3 (31B) | 64.85 | 0.06 s | |
| Amos 1 Large (27B) | 64.81 | 0.15 s | |
| Matilda Decision v1 | 64.75 | 0.09 s | |
| Gemma 4 31B IT | jev-brain | 64.61 | 0.1 s |
| KnowLine 26B-A4B Gen2.5 | 64.57 | 0.07 s | |
| frontier-infra Jebadiah 27B v2.1 (t1e) | 64.4 | 0.3 s | |
| Darwin-27B-RSI-Decision | 64.18 | 0.12 s | |
| Gemma 4 31B IT | AnyJev L0 | 63.65 | 0.1 s |
| deck31b (Gemma 4 31B) | 63.05 | 0.22 s | |
| decisio 0.6.0 (Gemma 4 31B) | 62.68 | 0.05 s | |
| GLiDE 9B | 62.48 | 0.09 s | |
| Gemma 4 31B IT | Decider chat | 61.63 | 0.11 s |
| Torchcast Decision 27B | 61.49 | 0.1 s | |
| Jeffan-9B-1211 | 61.48 | 0.08 s | |
| OneJev1.6-27B | 61.46 | 0.11 s | |
| Qwen Decision 27B noncausal LoRA | 61.12 | 0.13 s | |
| Quyet-1.0-Large | 60.77 | 0.11 s | |
| garum (Gemma 4 31B) | 60.27 | 0.12 s | |
| baselabs elephant-1 (9B) | 60.26 | 0.11 s | |
| Standard One 35B SH (v1) | 60.14 | 0.32 s | |
| NTele-Hybrid-27B-v1 | 60.12 | 0.08 s | |
| Lumma-fev-27B | 59.97 | 0.1 s | |
| Sieve 27B v2 | 59.89 | 0.11 s | |
| mogan-decision-31B-it | 59.82 | 0.11 s | |
| linne-fern 1.0 (27B) | 59.65 | 0.11 s | |
| Kev 27B | 59.56 | 0.14 s | |
| Xor 26B-A4B v1.2 | 59.44 | 0.11 s | |
| Jev 1.13 | 59.22 | 0.52 s | |
| Adjudex-9B v5 | 59.19 | 0.07 s | |
| span-02 (Gemma 4 26B-A4B) | 59.07 | 0.03 s | |
| Cerno 9B v1.2 | 58.98 | 0.07 s | |
| garas (Gemma 4 31B) | 58.95 | 0.12 s | |
| Shisa DE-2.1 (repeat) | 58.84 | 0.05 s | |
| Eikos-27B | 58.79 | 0.13 s | |
| reflex Qwen3.8-27B-FP8 (pmscr) | 58.77 | 0.15 s | |
| RSI-Jev v6.1 VL 27B (effort auto) | 58.6 | 0.08 s | |
| KnowLine 9B Gen1 | 58.44 | 0.13 s | |
| H2O Lightning Bolt 74B v1.1 | 58.42 | 0.29 s | |
| StartLux-Decision v1.1 9B | 58.07 | 0.04 s | |
| vLLM-SR Decision 2.0 Vega 27B | 58.01 | 0.12 s | |
| JEV-35B | 57.61 | 0.05 s | |
| JEV-27B | 57.35 | 0.1 s | |
| Piccolo 9B | 57.34 | 0.08 s | |
| Qwen 3.8 27B | simple-jev | 56.99 | 0.37 s |
| Tern-35B-A3B | 56.62 | 0.06 s | |
| Surogate Rune 26B-A4B v3 | 56.42 | 0.12 s | |
| SynACK Decide 26B-A4B v7 | 56.22 | 0.13 s | |
| KnowLine 4B Gen5.5 | 55.99 | 0.04 s | |
| Blink v0.3 26B-A4B (NVFP4) | 55.92 | 0.03 s | |
| Valen-Decision 1.5 9B | 55.85 | 0.12 s | |
| JADE | 55.57 | 0.13 s | |
| Dexy-Decision-9B-V2 | 55.39 | 0.03 s | |
| Wald-26B-A4B | 55.35 | 0.09 s | |
| AJev lora1 (Gemma 4 26B-A4B) | 55.29 | 0.09 s | |
| Perplexity Decider Flash v1.3 (4B) | 55.14 | 0.09 s | |
| Cloudflare clef | 54.92 | 0.1 s | |
| StartLux-Decision v1.1 4B | 54.8 | 0.04 s | |
| Qwen3.6 27B | Decider chat | 54.67 | 0.08 s |
| Perplexity Decider Flash v1.2 (4B) | 54.29 | 0.07 s | |
| vLLM-SR d3-flash (9B) | 54.27 | 0.05 s | |
| JPT-35B-A3B | 54.09 | 0.25 s | |
| chinese-decision-pointer-4b | 53.96 | 0.05 s | |
| Cerno 4B v1.2 | 53.88 | 0.06 s | |
| Xor 1.2 | 53.62 | 0.15 s | |
| GEV-26B-Decide | 53.5 | 0.13 s | |
| OneJev1.6-9B | 53.05 | 0.04 s | |
| vera-medium-omni | 53.02 | 0.09 s | |
| Senova-4B v4 | 52.79 | 0.08 s | |
| Nace.AI Drex v2.0 (35B-A3B) | 52.76 | 0.28 s | |
| muria (Gemma 4 12B) | 52.55 | 0.05 s | |
| Jeffan-4B-2010 | 52.21 | 0.05 s | |
| Verdin-4B v1.1 | 51.99 | 0.2 s | |
| LatentMesh Blitz 4B v1 | 51.94 | 0.07 s | |
| Saif 4B v2 | 51.68 | 0.07 s | |
| vev-4b-v2 | 51.11 | 0.06 s | |
| Bespoke Nimble 9B v3 | 51.06 | 0.07 s | |
| frontier-infra Jebadiah 9B v2.1 (t1e) | 50.9 | 0.13 s | |
| decisio 0.4.0 (Qwen3.6-35B-A3B) | 50.82 | 0.07 s | |
| Piccolo 4B | 50 | 0.05 s | |
| vLLM-SR d3-mini (4B) | 49.97 | 0.05 s | |
| RSI-Jev v7.0 VL 4B | 49.93 | 0.06 s | |
| Valen-Decision 1.5 4B | 49.87 | 0.05 s | |
| Jegue 0.2 (9B) | 49.82 | 0.09 s | |
| RSI-Jev v7.0 VL 3B | 49.68 | 0.1 s | |
| JoshuaSP diffusiongemma (open-jev) | 49.53 | 0.26 s | |
| AJev lora7 (Gemma 4 12B) | 48.91 | 0.07 s | |
| OneJev1.6-4B | 48.88 | 0.03 s | |
| decisio 0.4.0 (Gemma 4 12B) | 48.75 | 0.04 s | |
| BaseDecision-Dyno (4B) | 48.52 | 0.14 s | |
| H2O Lightning E4B v1.0.1 | 47.99 | 0.02 s | |
| Mica v0.5 4B | 47.7 | 0.02 s | |
| PurpleMIST-Flash-1.0 | 47.54 | 0.05 s | |
| Sieve 9B v2 | 47 | 0.05 s | |
| Decider 35B-A3B | 46.64 | 0.1 s | |
| Winnow-12B | 46.57 | 0.07 s | |
| Seb-9B v2 | 46.25 | 0.09 s | |
| PurpleMIST-Mini-2.0 | 46.24 | 0.06 s | |
| vLLM-SR Decision 2.0 Lux 9B | 45.97 | 0.04 s | |
| Nace.AI Drex v1.5 | 45.78 | 0.05 s | |
| Hopper 12B (trained) | 45.76 | 0.29 s | |
| Trio-Spark DI (9B) | 45.59 | 0.21 s | |
| Jevora 9B v1.6 | 45.57 | 0.12 s | |
| CoCo-Decision-4B 2.4 | 45.52 | 0.06 s | |
| Cloudflare clef-omni (30B-A3B) | 45.04 | 0.19 s | |
| JevK5 9B v0.3.3 | 44.89 | 0.04 s | |
| Cloudflare clef-flash | 44.43 | 0.05 s | |
| Jevfire | 44.39 | 0.09 s | |
| jiwo 4B v2 | 44.1 | 0.05 s | |
| JPT-9B | 44.08 | 0.15 s | |
| ezjev 4B s2 | 43.9 | 0.04 s | |
| Jev-Omni | 43.83 | 0.05 s | |
| GLiDE 2B | 43.72 | 0.04 s | |
| Solomon v1.1 | 43.23 | 0.22 s | |
| Standard One 8B SH (v4) | 42.93 | 0.09 s | |
| Amber Hybrid 4B | 42.74 | 0.27 s | |
| JEV-9B | 42.15 | 0.05 s | |
| Bespoke Nimble 9B v2 | 42.06 | 0.08 s | |
| Sieve 9B | 41.73 | 0.05 s | |
| Sieve 4B | 40.96 | 0.09 s | |
| Kev 9B v2 | 40.91 | 0.06 s | |
| Nari Decision 4B v3.2 | 40.87 | 0.02 s | |
| vLLM-SR Decision 2.0 Nox 4B | 40.75 | 0.03 s | |
| Aplomb 1 | 40.75 | 0.05 s | |
| Hopper (G) 1.2 | 40.17 | 0.02 s | |
| StartLux-Decision v1.1 2B | 40.11 | 0.03 s | |
| FlyMy.AI Decision 4B v1.6 | 39.8 | 0.03 s | |
| Standard One 3B SH (v4) | 39.79 | 0.08 s | |
| JPT-4B | 39.56 | 0.14 s | |
| Amber 4B | 39.45 | 0.13 s | |
| Intern-Decision-4B | 38.69 | 0.04 s | |
| djev | 38.15 | 0.08 s | |
| KnowLine 2B Gen1 | 38.07 | 0.03 s | |
| Valen-Decision 1.5 2B | 37.97 | 0.04 s | |
| razorback16 openjev diffusiongemma (NVFP4, vLLM) | 37.6 | 0.04 s | |
| NeoHorse-Jev-4B | 37.26 | 0.05 s | |
| JevK5 v0.3 | 36.59 | 0.03 s | |
| GLiDE 0.8B | 36.36 | 0.04 s | |
| Decider 4B | 36.3 | 0.01 s | |
| baselabs joey-1 (2B) | 35.91 | 0.08 s | |
| lev | 35.47 | 0.07 s | |
| Lev1 3.7B | 35.41 | 0.03 s | |
| Jev-Style 2B v4.2 | 35.13 | 0.03 s | |
| Kev 4B r10 | 34.93 | 0.06 s | |
| PKU-KCL-Meteor-2B | 34.75 | 0.03 s | |
| Sieve 2B v3 | 34.45 | 0.04 s | |
| LatentMesh Blitz 2B v1 | 34.44 | 0.05 s | |
| Saracura PT-BR 4B | 34.43 | 0.06 s | |
| LiquidAI d1-2B | 34.39 | 0.09 s | |
| Cam1 | 34.36 | 0.25 s | |
| vLLM-SR d3-nano (2B) | 34.3 | 0.04 s | |
| mmastrac diffusiongemma (vLLM PR 57250) | 34.25 | 0.13 s | |
| Kas 4B | 34 | 0.07 s | |
| GLiDE 0.4B | 33.84 | 0.02 s | |
| Tev1-4B-experimental | 33.73 | 0.04 s | |
| LiquidAI d1-Omni-2B | 33.58 | 0.1 s | |
| Adjudex-0.8B v5 | 32.81 | 0.05 s | |
| Winnow-E4B | 32.72 | 0.05 s | |
| Aurelis-2B | 32.55 | 0.07 s | |
| GLiClass v4.1 edge (0.4B) | 32.47 | 0.02 s | |
| Jevstral 8B | 32.23 | 0.03 s | |
| Metask-Jev-4B | 32.17 | 0.06 s | |
| Ryotide Qwen v0.3.1 | 31.99 | 0.08 s | |
| Intelif Qwen3-4B | 31.33 | 0.02 s | |
| LiquidAI d1-3B | 31.12 | 0.02 s | |
| open-jev (pngwn) | 31.1 | 0.11 s | |
| PKU-KCL-Meteor-0.8B | 30.94 | 0.04 s | |
| vera-core-2 | 30.6 | 0.09 s | |
| Jobe | 30.35 | 0.05 s | |
| OneJev1.6-0.8B | 29.58 | 0.01 s | |
| crystal-0.8b | 29.37 | 0.05 s | |
| MoDe-L | 29.35 | 0.1 s | |
| vLLM-SR vela3-fast (Vela 3.0, 0.4B) | 29.27 | 0.05 s | |
| Crivo-1B | 29.25 | 0.02 s | |
| KnowLine 0.8B Gen1 | 29.24 | 0.03 s | |
| Gevva E4B | 29.21 | 0.05 s | |
| StartLux-Decision v1.1 0.8B | 28.88 | 0.03 s | |
| openvons | 28.78 | 0.02 s | |
| Amber 0.4B v2 | 27.77 | 0.02 s | |
| Valen-Decision 1.5 0.8B | 27.6 | 0.04 s | |
| SemIf | 26.71 | 0.11 s | |
| Saina Helm 2 Omni (0.8B) | 26.54 | 0.04 s | |
| MoDe-M | 26.49 | 0.12 s | |
| Saif 0.8B Lightning v0.3 | 26.37 | 0.06 s | |
| vLLM-SR d3-lite (0.8B) | 26.16 | 0.04 s | |
| jiwo 0.8B v2 | 25.81 | 0.04 s | |
| Saina Helm 2.0 v2 | 25.29 | 0.04 s | |
| this-that 1.2 | 24.85 | 0.04 s | |
| Amber 150M | 24.67 | 0.02 s | |
| MoDe-S | 24.52 | 0.12 s | |
| Gevva E2B | 24.26 | 0.04 s | |
| Crivo-400M | 23.74 | 0.02 s | |
| Decider 2B | 23.65 | 0.01 s | |
| vLLM-SR Decision 2.0 Sol 2B | 23.64 | 0.03 s | |
| jdi-ptr14-0.8b | 23.58 | 0.07 s | |
| mini-jev | 22.81 | 0.07 s | |
| vLLM-SR vela3-fast-vision (Vela 3.0, 0.25B) | 22.11 | 0.04 s | |
| Sieve 2B | 21.9 | 0.06 s | |
| wyat-1-800m | 21.49 | 0.11 s | |
| Intern-Decision-2B | 20.93 | 0.03 s | |
| Sieve 0.8B | 20.82 | 0.05 s | |
| Strands Decider 2B | 20.72 | 0.05 s | |
| EXAONE-4.0-1.2B-JEV v0.3 | 20.6 | 0.15 s | |
| tasksource Decider nano v5 (150M) | 19.85 | 0.01 s | |
| Crivo-68M | 19.51 | 0.01 s | |
| Amber 68M | 19.24 | 0.01 s | |
| JEV Ettin 150M | 18.52 | 0.08 s | |
| vLLM-SR Decision 2.0 Eos 0.8B | 18.37 | 0.03 s | |
| Crivo-150M v2 | 18.26 | 0.01 s | |
| Bekko System One v0 400M | 17.98 | 0.02 s | |
| Mola-150M | 17.84 | 0.01 s | |
| vLLM-SR d3-edge (0.6B) | 17.69 | 0.02 s | |
| Mola-68M | 17.6 | 0.01 s | |
| JEV FLAN-T5 Large public v2 (342M) | 17.31 | 0.02 s | |
| DecisionTune 1.0 | 17.22 | 0.01 s | |
| Bosun v3.1 1.7B | 16.54 | 0.04 s | |
| vLLM-SR Decision 2.0 Kai 0.6B | 16.43 | 0.02 s | |
| Dinah-1 | 16.36 | 0.01 s | |
| Kev 0.8B r15 | 16.3 | 0.05 s | |
| Amber 32M | 15.98 | 0.01 s | |
| PICK-150M v5 | 15.62 | 0.02 s | |
| JPT-0.8B | 15.46 | 0.12 s | |
| JEV Ettin 400M | 15.24 | 0.02 s | |
| Sifr 0.8B v3.1 | 14.53 | 0.03 s | |
| Crivo-32M v2 | 14.23 | 0.01 s | |
| Prumo | 13.99 | 0 s | |
| Kodiak v0.2 1B (accuracy) | 13.86 | 0.14 s | |
| Intern-Decision-0.8B | 12.71 | 0.03 s | |
| Jev-Style 0.8B v3 | 12.5 | 0.04 s | |
| Tev1-0.8B-experimental | 12.47 | 0.03 s | |
| Bekko System One v0 68M | 12.4 | 0.01 s | |
| Amber 17M | 11.99 | 0.01 s | |
| LiquidAI d1-omni-600M | 11.75 | 0.01 s | |
| Crivo-17M | 11.65 | 0.01 s | |
| Von 1.3 | 11.65 | 0.02 s | |
| Bosun v3.1 0.6B | 11.04 | 0.04 s | |
| vera-spark | 11 | 0.08 s | |
| Lavoir | 10.85 | 0.02 s | |
| GLiNER2.5-Decide | 10.14 | 0.02 s | |
| Laya | 9.21 | 0.01 s | |
| JevK5 Lite | 8.78 | 0.02 s | |
| LFM2.5-2.6B-RLCD | 8.18 | 0.04 s | |
| Qwen-2.5-1B-RLCD | 7.85 | 0.04 s | |
| Bekko System One v0 17M | 7.66 | 0.01 s | |
| EmbeddingGemma 2 System-One | 7.41 | 0.03 s | |
| CLM-v0.1-8B | 6.49 | 0.05 s | |
| jeff | 6.21 | 0.02 s | |
| LFM2.5-350M-RLCD | 5.86 | 0.03 s | |
| system-one-gemma | 5.22 | 0.03 s | |
| DM-JEPA 1.1 | 4.96 | 0.06 s | |
| Julia 1 | 4.75 | 0.01 s | |
| Nirnaya 0.4B | 3.51 | 0.01 s | |
| Zev | 3.37 | 0 s | |
| Verdict | 2.04 | 0.01 s |
Number one over time
Lab claims count from the day the card came out, independent runs from the model’s release.
Google DeepMind
Source: Official Decision Index leaderboard
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
On the benchmark’s own leaderboard
Source: Official Decision Index leaderboard
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Other
- Personal Superintelligence Index (Meta) In use Meta's composite of seven personal and knowledge-work evals: Agents' Last Exam, AutomationBench-AA, FocusBench, JobBench, GDP.pdf, VBT and DRACO.
- Artificial Analysis Intelligence Index v5 In use Version 5 of Artificial Analysis's index: nine evaluations in four equal categories, most with private test sets, run three times each in its own agent harness. Gemini 4 Carbon 59.0
- SAGE v1.1 (Vals) In use Models grade handwritten undergraduate math and computer science work against rubrics. Scored by class-balanced accuracy of each rubric check against expert grading. Claude Opus 5.5 91.3%
- MTEB Fading Massive Text Embedding Benchmark: retrieval, clustering, classification across languages and modalities.
sonar 42% - Anthropic ECI (AECI) Only in system cards Index that combines a basket of capability benchmarks into one capability score to track trends across Anthropic models. Claude Opus 5.5 169.4
- SPEED-Bench Only in system cards Measures speculative decoding across varied prompts and domains. Reports the average acceptance length of draft tokens, so higher means faster generation at the same output.
Nemotron 3 Ultra 5.15