Creative Writing v3
Models write responses to 32 creative writing prompts, three times each. A judge model scores them with a rubric and pairwise Elo comparisons.
Version 3 replaced version 2 after the judge could no longer separate top models.
- Made by
- EQ-Bench
- Released
- March 2025
- Kind
- Creative writing
- Level
- University
- Scored
- Graded by a model
- Answers
- Open-ended
- Tasks
- All public
- Strongest model tested
- GPT-6 Astra #3 on the capability index
- Last in a launch post
- November 2025, dropped before it saturated
- Last model added
- October 2026
- Scores refreshed
- November 12th, 2026
Kimi K3.1 Pro leads with 83.2
Best score per entry from the benchmark's own leaderboard, read on November 12th, 2026. Where a model ran with several settings or harnesses, we keep its best. Names in gray aren't in our model list: fine-tunes, agent systems, products and older models. They don't count toward leaders.
Qwen3-235B-A22B-Thinking leads with 86.1, claims included
Best score per model from every source, including labs’ own numbers and claims Epoch AI collected from reports and papers. Labs pick their own settings, so a claim can beat an independent run of the same model.
- 83.2 Kimi K3.1 Pro
- 82.2 GLM-5.3
- 82.2 ox-alpha
- 81.9 Claude Fable 5
- 81.8 Kimi K3
- 81.3 Claude Fable 5.1
- 81.3 Claude Opus 5
- 81.1
Muse Wonder
- 80.8 GPT-5.6 Sol
- 80.7 Claude Opus 4.7
- 80.6 aion-3.5
- 80.3 GPT-6 Sol
- 79.9 Claude Opus 5.5
- 79.8
Muse Spark 1.1
- 79.8 Grok 4.7
- 79.7 Claude Opus 4.8
- 79.7 GPT-6 Astra
- 79.5 GPT-5.6 Terra
- 79.5 GPT-5.5
- 78.8 GPT-5.4
- 78.5 GPT-5.6 Luna
- 78.3 Claude Opus 4.6
- 78.2
Muse Spark 1.3
- 78.0
Gemini 3.8 Flash
- 78.0
Muse Spark 1.2
- 77.8
Gemini 4 Argon
- 77.7 Claude Sonnet 4.6
- 77.3 Altworld/Hemmingway-1
- 76.6 GLM-5.2
- 76.5
Qwen3.8-2.4T-A95B
- 76.3 Claude Sonnet 5
- 76.1
Gemini 3.7 Flash
- 75.0 Kimi K2
- 75.0 Claude Opus 4.5
- 75.0
DeepSeek-V4-Pro
- 74.7 Kimi K2.6
- 74.3
Gemini 3 Pro
- 74.0 GPT-5.2
- 73.5 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4
- 73.3 Kimi K2 Thinking
- 73.3 openrouter/horizon-beta
- 73.3 o3
- 72.7 GPT-5
- 72.5 GPT-5.4 Mini
- 72.5
Gemini 3.6 Flash
- 72.3
Gemini 2.5 Pro
- 72.3
Gemini 3.5 Flash-Lite
- 72.2 Claude Sonnet 4.5
- 72.2 GLM-5.1
- 71.9 openrouter/pony-alpha
- 71.7
DeepSeek-V3.2
- 71.4 MiMo-V2.5-Pro
- 71.2
Gemini 3.1 Pro
- 71.0 GPT-5.3 Instant
- 70.9
Inkling
- 70.7 hunter-alpha
- 70.6 GLM-5
- 70.5 Grok 4.5
- 70.4 Kimi K2.5
- 70.3
DeepSeek V4.1 Flash
- 70.2 GLM-4.7
- 70.0 Claude Opus 4
- 69.9
DeepSeek-V3.1
- 69.8
DeepSeek-V4-Flash
- 69.3 GLM-4.6
- 68.8 openrouter/horizon-alpha
- 68.8 GPT-4o
- 68.6 meta-models/Muse-Glimmer-30B
- 68.3
DeepSeek-R1
- 68.2 space-bunny-alpha
- 68.0
Gemma 4 31B IT
- 67.5
DeepSeek V4 Flash 0731
- 66.7 Hermes 4 405B
- 66.3
Qwen3.5 397B-A17B
- 66.3
Mistral Medium 3.1
- 65.8
Gemma 4 26B A4B
- 65.8
DeepSeek-V3
- 65.8 GPT-4.1
- 65.7 Grok 4.20
- 65.4 Claude Sonnet 4
- 64.8
Qwen 3.8 27B
- 64.7 Claude 3.7 Sonnet
- 64.5 optimus-alpha
- 64.2 Claude 3.5 Sonnet
- 63.8
Qwen3-235B-A22B
- 63.0 GLM-4.5
- 63.0 GPT-4o
- 62.3
Mistral Large 3
- 62.3 quasar-alpha
- 62.2 Grok 3
- 61.9
Gemma 4 12B
- 61.8 AlexWortega/Qwen3.8-27B-antislop
- 61.4 Grok 4.1 Fast
- 61.2 openrouter/sherlock-dash-alpha
- 60.9 mistral-small-creative
- 60.6 GPT-4.5
- 60.2
MiniMax-M2.5
- 60.0
DeepSeek-V3.2-Speciale
- 60.0 GPT-5 mini
- 58.9
Inkling-Small
- 58.7
Gemma 3 27B
- 58.7
Gemini 2.5 Flash
- 58.0 CohereForAI/c4ai-command-a-03-2025
- 58.0
Gemma 4 E4B
- 58.0
Nemotron 3.5 Lightning 30B-A3B
- 57.2
Mistral Small 3.2
- 57.0
Gemini 2.0 Flash
- 57.0
Nemotron 3.5 Bolt E4B
- 57.0
Gemma 3 12B
- 56.8 allura-org/Gemma-3-Glitter-12B
- 56.5
QwQ-32B
- 55.5 GPT-4.1 mini
- 55.2 glm-4.7-flash
- 54.8 Reka Flash 3
- 54.1
Gemma 3 4B
- 54.1 Claude 3.5 Haiku
- 53.5 sam-paech/Darkest-muse-v1
- 53.0 THUDM/GLM-4-32B-0414
- 52.5 ifable/gemma-2-Ifable-9B
- 51.9 GPT-4o mini
- 51.9
Mistral Large 2
- 51.7
Pixtral Large
- 51.7
Llama 4 Maverick
- 51.5
Llama 3.1-405B
- 50.9 GPT-4.1 nano
- 50.8 GPT-4
- 50.8
Llama 3.1-70B
- 49.5
Gemma 2 9B
- 48.3 Claude 3 Haiku
- 48.0
Mistral NeMo
- 47.9 gpt-oss-120b
- 47.5 ToastyPigeon/Gemma-3-Starshine-12B
- 47.2
Llama 3.1-8B
- 46.7 liquid/lfm-7b
- 46.6
Llama 4 Scout
- 45.9 GPT-5 nano
- 45.0 openrouter/cypher-alpha
- 44.5 Nanbeige/Nanbeige4-3B-Thinking-2511
- 42.8
Llama 3.2 3B
- 42.5 GPT-3.5 Turbo
- 42.4
Mistral Small 3
- 42.3
Mistral Small 3.1
- 40.5 gpt-oss-20b
- 31.9
Llama 3.2 1B
- 1 Kimi K3.1 Pro 83.2
- 2 GLM-5.3 82.2
- 3 ox-alpha 82.2
- 4 Claude Fable 5 81.9
- 5 Kimi K3 81.8
- 6 Claude Fable 5.1 81.3
- 7 Claude Opus 5 81.3
- 8
Muse Wonder 81.1
- 9 GPT-5.6 Sol 80.8
- 10 Claude Opus 4.7 80.7
- 11 aion-3.5 80.6
- 12 GPT-6 Sol 80.3
- 13 Claude Opus 5.5 79.9
- 14
Muse Spark 1.1 79.8
- 15 Grok 4.7 79.8
- 16 Claude Opus 4.8 79.7
- 17 GPT-6 Astra 79.7
- 18 GPT-5.6 Terra 79.5
- 19 GPT-5.5 79.5
- 20 GPT-5.4 78.8
- 21 GPT-5.6 Luna 78.5
- 22 Claude Opus 4.6 78.3
- 23
Muse Spark 1.3 78.2
- 24
Gemini 3.8 Flash 78.0
- 25
Muse Spark 1.2 78.0
- 26
Gemini 4 Argon 77.8
- 27 Claude Sonnet 4.6 77.7
- 28 Altworld/Hemmingway-1 77.3
- 29 GLM-5.2 76.6
- 30
Qwen3.8-2.4T-A95B 76.5
- 31 Claude Sonnet 5 76.3
- 32
Gemini 3.7 Flash 76.1
- 33 Kimi K2 Jul 2025 75.0
- 34 Claude Opus 4.5 75.0
- 35
DeepSeek-V4-Pro 75.0
- 36 Kimi K2.6 74.7
- 37
Gemini 3 Pro 74.3
- 38 GPT-5.2 74.0
- 39 nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 73.5
- 40 Kimi K2 Thinking 73.3
- 41 openrouter/horizon-beta 73.3
- 42 o3 73.3
- 43 GPT-5 72.7
- 44 GPT-5.4 Mini 72.5
- 45
Gemini 3.6 Flash 72.5
- 46
Gemini 2.5 Pro Jun 2025 72.3
- 47
Gemini 3.5 Flash-Lite 72.3
- 48 Claude Sonnet 4.5 72.2
- 49 GLM-5.1 72.2
- 50 openrouter/pony-alpha 71.9
- 51
DeepSeek-V3.2 71.7
- 52 MiMo-V2.5-Pro 71.4
- 53
Gemini 3.1 Pro 71.2
- 54 GPT-5.3 Instant 71.0
- 55
Inkling 70.9
- 56 hunter-alpha 70.7
- 57 GLM-5 70.6
- 58 Grok 4.5 70.5
- 59 Kimi K2.5 70.4
- 60
DeepSeek V4.1 Flash 70.3
- 61 GLM-4.7 70.2
- 62 Claude Opus 4 70.0
- 63
DeepSeek-V3.1 69.9
- 64
DeepSeek-V4-Flash 69.8
- 65 GLM-4.6 69.3
- 66 openrouter/horizon-alpha 68.8
- 67 GPT-4o Mar 2025 68.8
- 68 meta-models/Muse-Glimmer-30B 68.6
- 69
DeepSeek-R1 May 2025 68.3
- 70 space-bunny-alpha 68.2
- 71
Gemma 4 31B IT 68.0
- 72
DeepSeek V4 Flash 0731 67.5
- 73 Hermes 4 405B 66.7
- 74
Qwen3.5 397B-A17B 66.3
- 75
Mistral Medium 3.1 66.3
- 76
Gemma 4 26B A4B 65.8
- 77
DeepSeek-V3 Mar 2025 65.8
- 78 GPT-4.1 65.8
- 79 Grok 4.20 65.7
- 80 Claude Sonnet 4 65.4
- 81
Qwen 3.8 27B 64.8
- 82 Claude 3.7 Sonnet 64.7
- 83 optimus-alpha 64.5
- 84 Claude 3.5 Sonnet 64.2
- 85
Qwen3-235B-A22B 63.8
- 86 GLM-4.5 63.0
- 87 GPT-4o Jan 2025 63.0
- 88
Mistral Large 3 62.3
- 89 quasar-alpha 62.3
- 90 Grok 3 62.2
- 91
Gemma 4 12B 61.9
- 92 AlexWortega/Qwen3.8-27B-antislop 61.8
- 93 Grok 4.1 Fast 61.4
- 94 openrouter/sherlock-dash-alpha 61.2
- 95 mistral-small-creative 60.9
- 96 GPT-4.5 60.6
- 97
MiniMax-M2.5 60.2
- 98
DeepSeek-V3.2-Speciale 60.0
- 99 GPT-5 mini 60.0
- 100
Inkling-Small 58.9
- 101
Gemma 3 27B 58.7
- 102
Gemini 2.5 Flash Sep 2025 58.7
- 103 CohereForAI/c4ai-command-a-03-2025 58.0
- 104
Gemma 4 E4B 58.0
- 105
Nemotron 3.5 Lightning 30B-A3B 58.0
- 106
Mistral Small 3.2 57.2
- 107
Gemini 2.0 Flash Feb 2025 57.0
- 108
Nemotron 3.5 Bolt E4B 57.0
- 109
Gemma 3 12B 57.0
- 110 allura-org/Gemma-3-Glitter-12B 56.8
- 111
QwQ-32B 56.5
- 112 GPT-4.1 mini 55.5
- 113 glm-4.7-flash 55.2
- 114 Reka Flash 3 54.8
- 115
Gemma 3 4B 54.1
- 116 Claude 3.5 Haiku 54.1
- 117 sam-paech/Darkest-muse-v1 53.5
- 118 THUDM/GLM-4-32B-0414 53.0
- 119 ifable/gemma-2-Ifable-9B 52.5
- 120 GPT-4o mini 51.9
- 121
Mistral Large 2 Nov 2024 51.9
- 122
Pixtral Large 51.7
- 123
Llama 4 Maverick 51.7
- 124
Llama 3.1-405B 51.5
- 125 GPT-4.1 nano 50.9
- 126 GPT-4 Mar 2023 50.8
- 127
Llama 3.1-70B 50.8
- 128
Gemma 2 9B 49.5
- 129 Claude 3 Haiku 48.3
- 130
Mistral NeMo 48.0
- 131 gpt-oss-120b 47.9
- 132 ToastyPigeon/Gemma-3-Starshine-12B 47.5
- 133
Llama 3.1-8B 47.2
- 134 liquid/lfm-7b 46.7
- 135
Llama 4 Scout 46.6
- 136 GPT-5 nano 45.9
- 137 openrouter/cypher-alpha 45.0
- 138 Nanbeige/Nanbeige4-3B-Thinking-2511 44.5
- 139
Llama 3.2 3B 42.8
- 140 GPT-3.5 Turbo Jun 2023 42.5
- 141
Mistral Small 3 42.4
- 142
Mistral Small 3.1 42.3
- 143 gpt-oss-20b 40.5
- 144
Llama 3.2 1B 31.9
Source: Official Creative Writing v3 leaderboard
- 86.1
Qwen3-235B-A22B-Thinking
- 85.7
Qwen3-VL-235B-A22B
- 85.4
Ring-1T
- 84.6
Qwen3-235B-A22B
- 83.2 Kimi K3.1 Pro
- 82.2 GLM-5.3
- 81.9 Claude Fable 5
- 81.8 Kimi K3
- 81.3 Claude Fable 5.1
- 81.3 Claude Opus 5
- 81.1
Muse Wonder
- 81.0
Qwen3-32B
- 80.8 GPT-5.6 Sol
- 80.7 Claude Opus 4.7
- 80.6
Qwen3-Omni-30B-A3B
- 80.3
Qwen3-14B
- 80.3 GPT-6 Sol
- 79.9 Claude Opus 5.5
- 79.8
Muse Spark 1.1
- 79.8 Hermes 4 405B
- 79.8 Grok 4.7
- 79.7 Claude Opus 4.8
- 79.7 GPT-6 Astra
- 79.5 GPT-5.6 Terra
- 79.5 GPT-5.5
- 79.1
Qwen3-30B-A3B
- 78.8 GPT-5.4
- 78.5 GPT-5.6 Luna
- 78.3 Claude Opus 4.6
- 78.2
Muse Spark 1.3
- 78.0
Gemini 3.8 Flash
- 78.0
Muse Spark 1.2
- 77.8
Gemini 4 Argon
- 77.7 Claude Sonnet 4.6
- 76.6 GLM-5.2
- 76.5
Qwen3.8-2.4T-A95B
- 76.3 Claude Sonnet 5
- 76.1
Gemini 3.7 Flash
- 75.0
Qwen3-8B
- 75.0 Kimi K2
- 75.0 Claude Opus 4.5
- 75.0
DeepSeek-V4-Pro
- 74.7 Kimi K2.6
- 74.3
Gemini 3 Pro
- 74.0 GPT-5.2
- 73.3 Kimi K2 Thinking
- 73.3 o3
- 72.7 GPT-5
- 72.5 GPT-5.4 Mini
- 72.5
Gemini 3.6 Flash
- 72.3
Gemini 2.5 Pro
- 72.3
Gemini 3.5 Flash-Lite
- 72.2 Claude Sonnet 4.5
- 72.2 GLM-5.1
- 71.7
DeepSeek-V3.2
- 71.4 MiMo-V2.5-Pro
- 71.2
Gemini 3.1 Pro
- 71.0 GPT-5.3 Instant
- 70.9
Inkling
- 70.6 GLM-5
- 70.5 Grok 4.5
- 70.4 Kimi K2.5
- 70.3
DeepSeek V4.1 Flash
- 70.2 GLM-4.7
- 70.0 Claude Opus 4
- 69.9
DeepSeek-V3.1
- 69.8
DeepSeek-V4-Flash
- 69.3 GLM-4.6
- 68.8 GPT-4o
- 68.3
DeepSeek-R1
- 68.0
Gemma 4 31B IT
- 67.5
DeepSeek V4 Flash 0731
- 66.3
Qwen3.5 397B-A17B
- 66.3
Mistral Medium 3.1
- 65.8
Gemma 4 26B A4B
- 65.8
DeepSeek-V3
- 65.8 GPT-4.1
- 65.7 Grok 4.20
- 65.4 Claude Sonnet 4
- 64.8
Qwen 3.8 27B
- 64.7 Claude 3.7 Sonnet
- 64.2 Claude 3.5 Sonnet
- 63.0 GLM-4.5
- 63.0 GPT-4o
- 62.3
Mistral Large 3
- 62.2 Grok 3
- 61.9
Gemma 4 12B
- 61.4 Grok 4.1 Fast
- 61.1
Qwen3-4B
- 60.6 GPT-4.5
- 60.2
MiniMax-M2.5
- 60.0
DeepSeek-V3.2-Speciale
- 60.0 GPT-5 mini
- 58.9
Inkling-Small
- 58.7
Gemma 3 27B
- 58.7
Gemini 2.5 Flash
- 58.0
Gemma 4 E4B
- 58.0
Nemotron 3.5 Lightning 30B-A3B
- 57.2
Mistral Small 3.2
- 57.0
Gemini 2.0 Flash
- 57.0
Nemotron 3.5 Bolt E4B
- 57.0
Gemma 3 12B
- 56.5
QwQ-32B
- 55.5 GPT-4.1 mini
- 55.2 glm-4.7-flash
- 54.8 Reka Flash 3
- 54.1
Gemma 3 4B
- 54.1 Claude 3.5 Haiku
- 51.9 GPT-4o mini
- 51.9
Mistral Large 2
- 51.7
Pixtral Large
- 51.7
Llama 4 Maverick
- 51.5
Llama 3.1-405B
- 50.9 GPT-4.1 nano
- 50.8 GPT-4
- 50.8
Llama 3.1-70B
- 49.5
Gemma 2 9B
- 48.3 Claude 3 Haiku
- 48.0
Mistral NeMo
- 48.0
Qwen3-1.7B
- 47.9 gpt-oss-120b
- 47.2
Llama 3.1-8B
- 46.6
Llama 4 Scout
- 45.9 GPT-5 nano
- 42.8
Llama 3.2 3B
- 42.5 GPT-3.5 Turbo
- 42.4
Mistral Small 3
- 42.3
Mistral Small 3.1
- 40.5 gpt-oss-20b
- 31.9
Llama 3.2 1B
- 1
Qwen3-235B-A22B-Thinking Jul 2025 86.1
- 2
Qwen3-VL-235B-A22B 85.7
- 3
Ring-1T 85.4
- 4
Qwen3-235B-A22B 84.6
- 5 Kimi K3.1 Pro 83.2
- 6 GLM-5.3 82.2
- 7 Claude Fable 5 81.9
- 8 Kimi K3 81.8
- 9 Claude Fable 5.1 81.3
- 10 Claude Opus 5 81.3
- 11
Muse Wonder 81.1
- 12
Qwen3-32B 81.0
- 13 GPT-5.6 Sol 80.8
- 14 Claude Opus 4.7 80.7
- 15
Qwen3-Omni-30B-A3B 80.6
- 16
Qwen3-14B 80.3
- 17 GPT-6 Sol 80.3
- 18 Claude Opus 5.5 79.9
- 19
Muse Spark 1.1 79.8
- 20 Hermes 4 405B 79.8
- 21 Grok 4.7 79.8
- 22 Claude Opus 4.8 79.7
- 23 GPT-6 Astra 79.7
- 24 GPT-5.6 Terra 79.5
- 25 GPT-5.5 79.5
- 26
Qwen3-30B-A3B 79.1
- 27 GPT-5.4 78.8
- 28 GPT-5.6 Luna 78.5
- 29 Claude Opus 4.6 78.3
- 30
Muse Spark 1.3 78.2
- 31
Gemini 3.8 Flash 78.0
- 32
Muse Spark 1.2 78.0
- 33
Gemini 4 Argon 77.8
- 34 Claude Sonnet 4.6 77.7
- 35 GLM-5.2 76.6
- 36
Qwen3.8-2.4T-A95B 76.5
- 37 Claude Sonnet 5 76.3
- 38
Gemini 3.7 Flash 76.1
- 39
Qwen3-8B 75.0
- 40 Kimi K2 Jul 2025 75.0
- 41 Claude Opus 4.5 75.0
- 42
DeepSeek-V4-Pro 75.0
- 43 Kimi K2.6 74.7
- 44
Gemini 3 Pro 74.3
- 45 GPT-5.2 74.0
- 46 Kimi K2 Thinking 73.3
- 47 o3 73.3
- 48 GPT-5 72.7
- 49 GPT-5.4 Mini 72.5
- 50
Gemini 3.6 Flash 72.5
- 51
Gemini 2.5 Pro Jun 2025 72.3
- 52
Gemini 3.5 Flash-Lite 72.3
- 53 Claude Sonnet 4.5 72.2
- 54 GLM-5.1 72.2
- 55
DeepSeek-V3.2 71.7
- 56 MiMo-V2.5-Pro 71.4
- 57
Gemini 3.1 Pro 71.2
- 58 GPT-5.3 Instant 71.0
- 59
Inkling 70.9
- 60 GLM-5 70.6
- 61 Grok 4.5 70.5
- 62 Kimi K2.5 70.4
- 63
DeepSeek V4.1 Flash 70.3
- 64 GLM-4.7 70.2
- 65 Claude Opus 4 70.0
- 66
DeepSeek-V3.1 69.9
- 67
DeepSeek-V4-Flash 69.8
- 68 GLM-4.6 69.3
- 69 GPT-4o Mar 2025 68.8
- 70
DeepSeek-R1 May 2025 68.3
- 71
Gemma 4 31B IT 68.0
- 72
DeepSeek V4 Flash 0731 67.5
- 73
Qwen3.5 397B-A17B 66.3
- 74
Mistral Medium 3.1 66.3
- 75
Gemma 4 26B A4B 65.8
- 76
DeepSeek-V3 Mar 2025 65.8
- 77 GPT-4.1 65.8
- 78 Grok 4.20 65.7
- 79 Claude Sonnet 4 65.4
- 80
Qwen 3.8 27B 64.8
- 81 Claude 3.7 Sonnet 64.7
- 82 Claude 3.5 Sonnet 64.2
- 83 GLM-4.5 63.0
- 84 GPT-4o Jan 2025 63.0
- 85
Mistral Large 3 62.3
- 86 Grok 3 62.2
- 87
Gemma 4 12B 61.9
- 88 Grok 4.1 Fast 61.4
- 89
Qwen3-4B 61.1
- 90 GPT-4.5 60.6
- 91
MiniMax-M2.5 60.2
- 92
DeepSeek-V3.2-Speciale 60.0
- 93 GPT-5 mini 60.0
- 94
Inkling-Small 58.9
- 95
Gemma 3 27B 58.7
- 96
Gemini 2.5 Flash Sep 2025 58.7
- 97
Gemma 4 E4B 58.0
- 98
Nemotron 3.5 Lightning 30B-A3B 58.0
- 99
Mistral Small 3.2 57.2
- 100
Gemini 2.0 Flash Feb 2025 57.0
- 101
Nemotron 3.5 Bolt E4B 57.0
- 102
Gemma 3 12B 57.0
- 103
QwQ-32B 56.5
- 104 GPT-4.1 mini 55.5
- 105 glm-4.7-flash 55.2
- 106 Reka Flash 3 54.8
- 107
Gemma 3 4B 54.1
- 108 Claude 3.5 Haiku 54.1
- 109 GPT-4o mini 51.9
- 110
Mistral Large 2 Nov 2024 51.9
- 111
Pixtral Large 51.7
- 112
Llama 4 Maverick 51.7
- 113
Llama 3.1-405B 51.5
- 114 GPT-4.1 nano 50.9
- 115 GPT-4 Mar 2023 50.8
- 116
Llama 3.1-70B 50.8
- 117
Gemma 2 9B 49.5
- 118 Claude 3 Haiku 48.3
- 119
Mistral NeMo 48.0
- 120
Qwen3-1.7B 48.0
- 121 gpt-oss-120b 47.9
- 122
Llama 3.1-8B 47.2
- 123
Llama 4 Scout 46.6
- 124 GPT-5 nano 45.9
- 125
Llama 3.2 3B 42.8
- 126 GPT-3.5 Turbo Jun 2023 42.5
- 127
Mistral Small 3 42.4
- 128
Mistral Small 3.1 42.3
- 129 gpt-oss-20b 40.5
- 130
Llama 3.2 1B 31.9
Sources: Labs’ model cards and official Creative Writing v3 leaderboard
| # | Entry | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | Kimi K3.1 Pro | 83.2 | Oct 2026 | Official leaderboard | |
| 2 | GLM-5.3 | 82.2 | Aug 2026 | Official leaderboard | |
| 3 | ox-alpha | 82.2 | Official leaderboard | ||
| 4 | Claude Fable 5 | 81.9 | Jun 2026 | Official leaderboard | |
| 5 | Kimi K3 | 81.8 | Jul 2026 | Official leaderboard | |
| 6 | Claude Fable 5.1 | 81.3 | Sep 2026 | Official leaderboard | |
| 7 | Claude Opus 5 | 81.3 | Jul 2026 | Official leaderboard | |
| 8 | | 81.1 | Oct 2026 | Official leaderboard | |
| 9 | GPT-5.6 Sol | 80.8 | Jul 2026 | Official leaderboard | |
| 10 | Claude Opus 4.7 | 80.7 | Apr 2026 | Official leaderboard | |
| 11 | aion-3.5 | 80.6 | Official leaderboard | ||
| 12 | GPT-6 Sol | 80.3 | Sep 2026 | Official leaderboard | |
| 13 | Claude Opus 5.5 | 79.9 | Sep 2026 | Official leaderboard | |
| 14 | | 79.8 | Jul 2026 | Official leaderboard | |
| 15 | Grok 4.7 | 79.8 | Sep 2026 | Official leaderboard | |
| 16 | Claude Opus 4.8 | 79.7 | May 2026 | Official leaderboard | |
| 17 | GPT-6 Astra | 79.7 | Sep 2026 | Official leaderboard | |
| 18 | GPT-5.6 Terra | 79.5 | Jul 2026 | Official leaderboard | |
| 19 | GPT-5.5 | 79.5 | Apr 2026 | Official leaderboard | |
| 20 | GPT-5.4 | 78.8 | Mar 2026 | Official leaderboard | |
| 21 | GPT-5.6 Luna | 78.5 | Jul 2026 | Official leaderboard | |
| 22 | Claude Opus 4.6 | 78.3 | Feb 2026 | Official leaderboard | |
| 23 | | 78.2 | Sep 2026 | Official leaderboard | |
| 24 | | 78.0 | Sep 2026 | Official leaderboard | |
| 25 | | 78.0 | Aug 2026 | Official leaderboard | |
| 26 | | 77.8 | Sep 2026 | Official leaderboard | |
| 27 | Claude Sonnet 4.6 | 77.7 | Feb 2026 | Official leaderboard | |
| 28 | Altworld/Hemmingway-1 | 77.3 | Official leaderboard | ||
| 29 | GLM-5.2 | 76.6 | Jun 2026 | Official leaderboard | |
| 30 | | 76.5 | Aug 2026 | Official leaderboard | |
| 31 | Claude Sonnet 5 | 76.3 | Jun 2026 | Official leaderboard | |
| 32 | | 76.1 | Aug 2026 | Official leaderboard | |
| 33 | Kimi K2 Jul 2025 | 75.0 | Jul 2025 | Official leaderboard | |
| 34 | Claude Opus 4.5 | 75.0 | Nov 2025 | Official leaderboard | |
| 35 | | 75.0 | Apr 2026 | Official leaderboard | |
| 36 | Kimi K2.6 | 74.7 | Apr 2026 | Official leaderboard | |
| 37 | | 74.3 | Nov 2025 | Official leaderboard | |
| 38 | GPT-5.2 | 74.0 | Dec 2025 | Official leaderboard | |
| 39 | nvidia/NVIDIA-Nemotron-3-Ultra-550B-A55B-NVFP4 | 73.5 | Official leaderboard | ||
| 40 | Kimi K2 Thinking | 73.3 | Nov 2025 | Official leaderboard | |
| 41 | openrouter/horizon-beta | 73.3 | Official leaderboard | ||
| 42 | o3 | 73.3 | Apr 2025 | Official leaderboard | |
| 43 | GPT-5 | 72.7 | Aug 2025 | Official leaderboard | |
| 44 | GPT-5.4 Mini | 72.5 | Mar 2026 | Official leaderboard | |
| 45 | | 72.5 | Jul 2026 | Official leaderboard | |
| 46 | | 72.3 | Jun 2025 | Official leaderboard | |
| 47 | | 72.3 | Jul 2026 | Official leaderboard | |
| 48 | Claude Sonnet 4.5 | 72.2 | Sep 2025 | Official leaderboard | |
| 49 | GLM-5.1 | 72.2 | Apr 2026 | Official leaderboard | |
| 50 | openrouter/pony-alpha | 71.9 | Official leaderboard | ||
| 51 | | 71.7 | Dec 2025 | Official leaderboard | |
| 52 | MiMo-V2.5-Pro | 71.4 | Apr 2026 | Official leaderboard | |
| 53 | | 71.2 | Feb 2026 | Official leaderboard | |
| 54 | GPT-5.3 Instant | 71.0 | Mar 2026 | Official leaderboard | |
| 55 | | 70.9 | Jul 2026 | Official leaderboard | |
| 56 | hunter-alpha | 70.7 | Official leaderboard | ||
| 57 | GLM-5 | 70.6 | Feb 2026 | Official leaderboard | |
| 58 | Grok 4.5 | 70.5 | Jul 2026 | Official leaderboard | |
| 59 | Kimi K2.5 | 70.4 | Jan 2026 | Official leaderboard | |
| 60 | | 70.3 | Sep 2026 | Official leaderboard | |
| 61 | GLM-4.7 | 70.2 | Dec 2025 | Official leaderboard | |
| 62 | Claude Opus 4 | 70.0 | May 2025 | Official leaderboard | |
| 63 | | 69.9 | Aug 2025 | Official leaderboard | |
| 64 | | 69.8 | Apr 2026 | Official leaderboard | |
| 65 | GLM-4.6 | 69.3 | Sep 2025 | Official leaderboard | |
| 66 | openrouter/horizon-alpha | 68.8 | Official leaderboard | ||
| 67 | GPT-4o Mar 2025 | 68.8 | Mar 2025 | Official leaderboard | |
| 68 | meta-models/Muse-Glimmer-30B | 68.6 | Official leaderboard | ||
| 69 | | 68.3 | May 2025 | Official leaderboard | |
| 70 | space-bunny-alpha | 68.2 | Official leaderboard | ||
| 71 | | 68.0 | Apr 2026 | Official leaderboard | |
| 72 | | 67.5 | Jul 2026 | Official leaderboard | |
| 73 | Hermes 4 405B | 66.7 | Aug 2025 | Official leaderboard | |
| 74 | | 66.3 | Feb 2026 | Official leaderboard | |
| 75 | | 66.3 | Aug 2025 | Official leaderboard | |
| 76 | | 65.8 | Apr 2026 | Official leaderboard | |
| 77 | | 65.8 | Mar 2025 | Official leaderboard | |
| 78 | GPT-4.1 | 65.8 | Apr 2025 | Official leaderboard | |
| 79 | Grok 4.20 | 65.7 | Feb 2026 | Official leaderboard | |
| 80 | Claude Sonnet 4 | 65.4 | May 2025 | Official leaderboard | |
| 81 | | 64.8 | Aug 2026 | Official leaderboard | |
| 82 | Claude 3.7 Sonnet | 64.7 | Feb 2025 | Official leaderboard | |
| 83 | optimus-alpha | 64.5 | Official leaderboard | ||
| 84 | Claude 3.5 Sonnet | 64.2 | Jun 2024 | Official leaderboard | |
| 85 | | 63.8 | Apr 2025 | Official leaderboard | |
| 86 | GLM-4.5 | 63.0 | Aug 2025 | Official leaderboard | |
| 87 | GPT-4o Jan 2025 | 63.0 | Jan 2025 | Official leaderboard | |
| 88 | | 62.3 | Dec 2025 | Official leaderboard | |
| 89 | quasar-alpha | 62.3 | Official leaderboard | ||
| 90 | Grok 3 | 62.2 | Apr 2025 | Official leaderboard | |
| 91 | | 61.9 | Jun 2026 | Official leaderboard | |
| 92 | AlexWortega/Qwen3.8-27B-antislop | 61.8 | Official leaderboard | ||
| 93 | Grok 4.1 Fast | 61.4 | Nov 2025 | Official leaderboard | |
| 94 | openrouter/sherlock-dash-alpha | 61.2 | Official leaderboard | ||
| 95 | mistral-small-creative | 60.9 | Official leaderboard | ||
| 96 | GPT-4.5 | 60.6 | Feb 2025 | Official leaderboard | |
| 97 | | 60.2 | Feb 2026 | Official leaderboard | |
| 98 | | 60.0 | Dec 2025 | Official leaderboard | |
| 99 | GPT-5 mini | 60.0 | Aug 2025 | Official leaderboard | |
| 100 | | 58.9 | Jul 2026 | Official leaderboard | |
| 101 | | 58.7 | Mar 2025 | Official leaderboard | |
| 102 | | 58.7 | Sep 2025 | Official leaderboard | |
| 103 | CohereForAI/c4ai-command-a-03-2025 | 58.0 | Official leaderboard | ||
| 104 | | 58.0 | Mar 2026 | Official leaderboard | |
| 105 | | 58.0 | Aug 2026 | Official leaderboard | |
| 106 | | 57.2 | Jun 2025 | Official leaderboard | |
| 107 | | 57.0 | Feb 2025 | Official leaderboard | |
| 108 | | 57.0 | Oct 2026 | Official leaderboard | |
| 109 | | 57.0 | Mar 2025 | Official leaderboard | |
| 110 | allura-org/Gemma-3-Glitter-12B | 56.8 | Official leaderboard | ||
| 111 | | 56.5 | Mar 2025 | Official leaderboard | |
| 112 | GPT-4.1 mini | 55.5 | Apr 2025 | Official leaderboard | |
| 113 | glm-4.7-flash | 55.2 | Jan 2026 | Official leaderboard | |
| 114 | Reka Flash 3 | 54.8 | Mar 2025 | Official leaderboard | |
| 115 | | 54.1 | Mar 2025 | Official leaderboard | |
| 116 | Claude 3.5 Haiku | 54.1 | Oct 2024 | Official leaderboard | |
| 117 | sam-paech/Darkest-muse-v1 | 53.5 | Official leaderboard | ||
| 118 | THUDM/GLM-4-32B-0414 | 53.0 | Official leaderboard | ||
| 119 | ifable/gemma-2-Ifable-9B | 52.5 | Official leaderboard | ||
| 120 | GPT-4o mini | 51.9 | Jul 2024 | Official leaderboard | |
| 121 | | 51.9 | Nov 2024 | Official leaderboard | |
| 122 | | 51.7 | Nov 2024 | Official leaderboard | |
| 123 | | 51.7 | Apr 2025 | Official leaderboard | |
| 124 | | 51.5 | Jul 2024 | Official leaderboard | |
| 125 | GPT-4.1 nano | 50.9 | Apr 2025 | Official leaderboard | |
| 126 | GPT-4 Mar 2023 | 50.8 | Mar 2023 | Official leaderboard | |
| 127 | | 50.8 | Jul 2024 | Official leaderboard | |
| 128 | | 49.5 | Jun 2024 | Official leaderboard | |
| 129 | Claude 3 Haiku | 48.3 | Mar 2024 | Official leaderboard | |
| 130 | | 48.0 | Jul 2024 | Official leaderboard | |
| 131 | gpt-oss-120b | 47.9 | Aug 2025 | Official leaderboard | |
| 132 | ToastyPigeon/Gemma-3-Starshine-12B | 47.5 | Official leaderboard | ||
| 133 | | 47.2 | Jul 2024 | Official leaderboard | |
| 134 | liquid/lfm-7b | 46.7 | Official leaderboard | ||
| 135 | | 46.6 | Apr 2025 | Official leaderboard | |
| 136 | GPT-5 nano | 45.9 | Aug 2025 | Official leaderboard | |
| 137 | openrouter/cypher-alpha | 45.0 | Official leaderboard | ||
| 138 | Nanbeige/Nanbeige4-3B-Thinking-2511 | 44.5 | Official leaderboard | ||
| 139 | | 42.8 | Sep 2024 | Official leaderboard | |
| 140 | GPT-3.5 Turbo Jun 2023 | 42.5 | Jun 2023 | Official leaderboard | |
| 141 | | 42.4 | Jan 2025 | Official leaderboard | |
| 142 | | 42.3 | Mar 2025 | Official leaderboard | |
| 143 | gpt-oss-20b | 40.5 | Aug 2025 | Official leaderboard | |
| 144 | | 31.9 | Sep 2024 | Official leaderboard |
| # | Model | Score | Setting | Date | Source |
|---|---|---|---|---|---|
| 1 | | 86.1 | Jul 2025 | Lab model card | |
| 2 | | 85.7 | Sep 2025 | Lab model card | |
| 3 | | 85.4 | Oct 2025 | Lab model card | |
| 4 | | 84.6 | Apr 2025 | Lab model card | |
| 5 | Kimi K3.1 Pro | 83.2 | Oct 2026 | Official leaderboard | |
| 6 | GLM-5.3 | 82.2 | Aug 2026 | Official leaderboard | |
| 7 | Claude Fable 5 | 81.9 | Jun 2026 | Official leaderboard | |
| 8 | Kimi K3 | 81.8 | Jul 2026 | Official leaderboard | |
| 9 | Claude Fable 5.1 | 81.3 | Sep 2026 | Official leaderboard | |
| 10 | Claude Opus 5 | 81.3 | Jul 2026 | Official leaderboard | |
| 11 | | 81.1 | Oct 2026 | Official leaderboard | |
| 12 | | 81.0 | May 2025 | Lab model card | |
| 13 | GPT-5.6 Sol | 80.8 | Jul 2026 | Official leaderboard | |
| 14 | Claude Opus 4.7 | 80.7 | Apr 2026 | Official leaderboard | |
| 15 | | 80.6 | Sep 2025 | Lab model card | |
| 16 | | 80.3 | May 2025 | Lab model card | |
| 17 | GPT-6 Sol | 80.3 | Sep 2026 | Official leaderboard | |
| 18 | Claude Opus 5.5 | 79.9 | Sep 2026 | Official leaderboard | |
| 19 | | 79.8 | Jul 2026 | Official leaderboard | |
| 20 | Hermes 4 405B | 79.8 | Aug 2025 | Lab model card | |
| 21 | Grok 4.7 | 79.8 | Sep 2026 | Official leaderboard | |
| 22 | Claude Opus 4.8 | 79.7 | May 2026 | Official leaderboard | |
| 23 | GPT-6 Astra | 79.7 | Sep 2026 | Official leaderboard | |
| 24 | GPT-5.6 Terra | 79.5 | Jul 2026 | Official leaderboard | |
| 25 | GPT-5.5 | 79.5 | Apr 2026 | Official leaderboard | |
| 26 | | 79.1 | May 2025 | Lab model card | |
| 27 | GPT-5.4 | 78.8 | Mar 2026 | Official leaderboard | |
| 28 | GPT-5.6 Luna | 78.5 | Jul 2026 | Official leaderboard | |
| 29 | Claude Opus 4.6 | 78.3 | Feb 2026 | Official leaderboard | |
| 30 | | 78.2 | Sep 2026 | Official leaderboard | |
| 31 | | 78.0 | Sep 2026 | Official leaderboard | |
| 32 | | 78.0 | Aug 2026 | Official leaderboard | |
| 33 | | 77.8 | Sep 2026 | Official leaderboard | |
| 34 | Claude Sonnet 4.6 | 77.7 | Feb 2026 | Official leaderboard | |
| 35 | GLM-5.2 | 76.6 | Jun 2026 | Official leaderboard | |
| 36 | | 76.5 | Aug 2026 | Official leaderboard | |
| 37 | Claude Sonnet 5 | 76.3 | Jun 2026 | Official leaderboard | |
| 38 | | 76.1 | Aug 2026 | Official leaderboard | |
| 39 | | 75.0 | May 2025 | Lab model card | |
| 40 | Kimi K2 Jul 2025 | 75.0 | Jul 2025 | Official leaderboard | |
| 41 | Claude Opus 4.5 | 75.0 | Nov 2025 | Official leaderboard | |
| 42 | | 75.0 | Apr 2026 | Official leaderboard | |
| 43 | Kimi K2.6 | 74.7 | Apr 2026 | Official leaderboard | |
| 44 | | 74.3 | Nov 2025 | Official leaderboard | |
| 45 | GPT-5.2 | 74.0 | Dec 2025 | Official leaderboard | |
| 46 | Kimi K2 Thinking | 73.3 | Nov 2025 | Official leaderboard | |
| 47 | o3 | 73.3 | Apr 2025 | Official leaderboard | |
| 48 | GPT-5 | 72.7 | Aug 2025 | Official leaderboard | |
| 49 | GPT-5.4 Mini | 72.5 | Mar 2026 | Official leaderboard | |
| 50 | | 72.5 | Jul 2026 | Official leaderboard | |
| 51 | | 72.3 | Jun 2025 | Official leaderboard | |
| 52 | | 72.3 | Jul 2026 | Official leaderboard | |
| 53 | Claude Sonnet 4.5 | 72.2 | Sep 2025 | Official leaderboard | |
| 54 | GLM-5.1 | 72.2 | Apr 2026 | Official leaderboard | |
| 55 | | 71.7 | Dec 2025 | Official leaderboard | |
| 56 | MiMo-V2.5-Pro | 71.4 | Apr 2026 | Official leaderboard | |
| 57 | | 71.2 | Feb 2026 | Official leaderboard | |
| 58 | GPT-5.3 Instant | 71.0 | Mar 2026 | Official leaderboard | |
| 59 | | 70.9 | Jul 2026 | Official leaderboard | |
| 60 | GLM-5 | 70.6 | Feb 2026 | Official leaderboard | |
| 61 | Grok 4.5 | 70.5 | Jul 2026 | Official leaderboard | |
| 62 | Kimi K2.5 | 70.4 | Jan 2026 | Official leaderboard | |
| 63 | | 70.3 | Sep 2026 | Official leaderboard | |
| 64 | GLM-4.7 | 70.2 | Dec 2025 | Official leaderboard | |
| 65 | Claude Opus 4 | 70.0 | May 2025 | Official leaderboard | |
| 66 | | 69.9 | Aug 2025 | Official leaderboard | |
| 67 | | 69.8 | Apr 2026 | Official leaderboard | |
| 68 | GLM-4.6 | 69.3 | Sep 2025 | Official leaderboard | |
| 69 | GPT-4o Mar 2025 | 68.8 | Mar 2025 | Official leaderboard | |
| 70 | | 68.3 | May 2025 | Official leaderboard | |
| 71 | | 68.0 | Apr 2026 | Official leaderboard | |
| 72 | | 67.5 | Jul 2026 | Official leaderboard | |
| 73 | | 66.3 | Feb 2026 | Official leaderboard | |
| 74 | | 66.3 | Aug 2025 | Official leaderboard | |
| 75 | | 65.8 | Apr 2026 | Official leaderboard | |
| 76 | | 65.8 | Mar 2025 | Official leaderboard | |
| 77 | GPT-4.1 | 65.8 | Apr 2025 | Official leaderboard | |
| 78 | Grok 4.20 | 65.7 | Feb 2026 | Official leaderboard | |
| 79 | Claude Sonnet 4 | 65.4 | May 2025 | Official leaderboard | |
| 80 | | 64.8 | Aug 2026 | Official leaderboard | |
| 81 | Claude 3.7 Sonnet | 64.7 | Feb 2025 | Official leaderboard | |
| 82 | Claude 3.5 Sonnet | 64.2 | Jun 2024 | Official leaderboard | |
| 83 | GLM-4.5 | 63.0 | Aug 2025 | Official leaderboard | |
| 84 | GPT-4o Jan 2025 | 63.0 | Jan 2025 | Official leaderboard | |
| 85 | | 62.3 | Dec 2025 | Official leaderboard | |
| 86 | Grok 3 | 62.2 | Apr 2025 | Official leaderboard | |
| 87 | | 61.9 | Jun 2026 | Official leaderboard | |
| 88 | Grok 4.1 Fast | 61.4 | Nov 2025 | Official leaderboard | |
| 89 | | 61.1 | May 2025 | Lab model card | |
| 90 | GPT-4.5 | 60.6 | Feb 2025 | Official leaderboard | |
| 91 | | 60.2 | Feb 2026 | Official leaderboard | |
| 92 | | 60.0 | Dec 2025 | Official leaderboard | |
| 93 | GPT-5 mini | 60.0 | Aug 2025 | Official leaderboard | |
| 94 | | 58.9 | Jul 2026 | Official leaderboard | |
| 95 | | 58.7 | Mar 2025 | Official leaderboard | |
| 96 | | 58.7 | Sep 2025 | Official leaderboard | |
| 97 | | 58.0 | Mar 2026 | Official leaderboard | |
| 98 | | 58.0 | Aug 2026 | Official leaderboard | |
| 99 | | 57.2 | Jun 2025 | Official leaderboard | |
| 100 | | 57.0 | Feb 2025 | Official leaderboard | |
| 101 | | 57.0 | Oct 2026 | Official leaderboard | |
| 102 | | 57.0 | Mar 2025 | Official leaderboard | |
| 103 | | 56.5 | Mar 2025 | Official leaderboard | |
| 104 | GPT-4.1 mini | 55.5 | Apr 2025 | Official leaderboard | |
| 105 | glm-4.7-flash | 55.2 | Jan 2026 | Official leaderboard | |
| 106 | Reka Flash 3 | 54.8 | Mar 2025 | Official leaderboard | |
| 107 | | 54.1 | Mar 2025 | Official leaderboard | |
| 108 | Claude 3.5 Haiku | 54.1 | Oct 2024 | Official leaderboard | |
| 109 | GPT-4o mini | 51.9 | Jul 2024 | Official leaderboard | |
| 110 | | 51.9 | Nov 2024 | Official leaderboard | |
| 111 | | 51.7 | Nov 2024 | Official leaderboard | |
| 112 | | 51.7 | Apr 2025 | Official leaderboard | |
| 113 | | 51.5 | Jul 2024 | Official leaderboard | |
| 114 | GPT-4.1 nano | 50.9 | Apr 2025 | Official leaderboard | |
| 115 | GPT-4 Mar 2023 | 50.8 | Mar 2023 | Official leaderboard | |
| 116 | | 50.8 | Jul 2024 | Official leaderboard | |
| 117 | | 49.5 | Jun 2024 | Official leaderboard | |
| 118 | Claude 3 Haiku | 48.3 | Mar 2024 | Official leaderboard | |
| 119 | | 48.0 | Jul 2024 | Official leaderboard | |
| 120 | | 48.0 | May 2025 | Lab model card | |
| 121 | gpt-oss-120b | 47.9 | Aug 2025 | Official leaderboard | |
| 122 | | 47.2 | Jul 2024 | Official leaderboard | |
| 123 | | 46.6 | Apr 2025 | Official leaderboard | |
| 124 | GPT-5 nano | 45.9 | Aug 2025 | Official leaderboard | |
| 125 | | 42.8 | Sep 2024 | Official leaderboard | |
| 126 | GPT-3.5 Turbo Jun 2023 | 42.5 | Jun 2023 | Official leaderboard | |
| 127 | | 42.4 | Jan 2025 | Official leaderboard | |
| 128 | | 42.3 | Mar 2025 | Official leaderboard | |
| 129 | gpt-oss-20b | 40.5 | Aug 2025 | Official leaderboard | |
| 130 | | 31.9 | Sep 2024 | Official leaderboard |
Labs report scores for 12 models in their cards. Switch the scores above to rank them together.
11 models have held number one on the official leaderboard since its release in March 2025 6 models have held number one with claims included since its release in March 2025
Lab claims count from the day the card came out, independent runs from the model’s release. We draw one row each for the benchmark’s own leaderboard and what labs claim in their cards.
Sources: Official Creative Writing v3 leaderboard and labs’ model cards
Scores over time
All the scores we have, one dot each, so a model tested at several settings appears more than once.
Sources: Official Creative Writing v3 leaderboard and labs’ model cards
No launch post has listed it since November 2025
Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.
| Date | Launch post | Score | As the post writes it |
|---|---|---|---|
| Nov 17, 2025 | Grok 4.1 | 1721.9 | Creative Writing v3 (Elo (Normalized)) |
| Oct 10, 2025 | 85.4 | Creative Writing v3 (score) | |
| Oct 7, 2025 | LFM2-8B-A1B | 44.2 | Creative Writing v3 |
| Sep 23, 2025 | 85.7 | Creative Writing v3 | |
| Sep 22, 2025 | 80.6 | Creative Writing v3 | |
| Aug 26, 2025 | Hermes 4 405B | 79.8 | CreativeWriting3 (reasoning) |
| Jul 25, 2025 | 86.1 | Creative Writing v3 | |
| Apr 29, 2025 | 84.6 | Creative Writing v3 |
11 system cards report it, from 3 labs
Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.
| Date | Document | Score | As the document writes it | Section |
|---|---|---|---|---|
| Nov 26, 2025 | | 85.7 | Creative Writing v3 (Table 6) | Capabilities |
| Oct 21, 2025 | | 85.4 | Creative Writing v3 (Table 1) | Capabilities |
| Sep 22, 2025 | | 80.6 | Creative Writing v3, Instruct (Table 4). Thinking 82.5 (Table 5) | Capabilities |
| Aug 25, 2025 | Hermes 4 405B technical report | 79.3 | CreativeWriting3, reasoning mode (Table 3). Non-reasoning 50.6. v1 printed 79.8 | Capabilities |
| May 14, 2025 | | 75 | Creative Writing v3, thinking mode (Table 17). Non-thinking 64.5 (Table 18) | Capabilities |
| May 14, 2025 | | 61.1 | Creative Writing v3, thinking mode (Table 17). Non-thinking 53.6 (Table 18) | Capabilities |
| May 14, 2025 | | 81 | Creative Writing v3, thinking mode (Table 13). Non-thinking 78.3 (Table 14) | Capabilities |
| May 14, 2025 | | 79.1 | Creative Writing v3, thinking mode (Table 15). Non-thinking 68.1 (Table 16) | Capabilities |
| May 14, 2025 | | 84.6 | Creative Writing v3, thinking mode (Table 11). Non-thinking 80.4 (Table 12) | Capabilities |
| May 14, 2025 | | 80.3 | Creative Writing v3, thinking mode (Table 15). Non-thinking 73.1 (Table 16) | Capabilities |
| May 14, 2025 | | 48 | Creative Writing v3, thinking mode (Table 19). Non-thinking 43.6 (Table 20) | Capabilities |
2 lab claims next to the leaderboard
Each score a lab reported for its own model, beside the same model's best score on the leaderboard. Gaps mostly come from different harnesses, effort levels and task subsets. Every benchmark.
| Model | Lab says | Board says | Gap |
|---|---|---|---|
| | 84.6 Creative Writing v3 | 63.8 Leaderboard | +20.8 |
| Hermes 4 405B | 79.8 CreativeWriting3 (reasoning) | 66.7 Leaderboard | +13.1 |
More in Writing and taste
- Design Bench (Moonshot) In use Models make graphic designs from direct prompts or few-shot reference images. An automated grader rates the results as Elo scores. Kimi K3.1 Pro 957
- WritingBench Fading Models complete 1,000 real-world writing requests across 6 domains and 100 subdomains. A judge model scores each reply on five query-specific criteria. GPT-5 83.9
- Creative Writing (MiniMax in-house) Only in system cards Models write creative pieces for real Hailuo AI user requests. Automatic assessments score the writing.
MiniMax-Text-01 81.3%
- DeepSeek Chinese functional writing evaluation Only in system cards Models answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate.
DeepSeek-V4-Pro 62.6%
- Slide generation human evaluation (Z.ai) Only in system cards People compare HTML slide decks from two models on content, layout and visual quality. Metric is overall win rate. GLM-5 67.5%
- Task-dependent output homogenization evaluation Only in system cards Models answer prompts several times. A judge scores functional diversity where it is wanted and consistency where one answer is right.
Muse Spark 0.21