Benchmark Almanac

Longform Writing

Dropped

Models write long-form text without tools, capped at 32k output tokens. Moonshot AI has not published the tasks or the scoring method.

In-house Moonshot AI evaluation with no public tasks.

Made by
Moonshot AI
Released
November 2025
Kind
Creative writing
Level
University
Scored
Graded by a model
Answers
Open-ended
Tasks
Kept private
Strongest model tested
Kimi K2 Thinking #93 on the capability index
Last in a launch post
November 2025, dropped before it saturated
Last model added
November 2025
1
Model scored in lab cards
1
Launch post lists it, from 1 lab

Kimi K2 Thinking leads with 73.8%

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

  1. 1 Kimi K2 Thinking 73.8%

Source: Labs’ model cards

#ModelScoreSettingDateSource
1 Kimi K2 Thinking 73.8% Nov 2025 Lab model card

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card
0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Kimi K2 Thinking 0% 20% 40% 60% 80% 100% 2026 Near the ceiling (85%) Kimi K2 Thinking

Source: Labs’ model cards

No launch post has listed it since November 2025

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Moonshot AI
DateLaunch postScoreAs the post writes it
Nov 6, 2025 Kimi K2 Thinking 73.8 Longform Writing, no tools

More in Writing and taste

All 30 in Writing and taste
  • Design Bench (Moonshot) In use Models make graphic designs from direct prompts or few-shot reference images. An automated grader rates the results as Elo scores. Kimi K3.1 Pro 957
  • WritingBench Fading Models complete 1,000 real-world writing requests across 6 domains and 100 subdomains. A judge model scores each reply on five query-specific criteria. GPT-5 83.9
  • Creative Writing (MiniMax in-house) Only in system cards Models write creative pieces for real Hailuo AI user requests. Automatic assessments score the writing. MiniMax-Text-01 81.3%
  • DeepSeek Chinese functional writing evaluation Only in system cards Models answer 3,170 everyday Chinese writing prompts such as reports, emails and speeches. Pairwise judging against a baseline model gives a win rate. DeepSeek-V4-Pro 62.6%
  • Slide generation human evaluation (Z.ai) Only in system cards People compare HTML slide decks from two models on content, layout and visual quality. Metric is overall win rate. GLM-5 67.5%
  • Task-dependent output homogenization evaluation Only in system cards Models answer prompts several times. A judge scores functional diversity where it is wanted and consistency where one answer is right. Muse Spark 0.21