DELEGATE-52
Models perform long delegated document-editing workflows across 52 professional domains. Scores measure artifact fidelity after repeated transformations.
The COLM 2026 paper evaluates 19 language models and reports degradation across long workflows.
- Made by
- Microsoft Research
- Released
- April 2026
- Kind
- Documents and spreadsheets
- Level
- Expert
- Scored
- Checked automatically
- Answers
- Agent task
- Measures
- Capability
- Language
- English
- Interaction
- Agentic
- Refresh
- One fixed set
- Run by
- A host
- In views
- Agents
No scores here yet
No lab, leaderboard or Epoch AI run has reported a score for DELEGATE-52 yet.
No lab model card reports it yet
We read the headline results of 540 launch posts from 57 labs, and none of them list this benchmark.
More in Economic work
- JobBench In use 130 tasks from 35 occupations workers most want delegated. Agent works through messy reference files, graded by fact-anchored binary rubrics. GLM-5.3 61.4%
- GDPval In use Real work tasks from 44 occupations with reference files. Experts blindly compare model deliverables with expert work. Metric is win-or-tie rate.
Seed2.1 Pro 87.9%
- GDPval-AA v2.1 In use Agents with shell and web access complete 220 GDPval gold tasks from 44 occupations. Blind pairwise comparisons give Elo ratings. Claude Opus 5.5 1,846
- AA-Briefcase v1.1 In use Version 1.1 of Artificial Analysis's multi-hour office work evaluation, with Elo ratings fitted by Crowd-BT. Claude Opus 5.5 1,822
- Agents' Last Exam v1.1 In use Agents complete 122 public long-horizon professional workflow tasks across 55 sub-industries. Deterministic graders check outcomes against hidden references. GPT-6.2 Astra 47.5%
- CoWorkBench In use Agent completes long-horizon productivity tasks across computer science, finance, law and medicine. Qwen in-house scoring (method unpublished). Claude Fable 5 75.9%
Data audit
2 of 4 checks pass, 2 warnings. Look first at the Task access check. We don’t know whether the tasks are public. Every benchmark
Catalog record 1 warning 1 pass
- Warning Task access We don’t know whether the tasks are public.
- Pass Confidence Checked against a primary source.
Scores 1 warning 4 notes
- Warning Independent runs No scores from any source yet.
- Note Models scored No models scored yet.
- Note Newest score No scores yet.
- Note Frontier models No models scored yet.
- Note Headroom No scores yet.
Leaderboard import 1 note
- Note Importer No public leaderboard to read.
Consistency 1 pass 1 note
- Note Lab claims No model has both a lab number and an independent run.
- Pass Known issues No published audit found problems.