Terminal-X
A suite of three terminal datasets for coding agents. DeepTerminalBench tests single-shot depth, EvoCode-Bench tests multi-round iteration and RoadmapBench tests version upgrades on real repositories.
The blog post is dated May 2nd, 2026. All tasks use the Terminal-Bench 2.0 task format and the Harbor framework. The suite has no combined score, so each member is its own record.
- Made by
- UniPat AI
- Released
- May 2026
- Kind
- Terminal tasks
- Level
- Expert
- Scored
- Checked automatically
- Answers
- Agent task
- Tasks
- All public
No scores here yet
We have no scores for Terminal-X yet.
No lab model card reports it yet
We read the headline results of 522 launch posts from 52 labs, and none of them list this benchmark.
More in Terminal agents
- SkillsBench In use 86-87 containerized expert tasks in 11 domains, run with and without Agent Skills. Verifier tests give pass rate and skill lift. GPT-5.5 67.3%
- Terminal-Bench Hard In use Agents complete 44 hard tasks from Terminal-Bench Core in the Terminus 2 harness. Artificial Analysis scores pass@1 averaged over 3 repeats.
Gemma 4 31B IT 36% - Harbor-Index In use Agents solve about 80 hard tasks drawn from 29 benchmarks run through Harbor adapters, such as HLE, GSO and SWE-bench Pro. Each task keeps its source verifier. GPT-5.5 28.1%
- Terminal-Bench 2.1 Extended Not in model cards Agents complete long command-line tasks in containers, scored by verification tests. Mercor adds 99 new expert-written tasks to the 89 public ones and reports both scores.
Muse Wonder 54% - Terminal-Bench 4.1 Not in model cards The Terminal-Bench 4.0 tasks with hardened verifiers: agents complete 66 hard tasks in containerized terminals across software, ML, science, security, and operations. Test scripts verify each result, scored as resolution rate. Claude Opus 5.5 65.8%
- o11y-bench Not in model cards Agents query metrics, logs and traces in a live Grafana stack, investigate incidents and fix dashboards. Grading checks claims against facts read from the same environment. Claude Opus 5.5 93.8%