Benchmark Almanac

WRENCH authors

We track 2 benchmarks that WRENCH authors made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
WRENCH (Docker Compose) Agents maintain a service pipeline through seeded disruptions. The grader measures retained throughput and recovery. Terminal tasks Sep 2026 0.81 Not in cards
WRENCH (Factorio) Agents build Factorio factories and recover from unannounced disruptions. The evaluator measures how much production the factory retains after a disruption. Video games Aug 2026 1.49 Not in cards