WRENCH authors
We track 2 benchmarks that WRENCH authors made or helped make.
0 in use 2 with public code 1 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| WRENCH (Docker Compose) Agents maintain a service pipeline through seeded disruptions. The grader measures retained throughput and recovery. | Terminal tasks | Sep 2026 | 0.81 | Not in cards |
| WRENCH (Factorio) Agents build Factorio factories and recover from unannounced disruptions. The evaluator measures how much production the factory retains after a disruption. | Video games | Aug 2026 | 1.49 | Not in cards |