Benchmark Almanac

Loop

We track 2 benchmarks that Loop made or helped make.

0 in use 0 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Long-Horizon Freight AuditBench Challenge Agents price 100 difficult freight invoices and flag incorrect charges. The cases include incomplete information and exceptions to ordinary contract terms. Tasks from real jobs Sep 2026 10% Not in cards
Long-Horizon Freight AuditBench Production Agents price 200 freight invoices from contracts and carrier documents, then flag billing errors. Loop weights accuracy to reflect a 24 percent billing error rate. Tasks from real jobs Sep 2026 16.1% Not in cards