Benchmark Almanac

carlos-toledo

We track 3 benchmarks that carlos-toledo made or helped make.

0 in use 1 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Verify Gym Models give tighter rational bounds for roots on 120 held-out tasks. Exact integer arithmetic verifies both bounds and determines how much precision the answer adds. Word problems Oct 2026 0.10 Not in cards
Blind Spot (Carlos Toledo) Models find an input pair that distinguishes a modified circuit from its original or declare the circuits equivalent. Simulation and SAT proofs check the answers. Electronics Sep 2026 Not in cards
Break the Grader Models compare a numerical grader with a certified interval and determine whether the grader can accept an incorrect value. Exact certificates verify the answer. Written proofs Sep 2026 Not in cards