Benchmark Almanac

INSAIT

We track 4 benchmarks that INSAIT made or helped make.

0 in use 3 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
BaxBench Models write backend servers from a specification. Each solution is checked for correctness by tests and for security by end to end exploits. Secure code and review Feb 2025 68.6% Not in cards
BrokenMath Models are asked to prove false versions of 2025 competition problems. An LLM judge counts how often a model writes a proof instead of rejecting the statement. Written proofs Oct 2025 29% Not in cards
LADDER Policies, orchestrators and frontier-model agents do 145 long-horizon tabletop tasks of 1 to 10 subgoals in three simulators. A task counts only when every object ends in place. Simulated robots Oct 2026 63.3% Not in cards
Articulate3D Models locate movable parts and handles in scanned rooms. They predict how each part moves, including its axis and the location of its hinge. Spatial reasoning and counting Dec 2024 Not in cards