Benchmark Almanac

Collinear AI

We track 3 benchmarks that Collinear AI made or helped make.

3 in use 1 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
CWE-bench Agents audit a repository and write a patch for a security flaw, without being told where the bug is. Covers six programming languages. Secure code and review Sep 2026 71% In use
CWE-bench 2 Agents audit and patch vulnerabilities in 250 codebases. The score is pass@1 under deterministic verification. Secure code and review Nov 2026 75% In use
YC-Bench Agent runs a simulated startup for one year via CLI, managing staff, clients and cash. Scored by final funds. Running a business Feb 2026 $3,445,495 In use