Collinear AI
We track 3 benchmarks that Collinear AI made or helped make.
3 in use 1 with public code 3 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| CWE-bench Agents audit a repository and write a patch for a security flaw, without being told where the bug is. Covers six programming languages. | Secure code and review | Sep 2026 | | In use |
| CWE-bench 2 Agents audit and patch vulnerabilities in 250 codebases. The score is pass@1 under deterministic verification. | Secure code and review | Nov 2026 | 75% | In use |
| YC-Bench Agent runs a simulated startup for one year via CLI, managing staff, clients and cash. Scored by final funds. | Running a business | Feb 2026 | $3,445,495 | In use |