Benchmark Almanac

Martian

We track 2 benchmarks that Martian made or helped make.

0 in use 1 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Code Review Bench (Martian) AI code review tools review pull requests from five large open-source projects. An LLM judge matches their comments to human-verified golden comments. Fixing real repositories Feb 2026 Not in cards
RouterBench Routers select a language model for each prompt using cached responses, quality measurements, and costs. Evaluation measures the quality and cost of those selections. Composite indices Not in cards