Benchmark Almanac

Santa Cruz

We track 2 benchmarks that Santa Cruz made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AutoMedBench Agents set up and run medical imaging research workflows from a task brief through final submission. Scores combine task performance with rubric judgments of planning, setup, and validation, plus automatic checks of inference and submission. Machine learning engineering Jun 2026 66.5 Not in cards
LLM-Coordination Models play four cooperative games and answer 198 multiple-choice questions about the same games. The authors report game outcomes and question accuracy separately. Multi-agent games Oct 2023 46.6 Not in cards