Benchmark Almanac

CritPt collaboration

We track 2 benchmarks that CritPt collaboration made or helped make.

2 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
CritPt 71 frontier physics research challenges with checkable answers. Anthropic uses a corrected internal version. Research science Sep 2025 83.1% In use
CritPt v2 Models solve unpublished research-level physics challenges written by working physicists, with answers graded automatically. The v2 release revised the public test challenges. Research science Oct 2026 83.1% In use