CritPt collaboration
We track 2 benchmarks that CritPt collaboration made or helped make.
2 in use 2 with public code 2 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| CritPt 71 frontier physics research challenges with checkable answers. Anthropic uses a corrected internal version. | Research science | Sep 2025 | 83.1% | In use |
| CritPt v2 Models solve unpublished research-level physics challenges written by working physicists, with answers graded automatically. The v2 release revised the public test challenges. | Research science | Oct 2026 | 83.1% | In use |