Benchmark Almanac

Cornell

We track 3 benchmarks that Cornell made or helped make.

2 in use 3 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
LiveCodeBench v6 Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. Competitive programming Apr 2025 93.5% In use
LiveCodeBench Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. Competitive programming Mar 2024 93.5% In use
LiveCodeBench v5 Competitive programming problems collected after model cutoffs from LeetCode, AtCoder, Codeforces. Scored pass@1 on hidden tests. Competitive programming Jan 2025 81.2% Fading