Benchmark Almanac

Case Western Reserve University

We track 2 benchmarks that Case Western Reserve University made or helped make.

0 in use 0 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
CounterBench Models answer yes or no about hypothetical changes to a causal system. The original 1,000 questions cover basic, conditional, joint, and nested counterfactuals. Language reasoning Feb 2025 93.5% Not in cards
CounterBench (1,200 questions) Models answer counterfactual questions using the stated causal rules. This release adds 200 backdoor questions to the original 1,000. Language reasoning Aug 2025 91.8% Not in cards