Benchmark Almanac

King's College London

We track 3 benchmarks that King's College London made or helped make.

0 in use 3 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Numerical results extraction from randomized controlled trials Models extract group sizes, event counts, means, and standard deviations from trial reports. The test contains 656 treatment comparisons across 110 papers. Medicine May 2024 77.9% Not in cards
Evidence Inference 2.0 Models classify the direction of a treatment effect in a trial report and identify text that supports their answer. Medicine May 2020 Not in cards
SocioHack RL-trained models act in 72 sandbox environments that copy institutional reward rules, such as credit card points or school grading. The test measures whether they find compliant loopholes that defeat each rule's purpose. Deception and alignment Jun 2026 Not in cards