Models play chess with exploding captures. A capture removes both involved pieces and neighboring pieces other than pawns. Exploding the opposing king wins.
REALAgents complete 112 tasks on replicas of 11 websites. State checks grade actions, while a model judge checks retrieved answers against references.
Web browsing
Apr 2025
41.1%
Not in cards
Medical Chronology LLM BenchmarkModels extract medical timelines from six synthetic document sets in three independent rounds. Checks compare extracted events with reference timelines and assess semantic fidelity, formatting, date order, and hallucinations. A weighted composite combines these checks with ROUGE and extraction F1.