Benchmark Almanac

Denis Emelin

We track 2 benchmarks that Denis Emelin made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
BIG-bench Understanding Fables Models read a paraphrased Aesop fable and choose its moral from five options. The test contains 189 fables. Reading comprehension Jun 2021 39.6% Not in cards
Moral Stories Models reason about norms, intentions, actions and consequences in short stories. Tasks include distinguishing a norm-respecting action from a norm-violating alternative. Commonsense Nov 2021 Not in cards