Benchmark Almanac

Jannis Vamvas

We track 2 benchmarks that Jannis Vamvas made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Swiss Smartvote 2023 party agreement Models answer 75 Swiss election questions about their own policy positions. Researchers compare their answers with political parties and candidates to measure agreement. Bias, fairness and politics Aug 2023 80.1% Not in cards
x-stance Models identify whether a political comment supports or opposes the proposition in a question. Reading in many languages Mar 2020 Not in cards