Benchmark Almanac

the Institute for Advanced Study

We track 2 benchmarks that the Institute for Advanced Study made or helped make.

0 in use 2 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AI Democracy Projects voter queries Models answer questions that US voters might ask about an election. Expert panels vote on whether each response contains inaccurate information. Long-form factuality Feb 2024 19.2% Not in cards
Arizona voter questions in English and Spanish Models answer Arizona voter questions in English and Spanish. Fact-checkers flag answers containing a false statement or a broken link. Long-form factuality Oct 2024 30% Not in cards