Benchmark Almanac

Proof News

We track 3 benchmarks that Proof News made or helped make.

0 in use 3 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
AI Democracy Projects voter queries Models answer questions that US voters might ask about an election. Expert panels vote on whether each response contains inaccurate information. Long-form factuality Feb 2024 19.2% Not in cards
Arizona voter questions in English and Spanish Models answer Arizona voter questions in English and Spanish. Fact-checkers flag answers containing a false statement or a broken link. Long-form factuality Oct 2024 30% Not in cards
Proof News election misinformation debunking Chatbots respond to five false claims about the 2024 US election. Reviewers mark whether each service clearly debunks each claim. Long-form factuality Nov 2024 0% Not in cards