Benchmark Almanac

UCSC VLAA

We track 2 benchmarks that UCSC VLAA made or helped make.

0 in use 0 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
PARADE Audio Models answer questions about occupations and social status using audio clips. The evaluation tests whether voice cues bias their answers. Bias, fairness and politics Mar 2025 63.4% Not in cards
Audio PAIRS Models answer spoken questions adapted from PAIRS. The evaluation checks whether changing demographic cues changes their choices. Bias, fairness and politics Nov 2024 Not in cards