Benchmark Almanac

Andy Zou

We track 2 benchmarks that Andy Zou made or helped make.

0 in use 2 with public code 0 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Autocast Models forecast real events using questions from forecasting tournaments and news available before each prediction date. Real-world events Jun 2022 Not in cards
IntervalQA Models estimate numerical answers and give intervals for their uncertainty. The authors measure how often the intervals contain the true answers. Language reasoning Jun 2022 Not in cards