Benchmark Almanac

Yale NLP

We track 2 benchmarks and 1 arena that Yale NLP made or helped make.

1 in use 3 with public code 3 with a leaderboard here

Arena leaderboards

Top five in each of its 1 arena with three or more rated models, the most rated first.

Benchmarks

Name Kind Released Best score Status
MMVU 3,000 expert-annotated questions on videos across 27 disciplines. Multiple-choice and open-ended accuracy. Video understanding Jan 2025 82.4% In use
BRIGHT-Pro Models retrieve passages that cover different parts of a question. The 739 questions include 115 from Earth Science Stack Exchange. Questions that need search Apr 2026 41.8 Not in cards