Benchmark Almanac

Boston University

We track 3 benchmarks that Boston University made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
SITE Models answer multiple-choice spatial questions over single images, multiple images and video, drawn from about 30 vision datasets. Tasks span figural to environmental scale. Spatial reasoning and counting May 2025 32.8% Fading
SAT (Spatial Aptitude Training) Models answer static and dynamic spatial questions, such as how object relations change when the camera or an object moves. The real-image test set has 150 questions. Spatial reasoning and counting Dec 2024 76.7% System cards only
GenScale Models generate or edit images containing objects with known relative sizes. A judge calibrated against human ratings scores the relative scale of object pairs. Image generation and editing Sep 2026 Not in cards