Benchmark Almanac

Auburn University

We track 3 benchmarks that Auburn University made or helped make.

0 in use 3 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
VLMs Are Blind Models answer seven simple visual tasks such as counting line crossings or overlapping circles, which young children solve easily. Scored by accuracy. Spatial reasoning and counting Jul 2024 98.6% Fading
South Asian Music Understanding Models answer questions about Hindustani music theory and Bengali musical traditions. They also choose a continuation for a melody written in ABC notation. Expert-written questions Jun 2026 48.7% Not in cards
Bengali Classical Music Generation Models compose melodies for Bengali lyrics in ABC notation. Three listeners hear rendered samples and judge whether each melody matches the requested style. Creative writing Jun 2026 40% Not in cards