Benchmark Almanac

Institute of Automation

We track 4 benchmarks that Institute of Automation made or helped make.

0 in use 4 with public code 3 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
LongDocURL Models answer 2,325 questions over long documents with more than 33,000 pages in total. Its 20 subtasks cover understanding, numerical reasoning and locating document elements. Documents, charts and text in images Dec 2024 64.5% System cards only
CrossPoint-Bench Models see two views of a scene and must find the point in the second view that matches a point in the first. Tasks go from perception and reasoning to exact coordinate prediction. Spatial reasoning and counting Dec 2025 72.9% Not in cards
USIM underwater robot tasks Agents follow instructions to navigate, grasp, transport, and track objects underwater. The simulator measures task completion across 700 trials. Simulated robots Oct 2025 37.6% Not in cards
MER-UniBench Models describe emotions from audio, video, and text across nine datasets. Label normalization supports hit rate, weighted F1, and emotion-wheel F1. The reported mean averages the primary metric from each dataset. Audio understanding and voice Jan 2025 Not in cards