Institute of Automation
We track 4 benchmarks that Institute of Automation made or helped make.
0 in use 4 with public code 3 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| LongDocURL Models answer 2,325 questions over long documents with more than 33,000 pages in total. Its 20 subtasks cover understanding, numerical reasoning and locating document elements. | Documents, charts and text in images | Dec 2024 | 64.5% | System cards only |
| CrossPoint-Bench Models see two views of a scene and must find the point in the second view that matches a point in the first. Tasks go from perception and reasoning to exact coordinate prediction. | Spatial reasoning and counting | Dec 2025 | | Not in cards |
| USIM underwater robot tasks Agents follow instructions to navigate, grasp, transport, and track objects underwater. The simulator measures task completion across 700 trials. | Simulated robots | Oct 2025 | 37.6% | Not in cards |
| MER-UniBench Models describe emotions from audio, video, and text across nine datasets. Label normalization supports hit rate, weighted F1, and emotion-wheel F1. The reported mean averages the primary metric from each dataset. | Audio understanding and voice | Jan 2025 | Not in cards |