Benchmark Almanac

University of Technology Sydney

We track 2 benchmarks that University of Technology Sydney made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
Automotive-ENV Agents operate climate controls in an Android Automotive OS simulator. A validator checks the screen and vehicle signals after requests such as turning on the defroster. Apps and MCP servers Sep 2025 49.3% Not in cards
ReasonVOS Models segment and track objects in videos from explicit referring queries and implicit reasoning queries. The score is overall J&F on ReVOS. Video understanding Jul 2024 Not in cards