Benchmark Almanac

University of Hong Kong

We track 6 benchmarks that University of Hong Kong made or helped make.

0 in use 6 with public code 2 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
OSWorld-G Models map 564 desktop instructions to the right screen element or point, covering text matching, element recognition, layout understanding and fine manipulation. Finding things on screen May 2025 71.3% Fading
Spider 2.0-AIFunc Agents generate SQL that uses AI functions to solve 465 tasks across 125 databases. The evaluator compares execution results with reference results. Data science and SQL Jul 2026 70.3% Not in cards
DexVerse Robot policies perform tabletop manipulation tasks in Isaac Lab, including tool use, bimanual coordination, and sequences with several goals. Task-specific success conditions check completion under different visual settings and robot embodiments. Simulated robots Jul 2026 34% Not in cards
OmniMedVQA Models answer questions about 118,010 medical images across 12 imaging modalities. The authors measure accuracy against the correct answer option. Medicine Feb 2024 50.7% Not in cards
MobileAgentBench Agents complete 100 tasks across ten Android apps. The grader checks app state and accessibility events, so agents can take different paths. Phones Jun 2024 8.00% Not in cards
PlayWorld An agent player pursues objectives inside video world models. Gemini 3.1 Pro applies weighted rubrics for geometry, interaction, and state evolution across the resulting videos. Interactive world models Aug 2026 Not in cards