Benchmark Almanac

vivo AI Lab

We track 2 benchmarks that vivo AI Lab made or helped make.

0 in use 2 with public code 1 with a leaderboard here

Benchmarks

Name Kind Released Best score Status
MemGUI-Bench Agents remember details while working across Android apps. Tasks include recording audio and creating calendar events. A model checks the actions and results across repeated attempts. Phones Feb 2026 73.4% Not in cards
UI-Genie reward model evaluation Models judge individual Android actions and decide whether a sequence of actions completes a task. The authors report separate F1 scores for both judgments. Phones May 2025 66.9% Not in cards