vivo AI Lab
We track 2 benchmarks that vivo AI Lab made or helped make.
0 in use 2 with public code 1 with a leaderboard here
Benchmarks
| Name | Kind | Released | Best score | Status |
|---|---|---|---|---|
| MemGUI-Bench Agents remember details while working across Android apps. Tasks include recording audio and creating calendar events. A model checks the actions and results across repeated attempts. | Phones | Feb 2026 | | Not in cards |
| UI-Genie reward model evaluation Models judge individual Android actions and decide whether a sequence of actions completes a task. The authors report separate F1 scores for both judgments. | Phones | May 2025 | | Not in cards |