MobileMiniWoB++

Qwen2.5-VL-72B 68%

Dropped

Agents complete MiniWoB++ web tasks inside the Android emulator of AndroidWorld. Scored by task success rate.

Runs as the miniwob suite of AndroidWorld. MiniWoB++ itself comes from Liu et al. 2018.

Made by: Google Research (AndroidWorld team)
Released: May 2024
Kind: Phones
Level: Everyday
Scored: Checked automatically
Answers: Agent task
Tasks: All public

Last in a launch post: January 2025, dropped before it saturated
Last model added: February 2025

Model scored in lab cards

Launch post lists it, from 1 lab

System card reports it, from 1 lab

Qwen2.5-VL-72B leads with 68%

Best score per model as labs report them in their own cards. Labs pick their own settings, so these compare less cleanly than independent runs.

Bars Table

68.0 Qwen2.5-VL-72B

1 Qwen2.5-VL-72B 68%

Source: Labs’ model cards

#	Model	Score	Setting	Date	Source
1	Qwen2.5-VL-72B	68%		Jan 2025	Lab model card

Scores over time

All the scores we have, one dot each, so a model tested at several settings appears more than once.

Reported by the lab in its model card

Source: Labs’ model cards

No launch post has listed it since January 2025

Launch posts from every lab that has listed it, one tick per post. Tall colored ticks include it, and short gray ones leave it out.

Qwen

Date	Launch post	Score	As the post writes it
Jan 28, 2025	Qwen2.5-VL-72B	68	MobileMiniWob++_SR

One system card reports it

Besides launch posts, we read the system cards, model cards and technical reports labs publish with a release. They report far more, including safety and frontier-risk tests.

Date	Document	Score	As the document writes it	Section
Feb 19, 2025	Qwen2.5-VL-72B technical report	68	MobileMiniWob++ SR (Table 9)	Capabilities

Qwen2.5-VL-72B leads with 68%

Scores over time

No launch post has listed it since January 2025

One system card reports it

More in Computer and browser use