Plover: Steering GUI Agents through Plan-Centric Interaction

arXiv cs.AI · 6 hours ago

Plover is a GUI automation system that externalizes task plans as visible, editable artifacts, allowing users to supervise and correct autonomous agent behavior through a planner-executor architecture. A formative study with six participants guided the interaction design, and evaluation through benchmark failure-case repair and scenario-based workflow analyses demonstrated the approach. The system makes GUI automation more transparent and controllable by keeping plans visible and enabling localized interventions during agent execution.