KnowAct-GUIClaw: Know Deeply, Act Perfectly, Personal GUI Assistant with Self-Evolving Memory and Skill

arXiv cs.CL · 18 hours ago

Researchers introduced KnowAct-GUIClaw, a framework that enhances GUI automation agents by adding cross-platform support and self-improving memory systems that learn from user interactions. The system achieved 64.1% accuracy on the MobileWorld benchmark across Android, iOS, HarmonyOS, and Windows platforms, outperforming existing agents and models. The framework enables continuous performance improvement through accumulated interaction experience and transferable skills that work across different base models with an 8.5% performance gain using Kimi-2.6.