Alibaba President: AI agents can talk, but can they actually do the work?
Fortune 45 ● 2 sources
Alibaba.com’s Accio team released CommerceAgentBench, an open-source benchmark that grades AI agents by end-to-end commercial outcomes rather than model reasoning. The benchmark includes 107 tasks built from real e-commerce work and the best model completed 61.7% of them. The results shift deployments toward “precision delegation,” where businesses hand off only the workflows with high pass rates and keep humans checking the low-performing exception areas.