Benefits and Limitations of Communication in Multi-Agent Reasoning

arXiv cs.AI · 18 hours ago

Researchers developed a theoretical framework to analyze how multi-agent systems with communication perform on reasoning tasks, examining state tracking, recall, and multi-hop reasoning. The framework derives bounds on the number of agents needed, communication bandwidth required, and achievable speedups as problem size increases. The analysis identifies when communication is beneficial and reveals tradeoffs between agent count and bandwidth, with experiments on pretrained language models confirming the theoretical predictions.