MindTopo reveals VLMs’ spatial reasoning abilities
Microsoft 2 months ago 22
MindTopo, a new benchmark from Microsoft Research, evaluates whether multimodal large language models can do 3D topological reasoning and planning, not just recognize topology in single images. It tests topology across 5 categories: continuity, separation, order, enclosure, and knots, with both reasoning and planning tasks. Results show a persistent gap where models perform better on static recognition than on interactive action sequences that must preserve or change the same topological relations.