NVIDIA Releases Personal AI Router (PAIR): An Open Source Virtual Inference Router that Distributes Local AI Requests Across RTX, DGX Spark, and Mac Nodes

MarkTechPost · 1 month ago · 31 ● 7 sources

NVIDIA released Personal AI Router (PAIR), a virtual inference router that discovers compatible local machines and schedules independent inference requests across them while proxying existing Ollama and LM Studio endpoints. In its five-subagent demo using Qwen 3.6 35B A3B, it reduced average runtime from 18 minutes on one RTX Spark laptop to 8 minutes 48 seconds on a three-device cluster. This changes local multi-agent inference by routing each request to a single eligible node instead of letting requests contend on one machine, without pooling VRAM or sharding a single request.