A new trend, smart model routing

The Pragmatic Engineer · 1 month ago · 43 ● 2 sources

Companies are adopting intelligent model routing systems that automatically select cheaper AI models for tasks that don't require state-of-the-art capabilities, reducing token costs. Factory Router and similar vendors claim cost savings of 20-30%, with one engineering leader reporting that open models are sufficient for approximately 60% of coding work. As enterprises prioritize cost control, intelligent routing is expected to become standard functionality across AI vendors and gateways.