Learn how Cursor partnered with Together AI to deliver real-time, low-latency inference at scale

Together AI · 6 months ago

Cursor partnered with Together AI to optimize real-time code completion inference using NVIDIA Blackwell hardware and advanced quantization techniques. The partnership productionized B200/GB200 chips with FP4 quantization and TensorRT optimizations to achieve low-latency inference at scale. This infrastructure enables Cursor's in-editor AI agents to maintain fast response times while processing requests reliably.