Announcing the fastest inference for realtime voice AI agents

Together AI · 8 months ago

Together AI announced expanded voice infrastructure for AI agents including streaming Whisper speech-to-text with WebSocket APIs, serverless open-source text-to-speech models (Orpheus at 187ms and Kokoro at 97ms time-to-first-byte), and new transcription capabilities with Voxtral Mini and speaker diarization. The streaming Whisper transcription completes transcripts up to 35% faster than alternatives with tuned voice activity detection for natural conversation timing. These integrated services enable developers to build voice agents with lower latency, reduced operational complexity, and consistent performance at scale.