Introducing gpt-realtime and Realtime API updates

OpenAI Blog · 10 months ago

OpenAI released gpt-realtime, an advanced speech-to-speech model with new API capabilities including MCP server support, image input, and SIP phone calling. The model enables direct audio conversation without requiring intermediate text transcription steps. These additions allow developers to build voice applications that integrate with existing phone systems and process visual information alongside speech.