Introducing gpt-realtime and Realtime API updates
OpenAI Blog
OpenAI released gpt-realtime, an advanced speech-to-speech model with new API capabilities including MCP server support, image input, and SIP phone calling. The model enables direct audio conversation without requiring intermediate text transcription steps. These additions allow developers to build voice applications that integrate with existing phone systems and process visual information alongside speech.
Why it matters
We’re releasing a more advanced speech-to-speech model and new API capabilities including MCP server support, image input, and SIP phone calling support.
