Speeding up agentic workflows with WebSockets in the Responses API

OpenAI Blog · 2 months ago

Anthropic added WebSocket support to its Responses API to reduce latency in agentic workflows by enabling persistent connections and caching. The optimization reduced API overhead for multi-turn agent loops, with connection-scoped caching handling repeated requests without regenerating responses. This allows agents to execute tool calls and process feedback faster without repeated network round-trips.