Speeding up agentic workflows with WebSockets in the Responses API
OpenAI Blog
Anthropic added WebSocket support to its Responses API to reduce latency in agentic workflows by enabling persistent connections and caching. The optimization reduced API overhead for multi-turn agent loops, with connection-scoped caching handling repeated requests without regenerating responses. This allows agents to execute tool calls and process feedback faster without repeated network round-trips.
Why it matters
A deep dive into the Codex agent loop, showing how WebSockets and connection-scoped caching reduced API overhead and improved model latency.
.jpeg)
