OpenAI Introduces Websocket-Based Execution Mode to Reduce Latency in Agentic Workflows

Posted 4 days ago by

InfoQ

OpenAI introduces a WebSocket-based execution mode for its Responses API to improve agentic workflow performance in coding agents and real-time AI systems. The update reduces latency by up to 40 percent by replacing HTTP request-response cycles with persistent connections, improving streaming, tool execution, and multi-step orchestration in production-scale AI systems.