Articles tagged “websockets”
2 articles
Agent Architecture·14 min read
The Buffering Bug That Quietly Breaks Voice Agent Latency
SSE streams fine locally, then tokens batch into 500ms bursts in production. Here's why, how to fix it, and why pipeline parallelism matters more than model speed.
Read More
Learning AI·20 min read
Streaming AI Responses: SSE, WebSockets, and the Architecture Behind ChatGPT's Typing Effect
Build three streaming implementations from scratch — SSE, WebSocket, and HTTP/2 — and learn why token-by-token rendering is harder than it looks.
Read More
The Signal Briefing
One email a week. How leading CS, revenue, and AI teams are turning conversations into decisions. Benchmarks, playbooks, and what's working in production.
