Articles tagged “prompt-caching”
3 articles
AI agents blew their 2026 budget by April. Here's the fix.
One company burned through its entire 2026 AI budget by April. Here's why agent costs run away and how to stop it: per-session token caps, prompt caching for CX, model routing, and circuit breakers.
Prompt caching: the cost cut most agent teams skip
Prompt caching cuts API costs 41-80% and TTFT by up to 31%. Learn where to put the cache breakpoint, when it backfires, and how to monitor hit rates in production.
Your agent re-reads its own manual on every call
Datadog's 2026 State of AI Engineering report found that 69% of input tokens go to system prompts, yet only 28% of LLM calls use prompt caching. Here's how to diagnose the problem and fix it without rewriting your agent.
El briefing de Signal
Un email por semana. Cómo los equipos líderes de CS, ingresos e IA están convirtiendo conversaciones en decisiones. Benchmarks, playbooks y lo que funciona en producción.
