Articles tagged “prompt-caching”
3 articles
Operations·13 min read
AI agents blew their 2026 budget by April. Here's the fix.
One company burned through its entire 2026 AI budget by April. Here's why agent costs run away and how to stop it: per-session token caps, prompt caching for CX, model routing, and circuit breakers.
Read More
Agent Architecture·13 min read
Prompt caching: the cost cut most agent teams skip
Prompt caching cuts API costs 41-80% and TTFT by up to 31%. Learn where to put the cache breakpoint, when it backfires, and how to monitor hit rates in production.
Read More
Operations·13 min read read
Your agent re-reads its own manual on every call
Datadog's 2026 State of AI Engineering report found that 69% of input tokens go to system prompts, yet only 28% of LLM calls use prompt caching. Here's how to diagnose the problem and fix it without rewriting your agent.
Read More
Learn Agentic AI
Weekly. Patterns for shipping agents that work. MCP, scorecards, regression tests, prompts, model comparisons.
