Articles tagged “performance”
4 articles
Tool result caching: the latency and cost wins hiding in your stack
Your agent re-fetches the same data on every call. Tool result caching cuts latency by up to 70% and inference costs by 40-60% with changes that take days, not weeks. Here's how to classify, implement, and measure it.
Parallel tool calls: the 5x speedup in your agent
Sequential tool calls compound latency for no reason. Here's how to fan out independent tool calls in parallel and cut agent response time by up to 5x in production.
Pre-Execute Tool Calls to Cut Agent Latency 48%
Sequential tool calls quietly kill your agent's response time. PASTE shows you can pre-execute likely tool calls during LLM thinking time and cut latency 48% without touching your model.
Performance Benchmarks for AI Agents: What Actually Matters Beyond Word Error Rate
Most enterprises obsess over Word Error Rate while missing the metrics that actually predict success. Here's what to measure instead.
El briefing de Signal
Un email por semana. Cómo los equipos líderes de CS, ingresos e IA están convirtiendo conversaciones en decisiones. Benchmarks, playbooks y lo que funciona en producción.
