Articles tagged “model-routing”
3 articles
Operations·14 min read
How LLM Routing Cuts Agent Costs 40-85% in Production
Most CX agents route every request to their priciest model. A routing layer sends simple queries to a cheap model, cutting costs 40-85% with no quality drop.
Read More
Agent Architecture·14 min read read
Everyone Benchmarks Opus. Your Chatbot Runs on Haiku.
Haiku 4.5, GPT-5 Mini, Gemini Flash at the $1/MTok tier that powers CX. Tool-call accuracy, first-token latency, structured-output reliability, blended cost math.
Read More
Agent Architecture·13 min read read
Your Agent Should Use Three Models, Not One
Production CX agents route tasks by difficulty, not brand loyalty. The planner/router/summarizer pattern, a concrete rubric, support-deflection cost math, and the failure modes nobody warns you about.
Read More
The Signal Briefing
Un email por semana. Cómo los equipos líderes de CS, ingresos e IA están convirtiendo conversaciones en decisiones. Benchmarks, playbooks y lo que funciona en producción.
