ChanlChanl
Blog/Tags/production

production

Browse 17 articles tagged with “production”.

Articles tagged “production

17 articles

Developer at a desk surrounded by sticky notes with warning symbols, red warning lights on a server rack nearby
Tools & MCP·14 min read read

7 FastMCP mistakes that break your agent in production

FastMCP servers that work locally often fail at scale. Seven common mistakes, from missing annotations to monolithic tool sets, and how to fix each one.

Read More
Overhead view of translucent screens on a conference table, their overlapping symbols blurring into noise
Agent Architecture·14 min read read

The 17x error trap in multi-agent systems

Multi-agent systems amplify errors 17x, not reduce them. We compare CrewAI, LangGraph, and Autogen failure modes with concrete fixes and a decision tree.

Read More
A clean desk with colorful building blocks arranged into a fragile tower on one side and a sturdy steel structure with monitoring instruments on the other
Industry & Strategy·14 min read read

The no-code ceiling: when agent builders hit production

Visual agent builders get you to 80% fast. The last 20%, telephony, monitoring, testing, and memory, requires infrastructure they never intended to provide.

Read More
Engineering team reviewing real-time AI agent monitoring dashboards with metrics and conversation traces
Learning AI·22 min read read

Build an AI Agent Observability Pipeline from Scratch

Build a production observability pipeline for AI agents using TypeScript and the Chanl SDK. Covers metrics, traces, quality scoring, drift detection, and alerting.

Read More
Illustration of a quality monitoring dashboard showing score trends and alert thresholds across production AI agent conversations
Learning AI·20 min read

Production Agent Evals: Catch Score Drift, Ship Confidently

Your evals pass in staging but miss production failures. Build three eval pipelines with the Chanl SDK: automated scorecards, scenario regression, and drift detection that catches quality degradation before customers do.

Read More
Watercolor illustration of a split dashboard showing human reviewers on one side and automated scoring metrics on the other
Operations·15 min read read

74% of Production Agents Still Rely on Human Evaluation

A survey of 306 practitioners reveals most production agents are far simpler than expected. The eval gap isn't a tooling problem. It's a trust problem.

Read More
Visualization of the widening gap between AI agent capability scores and reliability metrics across model generations
Learning AI·15 min read

Your Agent Is Getting Smarter. It's Not Getting More Reliable.

Reliability improves at half the rate of accuracy. Three 85%+ tools combine to just 74%. Here's the math, the research, and the testing protocols that close the gap.

Read More
Data visualization showing the gap between AI agent benchmark scores and production performance metrics
Testing & Evaluation·13 min read

Your Agent Aced the Benchmark. Production Disagreed.

We scored 92% on GAIA. Production CSAT: 64%. Here's which AI agent benchmarks actually predict deployed performance, why most don't, and what to measure instead.

Read More
Watercolor illustration of distributed trace spans flowing through an AI agent pipeline with OpenTelemetry instrumentation
Operations·18 min read read

What to Trace When Your AI Agent Hits Production

OpenTelemetry GenAI conventions are the production standard for agent tracing. What to instrument, what to skip, and what breaks — from a 2 AM debugging war story.

Read More
Developer comparing small and large AI model outputs on a monitor
Learning AI·18 min read

A 7B Domain Model Beat Everything We Tried

Domain-specific language models are beating trillion-parameter generalists on vertical tasks. Here's when a 7B model is the right call, how the training pipeline works, and what production teams are shipping today.

Read More
Diagram showing interconnected AI agents coordinating a complex customer service workflow
Agent Architecture·14 min read

The Multi-Agent Pattern That Actually Works in Production

Gartner reports a 1,445% surge in multi-agent system inquiries. Here are the orchestration patterns that actually work when real customers call -- and why most teams pick the wrong one.

Read More
Layered shield diagram representing defense-in-depth security architecture for AI agents
Security & Compliance·18 min read

Your AI Agent Has No Guardrails

Air Canada honored a refund its chatbot hallucinated. DPD's bot cursed at customers on camera. One e-commerce agent approved $2.3M in unauthorized refunds at 2:47 AM. Here is the five-layer guardrail architecture that prevents all three.

Read More
Watercolor illustration of descending cost bars alongside token streams flowing through an optimization pipeline
Operations·16 min read read

Your AI Agent Costs $13K/Month. Here's the Fix.

A production customer-service agent burned $13,247 in one month. Prompt caching, model routing, batch processing, and plan-and-execute architecture cut it to $1,100. Real pricing math for every technique.

Read More
Watercolor illustration of developers at a cafe terrace with rocket deployment diagram on screen — Dusty Blue style
Learning AI·20 min read

Part 4: All 7 Extension Points in One Production Codebase

50+ skills, multiple MCP servers, scoped rules, safety hooks — here's how all 7 Claude extension points compose in a real NestJS monorepo with 17 projects. What works, what fights, and what we'd do differently.

Read More
Developer reviewing AI agent test results on a laptop
Testing & Evaluation·14 min read

Your Agent Passed Every Dev Test. Here's Why It'll Fail in Production

A 4-layer testing framework for AI agents (unit, integration, performance, and chaos testing) so your agent survives real customers, not just controlled demos.

Read More
Watercolor illustration of an engineer monitoring a production AI agent dashboard with reliability metrics
Agent Architecture·24 min read

Agentic AI in Production: From Prototype to Reliable Service

Ship agentic AI that doesn't break at 2 AM. Covers orchestration patterns (ReAct, planning loops), error handling, circuit breakers, graceful degradation, observability, and scaling — with TypeScript implementations you can steal.

Read More
Watercolor illustration of an engineering team monitoring AI agent dashboards with data flowing across screens
Operations·28 min read read

AI Agent Observability: What to Monitor When Your Agent Goes Live

Build a production observability pipeline for AI agents. Covers latency, token usage, tool success rates, conversation quality, drift detection, structured logging, alerting strategies, and the critical difference between LLM and agent observability.

Read More

Learn Agentic AI

One lesson a week — practical techniques for building, testing, and shipping AI agents. From prompt engineering to production monitoring. Learn by doing.

500+ engineers subscribed