production-monitoring

The trace-to-dataset loop: turning live conversations into eval cases

Your best eval cases are already in your production traces. Here's how to automatically curate the interesting ones into a test suite that gets better every week without manual effort.