Glossary
Evaluation (evals)
Evals are structured tests of agent or model behaviour against examples and criteria — accuracy, tone, cost, refusal, tool use. Without evals, "it worked in the demo" is the only evidence. Operators should keep a living set of cases tied to the workflows they run in production.
Why it matters to your operation
Evals turn opinions about quality into something you can trend.