Glossary
Prompt caching
Prompt caching reuses stable prompt prefixes (policies, schemas, long instructions) so repeated calls pay less and run faster. For operators with high-volume similar requests, cache hit rate often moves the bill more than switching models. It is an architecture choice, not a trick.
Why it matters to your operation
Design for cache hits before you chase a cheaper model name.