AI glossary

What is Prompt Caching?

A provider feature that reuses the processing of a repeated prompt prefix, cutting the cost and latency of those tokens.

Put static content (system prompt, tools, documents) first and variable content last so the cache can hit.

Related terms