How Prompt Caching Cut Our LLM Bills in Half
BALÁZS CSOMOR
Slides from my Applied AI Conf talk on how Langdock used prompt caching to cut LLM costs, what breaks cache hits, and the tooling needed to keep savings visible in production.
Slides from my Applied AI Conf talk on how Langdock used prompt caching to cut LLM costs, what breaks cache hits, and the tooling needed to keep savings visible in production.