iCreatAI News
Skip to content
AWS Machine Learning Blog· Claudio Mazzoni·· 20 days agoAI score40

Groundhog Day for AI agents: Prompt caching patterns for using OpenAI models on Amazon Bedrock

Groundhog Day for AI agents: Prompt caching patterns for using OpenAI models on Amazon Bedrock

AI summary

This post explains how AI agents resend their full context (tool definitions, instructions, and history) on every turn, and how Amazon Bedrock prompt caching avoids recomputing that prefix by reusing saved key-value state. It covers implicit versus explicit caching, caching conversation history and tool results, handling tool changes with allowed_tools and additional_tools, sharing cached prefixes across subagents and new sessions via prompt_cache_key, and monitoring cache reads and writes through response usage and CloudWatch.

Source: AWS Machine Learning Blog · aws.amazon.com