points by gringofyx 19 hours ago | 0 comments
No, not necessarily - the prompt-cache is only hit if everything prior matches... including MCP & tool definitions. So to benefit from prompt-caching themselves they would need to include the tools you define to the summariser.
If they were doing that, then a cheaper (prompt-cache friendly) option is just to silently send the whole conversation with the summariser prompt appended
Aún no hay comentarios.