News for hackers. Stuff that matters.
Re:Best Practices for Building Agentic AI Systems by itsalotoffun on Saturday August 16, 2025 @01:35AM (#44920477)
When you discuss caching, are you talking about caching the LLM response on your side (what I presume) or actual prompt caching (using the provider cache[0])? Curious why you'd invalidate static content?

[0]: https://docs.anthropic.com/en/docs/build-with-claude/prompt-...

Re:Best Practices for Building Agentic AI Systems by imsh4yy on Saturday August 16, 2025 @01:39AM (#44920500)
I think I need to make this a bit more clear. I was mostly referring to caching the tools (sub-agents) if they are a pure function. But that may be a bit too speicific for the sake of this post.

i.e. you have a query that reads data that doesn't change often, so you can cache the result.

Re:Best Practices for Building Agentic AI Systems by adastra22 on Saturday August 16, 2025 @01:58AM (#44920605)
It seems very doubtful to me that every query would be literally the same (e.g. same hash), if these are plain text descriptions of the subset task.
Re:Best Practices for Building Agentic AI Systems by imsh4yy on Saturday August 16, 2025 @02:04AM (#44920629)
I mean that depends on how you define the "input" for the tool. Some can be very deterministic like an enum, boolean, number, etc.
Re:Best Practices for Building Agentic AI Systems by cma on Saturday August 16, 2025 @07:04AM (#44922182)
The task can be something like summarize each source file. Many files might not change every time.