News for hackers. Stuff that matters.

A comment on LLMs Are Cheap. Parent comment

Re:LLMs Are Cheap by chipsrafferty on Monday June 09, 2025 @10:58PM (#44232009)
Are you saying if I ask a prompt "foo" and then a month later another user asks "foo" then it retrieves a cached value?
[ Parent | on HN ]
Re:LLMs Are Cheap by wkat4242 on Tuesday June 10, 2025 @03:08AM (#44233613)
No, the key value cache is the context in a way the model can read it.
[ Parent | on HN ]