News for hackers. Stuff that matters.
Re:An update on recent Claude Code quality reports by vanviegen on Friday April 24, 2026 @04:54AM (#47887518)
Wrong on both counts. The kv-cache is likely to be offloaded to RAM or disk. What you have locally is just the log of messages. The kv-cache is the internal LLM state after having processed these messages, and it is a lot bigger.
Re:An update on recent Claude Code quality reports by cortesoft on Friday April 24, 2026 @12:48PM (#47892723)
I shouldn't have said 'loaded into GPU memory', but my point still stands... the cached data is on the anthropic side, which means that caching more locally isn't going to help with that.