News for hackers. Stuff that matters.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by ATMLOTTOBEER on Thursday July 23, 2026 @02:29PM (#49026066)
Glad this exists. It will force anthropic to fix their flawed cache mechanism.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by cortesoft on Thursday July 23, 2026 @02:44PM (#49026263)
How should they fix it?
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by addaon on Thursday July 23, 2026 @03:53PM (#49027139)
There are a lot of workflows where cache is likely to be consumed exactly once (e.g. anything chat-like where a single thread is extended; if a prefix cache hit is found, and a set of new longer prefixes is inserted in the cache, it is unlikely that the original shorter prefix will be consumed in later turns). I could see allowing each session key a small number (1?) of 24-hour cache entries, where inserting a new cache entry (perhaps the maximum-length prefix, perhaps an API-tagged specified-length prefix) consumes that slot and either boots the rest of the items from cache, or demotes them to 5 minutes or something. Basically: workflow awareness, not uniform handling.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by s0ck_r4w on Thursday July 23, 2026 @03:17PM (#49026690)
Make the cache TTL more adaptive. Have more tiers than just 5m and 1h. Long-running subagents become increasingly ubiquitous. There's no reason for Anthropic to not do a better job for this use case.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by randomblock1 on Thursday July 23, 2026 @06:18PM (#49028805)
Default to 1h. Allow setting it to longer or shorter, granularly. Add /pause to mark it for eviction, for a token refund.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by SwellJoe on Thursday July 23, 2026 @05:01PM (#49028000)
While Anthropic is far behind on caching and efficiency (made more dramatically apparent by how much cheaper it is to use GPT 5.6 Sol at API rates than even Opus 4.8, much less Fable), a bunch of people forcing their way to the front of the queue at the expense of everyone else isn't going to solve that.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by skeledrew on Thursday July 23, 2026 @09:41PM (#49030338)
They definitely aren't. Over 98% of my tokens over the last 6 month have been cache reads (did an analysis just a couple days ago), which has made my Pro plan highly valuable.
Re:Show HN: Claude-thermos – keeps your Claude session warm ... by SwellJoe on Friday July 24, 2026 @02:26AM (#49031851)
I certainly don't see much in the way of cached token rates when I use the API, whereas when I use DeepSeek via API, it's mostly at the cached token rate.