Re:Show HN: Claude-thermos – keeps your Claude session warm ...
by searealist on Friday July 24, 2026 @01:44AM
(#49031606)
They could always just extend the cache timeout beyond 5 minutes themselves. They don't do that because it is an expensive resource and there is a trade-off bewteen saving computation and reserving VRAM. Running a tool like this will force them to do one of the following:
1) Start charging for VRAM reservations.
2) Charge _other_ customers more.
3) Eat the cost themselves.
Re:Show HN: Claude-thermos – keeps your Claude session warm ...
by dannyw on Friday July 24, 2026 @02:54AM
(#49032027)
They charge you for cache writes already. There's a price assigned to it. Even if you're on subscription, it counts against your usage (very easy to observe with a big cache miss).
Anthropic (and now OpenAI too for 5.6) prompt caching is not free.
Re:Show HN: Claude-thermos – keeps your Claude session warm ...
by searealist on Friday July 24, 2026 @10:26PM
(#49043932)
Holding your cache in VRAM for 5 minutes or 3 hours have very different costs to them.
"They already charge me to park my car, why can't I leave it there for a year for the same price as 1 week?"
The cache is discounted for a reason. They WANT you to use it.