Re:Anthropic: Claude Code users hitting usage limits 'way fa...
by barazany on Wednesday April 01, 2026 @07:35AM
(#47599484)
The variance people are seeing makes sense once you look at what is actually happening with token billing. Cache hits are discounted. Cache misses cost 1.25x. Your cache hit ratio is effectively your quota multiplier.
Two developers doing the same work can burn quota at wildly different rates depending on their session patterns. Someone who uses /clear after long breaks preserves the cache. Someone who resumes a 100K+ token conversation after an hour of idle time reprocesses everything from scratch at the penalty rate.
The source code has a feature called "willow" that tries to help with this. It fires when two conditions are met: 75 minutes idle and at least 100K tokens in the conversation. At that point it shows either a blocking dialog or a one-liner hint to /clear. The 75-minute threshold is not arbitrary -- the cache TTL is around one hour, so 75 minutes idle means the cache has definitely expired. Continuing means reprocessing the entire context at 1.25x.
Boris mentioned improvements are coming, and given the source it is clear what that means. Not server-side quota changes -- client-side cache hit ratio optimization. There are twelve distinct caching mechanisms in the codebase, each plugging a specific leak. Tightening any of them hands quota back to users without changing the limit itself.
Two developers doing the same work can burn quota at wildly different rates depending on their session patterns. Someone who uses /clear after long breaks preserves the cache. Someone who resumes a 100K+ token conversation after an hour of idle time reprocesses everything from scratch at the penalty rate.
The source code has a feature called "willow" that tries to help with this. It fires when two conditions are met: 75 minutes idle and at least 100K tokens in the conversation. At that point it shows either a blocking dialog or a one-liner hint to /clear. The 75-minute threshold is not arbitrary -- the cache TTL is around one hour, so 75 minutes idle means the cache has definitely expired. Continuing means reprocessing the entire context at 1.25x.
Boris mentioned improvements are coming, and given the source it is clear what that means. Not server-side quota changes -- client-side cache hit ratio optimization. There are twelve distinct caching mechanisms in the codebase, each plugging a specific leak. Tightening any of them hands quota back to users without changing the limit itself.
Full analysis of the caching mechanisms from the source: https://barazany.dev/blog/claude-code-token-caching