News for hackers. Stuff that matters.
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by yummytummy on Sunday April 12, 2026 @11:17AM (#47740729)
Ah, so cache usage impacts rate limits. There goes the ”other harnesses aren’t utilizing the cache as efficiently” argument.
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by bcherny on Sunday April 12, 2026 @11:19AM (#47740742)
Claude Code is the most prompt cache-efficient harness, I think. The issue is more that the larger the context window, the higher the cost of a cache miss.
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by yummytummy on Sunday April 12, 2026 @11:33AM (#47740923)
That might be, but the argument was that poor cache utilization was costing Anthropic too much money in other harnesses. If cache is considered in rate limits, it doesn’t matter from a cost perspective, you’ll just hit your rate limits faster in other harnesses that don’t try to cache optimize.
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by bcherny on Sunday April 12, 2026 @11:43AM (#47741058)
There were two issues with some other 3p harnesses:

1. Poor cache utilization. I put up a few PRs to fix these in OpenClaw, but the problem is their users update to new versions very slowly, so the vast majority of requests continued to use cache inefficiently.

2. Spiky traffic. A number of these harnesses use un-jittered cron, straining services due to weird traffic shape. Same problem -- it's patched, but users upgrade slowly.

We tried to fix these, but in the end, it's not something we can directly influence on users' behalf, and there will likely be more similar issues in the future. If people want to use these they are welcome to, but subscriptions clients need to be more efficient than that.

Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by SyneRyder on Sunday April 12, 2026 @12:43PM (#47741747)
How much jitter would you prefer, how many seconds / minutes out? I have some morning tasks that run while I'm asleep via claude -p, and it sounds like I'm slightly contributing to your spikes (presumably hourly and on quarter hours).
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by dollspace on Sunday April 12, 2026 @01:03PM (#47741968)
If you give doll a list of things you want to see from third party harnesses, a compliance checklist it will make sure the one it is building follows it to the letter.
Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by eastbound on Sunday April 12, 2026 @11:48AM (#47741113)
I’m sorry but when you wake up in the morning with 12% of your session used, saying “it’s the cache” is not an appropriate answer.

And I’m using Claude on a small module in my project, the automations that read more to take up more context are a scam.

Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by beacon294 on Sunday April 12, 2026 @12:22PM (#47741501)
Politely, no.

- I wrote an extension in Pi to warm my cache with a heartbeat.

- I wrote another to block submission after the cache expired (heartbeats disabled or run out)

- I wrote a third to hard limit my context window.

- I wrote a fourth to handle cache control placement before forking context for fan out.

- my initial prompt was 1000 tokens, improving cache efficiency.

Anthropic is STOMPING on the diversity of use cases of their universal tool, see you when you recover.

Re:Pro Max 5x quota exhausted in 1.5 hours despite moderate ... by simsla on Sunday April 12, 2026 @03:13PM (#47743273)
I do wonder if it's fair to expect users to absorb cache miss costs when using Claude Code given how untransparent these are.