News for hackers. Stuff that matters.
Re:Claude: System Prompts by simonw on Sunday August 16, 2026 @09:39AM (#49319982)
These system prompts don't affect the API, they are for the Claude consumer chat products. We aren't charged extra for them.

They're also prefix cached, so the cost to Anthropic and performance hit is greatly reduced.

Re:Claude: System Prompts by Dfol on Sunday August 16, 2026 @10:07AM (#49320231)
So the people using the Claude consumer chat products pay for them via usage...

That's not any better. It's actually worse.

Re:Claude: System Prompts by simonw on Sunday August 16, 2026 @10:13AM (#49320287)
I don't understand.

System prompts are part of the software that customers pay to access.

Complaining about that is a bit like complaining that your Netflix subscription includes paying to execute the compiled code that Netflix wrote that serves you video streams from their servers.

Actually there is a difference: If Anthropic deleted a large chunk of that system prompt I guess you might get like a 1% increase in how much Opus 5 you can use via their chat allowance for your paid subscription.

Is that really something worth being frustrated by?

Re:Claude: System Prompts by TZubiri on Sunday August 16, 2026 @10:18AM (#49320336)
Cached.

they are the first part of the input and it contains no user dependent variables, so the model is in a known state that it can reuse across all users, it does not need to recompute all that inference

Re:Claude: System Prompts by cubefox on Sunday August 16, 2026 @10:35AM (#49320492)
Unless they are using a linear architecture, the compute cost still scales O(n²) for n tokens, and nemory cost scales O(n).
Re:Claude: System Prompts by TZubiri on Sunday August 16, 2026 @12:52PM (#49321644)
>the compute cost still scales O(n²) for n tokens,

That is never the cost, it's a common misconception.

Cost scales linearly per tokens. Unless you are sending one token at a time and avoiding using the same machine or cache.

Just look at api charges, they are charged by token, not by token squared.

Re:Claude: System Prompts by cubefox on Sunday August 16, 2026 @01:36PM (#49321991)
Which seems to contradict the usual consensus that purely linear architectures are not sufficiently capable and unsuited for frontier models.
Re:Claude: System Prompts by jannyfer on Sunday August 16, 2026 @06:06PM (#49324205)
They have a {{currentDateTime}} in the prompt which is interesting for something that gets prefix cached. Hopefully they are handling that properly :)
Re:Claude: System Prompts by bob1029 on Monday August 17, 2026 @01:48AM (#49326953)
It's probably a lower resolution timestamp (seconds/minutes omitted).