News for hackers. Stuff that matters.

A comment on Changes in the system prompt between Claude Opus 4.6 and 4.7.

Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Sunday April 19, 2026 @08:36AM (#47823855)
I knew these system prompts were getting big, but holy fuck. More than 60,000 words. With the 3/4 words per token rule of thumb, that's ~80k tokens. Even with 1M context window, that is approaching 10% and you haven't even had any user input yet. And it gets churned by every single request they receive. No wonder their infra costs keep ballooning. And most of it seems to be stable between claude version iterations too. Why wouldn't they try to bake this into the weights during training? Sure it's cheaper from a dev standpoint, but it is neither more secure nor more efficient from a deployment perspective.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by an0malous on Sunday April 19, 2026 @08:51AM (#47823941)
I’m just surprised this works at all. When I was building AI automations for a startup in January, even 1,000 word system prompts would cause the model to start losing track of some of the rules. You could even have something simple like “never do X” and it would still sometimes do X.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by embedding-shape on Sunday April 19, 2026 @09:20AM (#47824120)
Two things; the model and runtime matters a lot, smaller/quantized models are basically useless at strict instruction following, compared to SOTA models. The second thing is that "never do X" doesn't work that well, if you want it to "never do X" you need to adjust the harness and/or steer it with "positive prompting" instead. Don't do "Never use uppercase" but instead do "Always use lowercase only", as a silly example, you'll get a lot better results. If you've trained dogs ("positive reinforcement training") before, this will come easier to you.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by jug on Sunday April 19, 2026 @07:58PM (#47828843)
It's interesting to note here that Anthropic indeed don't use "do not X" in the Opus system prompts. However, "Claude does not X" is very common.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by wongarsu on Sunday April 19, 2026 @08:24PM (#47828986)
I suspect that lets the model "roleplay" as Claude, promoting reasoning like "would Claude do X?" or "what would Claude do in this situation?"
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by dataviz1000 on Sunday April 19, 2026 @09:48AM (#47824299)
I created a test evaluation (they friggen' stole the word harness) that runs a changed prompt comparing success pass / fail, the number of tokens and time of any change. It is an easy thing to do. The best part is I set up an orchestration pattern where one agent iterations updating the target agent prompts. Not only can it evaluate the outcome after the changes, it can update and rerun self-healing and fixing itself.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by mysterydip on Sunday April 19, 2026 @08:40AM (#47823877)
I assume the reason it’s not baked in is so they can “hotfix” it after release. but surely that many things don’t need updates afterwards. there’s novels that are shorter.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Sunday April 19, 2026 @08:48AM (#47823921)
Yeah that was the original idea of system prompts. Change global behaviour without retraining and with higher authority than users. But this has slowly turned into a complete mess, at least for Anthropic. I'd love to see OpenAI's and Google's system prompts for comparison though. Would be interesting to know if they are just more compute rich or more efficient.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by aesthesia on Sunday April 19, 2026 @10:04PM (#47829559)
Leaked/extracted system prompts for other chat models, particularly ChatGPT, are often around this size. Here's GPT-5.4: https://github.com/asgeirtj/system_prompts_leaks/blob/main/O...
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Monday April 20, 2026 @03:20AM (#47831278)
Thanks, but that kind of confirms my belief. wc counts ~15k words in there. That may technically be the same order of magnitude, but it is only a quarter of Claude's and less than 2% of the context limit. So a lot more steering is baked into the model weights than into the prompt compared to Claude.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by jatora on Sunday April 19, 2026 @08:55AM (#47823962)
There are different sections in the markdown for different models. It is only 3-4000 words
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by winwang on Sunday April 19, 2026 @08:44AM (#47823895)
That's usually not how these things work. Only parts of the prompt are actually loaded at any given moment. For example, "system prompt" warnings about intellectual property are effectively alerts that the model gets. ...Though I have to ask in case I'm assuming something dumb: what are you referring to when you said "more than 60,000 words"?
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Sunday April 19, 2026 @08:46AM (#47823904)
What you're describing is not how these things usually work. And all I did was a wc on the .md file.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by bavell on Sunday April 19, 2026 @09:07AM (#47824034)
The system prompt is always loaded in its entirety IIUC. It's technically possible to modify it during a conversation but that would invalidate the prefill cache for the big model providers.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by formerly_proven on Sunday April 19, 2026 @08:46AM (#47823912)
Surely the system prompt is cached across accounts?
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Sunday April 19, 2026 @09:00AM (#47823992)
You can cache K and V matrices, but for such huge matrices you'll still pay a ton of compute to calculate attention in the end even if the user just adds a five word question.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by pests on Sunday April 19, 2026 @10:12PM (#47829608)
The state of the system can be cached after the system prompt is calculated and all new chats start from that state. O(n^2) is not great but apparently its fine at these context lengths and I'm sure this is a factor in their minimum prompt cost. Advances like grouped query or multi head attention or sparse attention will eventually get rid of that exponential, hopefully.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by sigmoid10 on Monday April 20, 2026 @03:25AM (#47831305)
That's not how it works. The system prompt doesn't "get calculated first" or anything. You combine it with the user prompt and then run the generation for the first new token on that thing, which basically boils down to one huge matmul that runs in parallel. So you can literally just cache a part of the input matrices for the first step and then you'll very quickly run into n^2 complexity.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by pests on Tuesday April 21, 2026 @10:49AM (#47849601)
The system prompt will always match in the prefix cache. I just meant it could be prefilled before any user queries on completely different hardware. Then you are only dealing with the n^2 only for the actual user prompt. We're in agreeance I think.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by cfcf14 on Sunday April 19, 2026 @08:57AM (#47823973)
I would assume so too, so the costs would not be so substantial to Anthropic.
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by cma on Sunday April 19, 2026 @09:46AM (#47824282)
> And it gets churned by every single request they receive

It gets pretty efficiently cached, but does eat the context window and RAM.

[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by pests on Sunday April 19, 2026 @10:10PM (#47829598)
> And it gets churned by every single request they receive.

Not true, it gets calculated once and essentially baked into initial state basically and gets stored in a standard K/V prefix cache. Processing only happens on new input (minus attention which will have to content with tokens from the prompt)

[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by joquarky on Tuesday April 21, 2026 @06:50PM (#47855746)
So we still pay for 10% of it or not?
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by ares623 on Sunday April 19, 2026 @10:44PM (#47829815)
Does Claude Code (or whatever harness) have it's own system prompt of on top of Opus'?
[ Parent | on HN ]
Re:Changes in the system prompt between Claude Opus 4.6 and 4.7 by simonw on Sunday April 19, 2026 @11:03PM (#47829938)
Yes, in fact it has an entirely different system prompt from the ones that Anthropic publish on https://platform.claude.com/docs/en/release-notes/system-pro...

The Claude Code one isn't published anywhere but it's very easy to get hold of. One way to do that is to run Claude Code through a logging proxy - I was using a project called claude-trace for this last year but I'm not sure if it still works, I've not tried it in a while: https://simonwillison.net/2025/Jun/2/claude-trace/

[ Parent | on HN ]