Re:Goodbye Claude, Hello Pi
by miki123211 on Sunday November 08, 2026 @04:28AM
(#50411682)
Most harnesses are not designed with conversations to be append-only from the start, which causes us all endless pain when caching is concerned.
When making a harness, it is so, so easy to do the "web thing" and have your system prompt be a template where you dynamically inject variables like the current date or the contents of the current working directory, and then just re-render that template on every request. THis is a bad, doubleplusungood, terrible, awful idea, and you should never do this under any circumstances. Anthropic will soon force you not to by literally refusing conversations that "break continuity" in this way and do anything but append new user messages at the end, but other providers at least appear to work.
Re:Goodbye Claude, Hello Pi
by bscphil on Sunday November 08, 2026 @06:49AM
(#50412456)
I don't think I've seen opencode change the system prompt of a conversation, nor pi (though I have less experience there). Is there a specific scenario you're referring to where this could happen?
When making a harness, it is so, so easy to do the "web thing" and have your system prompt be a template where you dynamically inject variables like the current date or the contents of the current working directory, and then just re-render that template on every request. THis is a bad, doubleplusungood, terrible, awful idea, and you should never do this under any circumstances. Anthropic will soon force you not to by literally refusing conversations that "break continuity" in this way and do anything but append new user messages at the end, but other providers at least appear to work.