Same, even when it should not apologize Claude always says that to me.

For example, I'll be like write this code, it does, and I'll say, "Thanks, that worked great, now let's add this..."

It will still start it's reply with "I apologize for the confusion". It's a particularly odd tick of that system.

Clear case of "fix it in post": https://tvtropes.org/pmwiki/pmwiki.php/Main/FixItInPost

I believe that the system prompt offers a way to fix up alignment issues that could not be resolved during training. The model could train forever, but at some point, they have to release it.

It's possible it reduces the rate but doesn't fix it.

This did make me wonder how much of their training data is support emails and chat, where they have those phrases as part of standard responses.

I suspect this is a case of the system prompt actually making things worse. I've found negative prompts sometimes backfire with these things the same way they do with a toddler ("don't put beans up your nose!"). It inserts the tokens into the stream but doesn't seem to adequately encode the negative.

I know, I suspect that too. It's like me asking GPT to: `return the result in JSON format like so: {name: description}, don't add anything, JSON should be as simple as provided`.

ChatGTP: I understand... here you go

{name: NAME, description: {text: DESCRIPTION } }

(ノಠ益ಠ)ノ彡┻━┻

I was also pretty shocked to read this extremely specific direction, given my (many) interactions with Claude.

Really drives home how fuzzily these instructions are interpreted.

I mean... we humans are also pretty bad at following instruction too.

Turn left, no! Not this left, I mean the other left!

“Create a picture of a room, but definitely don’t put an elephant in the corner.”