I agree, you could solve this with modeling choices. Problem is, OpenAI spent $$$ on GPT which does not, and then more $$$ on InstructGPT’s datasets. So that’s a lot of $$$$$$.

I’m actually not sure you’ll get clear of every “sandbox violation” but probably most and especially the worst ones.