There are no lower-level prompts, the messages are formatted using ChatML [1] which has special tokens to denote messages in the chat context that the model was trained on, so it can clearly differentiate between different messages.
[1] https://github.com/openai/openai-python/blob/main/chatml.md
I have suspicions that there is middleware somewhere for the ChatGPT interface to the chat models underneath; something to enclose the normal prompt, to update weights, or to manipulate logits.
Just last night I began seeing a behavior that I could formerly reproduce 100% of the time: asking it to critically evaluate my instructions, explaining why it didn’t follow them, and suggest rewrites. Since the beginning of ChatGPT itself, it would reliably answer that every time. As of last night, it flat out refused to, assuring me of its sincere apologies and confidently stating it’ll follow my instructions better from now on.
If I understand correctly, the older method you describe has been replaced by exposing a GPT model to some further training (as opposed to "pre-training") with successful conversations. I think this premiered with the InstructGPT paper: https://arxiv.org/pdf/2203.02155.pdf
Is this done differently now, or if not I wonder if anyone has been able to guess what that prompt says and how the system message gets inserted.