They were trained on a lot of garbage human-written slop originally, they have to post-train the models so the responses are good. Luckily if you’re an AI company you probably have the whole chat, so it’s easy to categorise it: the user might respond “Good job, that fixed it” or “WHAT THE FUCK IS THIS??? WORST CODE I’VE EVER SEEN”.