It's anecdotal, but in my usage GPT "knows" way better how to formalize a problem than the actual factual answer. If I ask for a list of animal names that end with the string "ar", the answer is nonsense, but if I ask for a python script that check if a string end with the substring "ar", the answer is correct. Same with simple math problems and many other questions. I was wondering the same thing, if it would be possible to use some kind of deterministic confirmation as a part of GPT training.