There is a truth of the matter regarding whether a program will eventually halt or not, even when there is no computable proof for either case. Similar for the incompleteness theorems. The correct response in such cases is “I don’t know”.

You know something I don’t hear a lot from chatGPT? “I don’t know”

True. Seemingly, based on my experiences, the instructions are to keep individual engaged for as long as possible. I hate to say it, but it works too.

Providing examples of questions without correct answers does not prove that no questions have correct answers. Or that it’s hallucinations aren’t problematic when they provide explicitly incorrect answers. The author is just avoiding addressing the hallucination problem at all by saying “well sometimes there is no correct answer”