"On two occasions I have been asked, 'Pray, Mr. Babbage, if you put into the machine wrong figures, will the right answers come out?' I am not able rightly to apprehend the kind of confusion of ideas that could provoke such a question."

A great quote, but not applicable. The problem with LLMs is that they are non-deterministic, and you can ask the exact correct question and get the wrong answer.