They can't be wrong in the way that LLMs can be, which is the exact reason that using them for this comparison falls apart - but yes if we're splitting hairs they can be wrong in the same way that javascript is wrong when you ask it to add two floats together.