>Human doctors 'hallucinate' stuff all the time, due to lack of sleep, lack of time, lack of education and/or just not caring enough to pay proper attention to what they are doing.

No, they don't. If that happened anywhere near all the time, we would never have given up alchemy and bloodletting, because there would be no reason to trust medicine at all, and yet it works overwhelmingly well most of the time for most people. Meanwhile, AIs hallucinate by design.