It's not a "hallucination" it's a "miss-prediction".

And the more-classical methods of CV are still very capable of miss-predicting.

No matter what method you choose, you must test how accurate it is, NN have the benefit of being fine-tuned for specific applications as well. If you want to be extra sure then you likely want to use both.