The mathematics of neural networks is very well understood from a theoretical and scientific perspective. It is easy to say that a neural network will have predictive power given labelled training data.

Whether or not the predictions it is making satisfy unstated requirements is another problem altogether.