Well, science includes scientific method. Trial and error that is abundant in deep NN ML research is at the core of science. The theories and math have almost always arrived after stuff worked heuristically.

That's also one of the reasons why deep NN returned the spark to ML. ML was so deep into the proven models and math that the lack of trial and error part slowed down progress.