They came up with the function,

    f(x; W, W', ...) = ...max(0, W''max(0, W'max(0, Wx)))

And called it a "neural network"

When your opening gambit is that ridiculous, you really can't expect them to improve. We're not dealing with people interested in science in the ordinary sense.