One other reason machine learning has acquired the "Deep" label was the rise of the computing power. It's not just a bunch of tricks, it's also plain old hardware speed that is driving the revolution.
Also, we now have access to huge datasets to try our algorithms on. Progress in ML depends a lot on the training data that is available.
Is this true? My impression is that "deep learning" is a series of mathematical tricks and design and implementation concepts that get you to solve neural networks of depth greater than 3-4, which becomes mathematically challenging.