It's not marginally better, it's significantly better in some areas. There were massive improvements on some benchmarks like speech recognition and image classification.

It's not another machine learning algorithm, it's a feature learning algorithm. You can feed raw pixels into an SVM, but you aren't taking advantage of the structure of the data at all.