Re:Introduction to Support Vector Machines
by wslh on Friday July 12, 2013 @05:39PM
(#6035378)
How is SVM doing comparing to the Neural Network renaissance with deep learning?
[ Parent
| on HN ]
It's always hard to get a birds'-eye view of these things, but from my vantage point, I think SVMs are much more widely used in applications, but have been surpassed by deep learning as the current hot research area in machine learning. There is still SVM research, but it's plateaued compared to the frenzy of the late 1990s and early 2000s, while deep learning has taken off in the past few years. SVM has instead entered the realm of "standard ML tool", as an off-the-shelf technique with robust and well-documented implementations that can be applied in a reasonably straightforward way.
There was a paper not too far back that used SVMs in deep learning and leaped over the then state-of-the-art performance.
Re:Introduction to Support Vector Machines
by joe_the_user on Friday July 12, 2013 @08:02PM
(#6036098)
One interesting thing is that the mechanism of SVMs is formally identical to that of either deep or shallow neural network. The main thing that different is the learning mechanism. I believe Neural Networks inherently take more time to learn than SVMs but for all I know networks could learn a set "better".
I believe NNs and SVMs involve tweaks and judgement to perfect