News for hackers. Stuff that matters.
Re:A Quick Look at Support Vector Machines by akyu on Thursday March 23, 2017 @12:10PM (#13941073)
Yes SVMs are still great models. The advantage neural nets have over them are that they can do automatic feature extraction. By the time you get to the last layer of a neural net, you are basically just doing a simple logistic classification, but the features coming in have been learned from all of the previous layers.

I've even seen people use pretrained ImageNet classifiers, chop off the last layer and use an SVM as the actual classifier, and it works very well for some problems.

Re:A Quick Look at Support Vector Machines by bunderbunder on Thursday March 23, 2017 @10:12PM (#13946021)
> they can do automatic feature extraction

Sort of. They can readily do really basic feature engineering along the lines of doing nonlinear transformations of the input. With a bit more doing, they can do spatial feature engineering (e.g., convolutional nets), and with a bit more foresight and planning they can learn the kinds of complex "hidden Markov process" style features you typically use in natural language processing.

But, as far as I'm aware, anyway, they can't necessarily do a great job with things like irregular time series (which is a huge chunk of big data), so you're still stuck doing some of that basic feature engineering. And I hesitate to say that some of the fancier architectures like LSTMs can be characterized as a turnkey solution for feature engineering, considering how much thought and effort and pre-existing knowledge and theory about what the engineered features should look like in the first place needed to go into designing them. So I feel like the "they can learn their own features" thing is a bit overhyped.

Re:A Quick Look at Support Vector Machines by Eridrus on Saturday March 25, 2017 @08:07AM (#13955214)
I've had great success with LSTMs for time series classification.
Re:A Quick Look at Support Vector Machines by platz on Thursday March 23, 2017 @03:41PM (#13943440)
> automatic feature extraction

Hope you have a *ton of data, otherwise it's not gonna happen

Re:A Quick Look at Support Vector Machines by trendia on Thursday March 23, 2017 @03:53PM (#13943588)
And a lot of tweaking of configuration parameters until it's "automatic".
Re:A Quick Look at Support Vector Machines by akyu on Thursday March 23, 2017 @08:39PM (#13945633)
This was true maybe 10 years ago. Not so much anymore.
Re:A Quick Look at Support Vector Machines by akyu on Thursday March 23, 2017 @08:40PM (#13945636)
No, it will still happen. The learned features will just be "overfit" to that small dataset.