Re:Machine Learning Library for C++
by misiti3780 on Friday April 26, 2013 @11:29AM
(#5613433)
Implementing the SVM from scratch was time consuming - no?
[ Parent
| on HN ]
The only tricky part would be writing a quadratic solver. Alternatives: either solve a linear SVM using gradient descent (simpler to write), or offload the core of the algorithm to an existing solver like cvxopt.
edit: For an example of using cvxopt, check out http://www.mblondel.org/journal/2010/09/19/support-vector-ma...
Another approach is to implement Platt's SMO:
http://en.wikipedia.org/wiki/Sequential_minimal_optimization
Re:Machine Learning Library for C++
by misiti3780 on Friday April 26, 2013 @04:32PM
(#5615279)
cool - thanks
Yes it was :) but time well spent imo.
On reflection I guess I might have had more free time to spend on this than a normal person - I did the SVM as a [small] part of my masters project, so if you're time constrained with a real job and a life then might be best to disregard me.
Re:Machine Learning Library for C++
by misiti3780 on Friday April 26, 2013 @04:32PM
(#5615273)
If you had the quadratic solver, I would think it would be reasonable to add the rest of the code. If you started adding costs, gammas, etc. I would think it would take a while. I spent hours looking at the source code of libSVM at my last job and never really understood what the hell was going on