News for hackers. Stuff that matters.
Re:The main trick in machine learning by JASchilz on Monday December 09, 2013 @08:31PM (#6878406)
Check out Bayesian Model Selection. It's the mathematical expression of Occam's Razor.
Re:The main trick in machine learning by khawkins on Monday December 09, 2013 @10:46PM (#6878868)
My point is that it shows up everywhere, just in different forms. Sparse coding has a penalty for large basises. Gaussian process regression tunes the density of its representation using Bayesian model Selection. SVMs have a slack parameter which dictates how many errors you'll tolerate to reduce the number of hyperplanes.
Re:The main trick in machine learning by JASchilz on Monday December 09, 2013 @11:20PM (#6878951)
I apologize, my reply was aimed too low.