News for hackers. Stuff that matters.
Re:Machine learning for the impatient: algorithms tuning alg... by numlocked on Monday July 23, 2012 @02:30PM (#4282347)
To prevent overfitting. A common technique is to use cross-validation, where you train some percentage of the data (90%) and test on the remaining (10%), and cycle through which 10% you use as test (each train/test split is called a "fold"). Once you've identified a model that resists overfitting, you can train on all of the data.

edit: As noted in the other reply, having a truly blind validation set is still ideal.

There are no comments on this comment yet.