News for hackers. Stuff that matters.
Re:Basic Neural Network on Python by mbq on Friday July 05, 2013 @02:09PM (#5996006)
You are just doing a simple validation on a test set rather than cross-validation; the point of CV is to make many iterations of validation on different train-test splits and average the results.
Re:Basic Neural Network on Python by dfrodriguez143 on Friday July 05, 2013 @02:52PM (#5996208)
I agree completely a more complex benchmark should be done with a complete cross-validation.

Just for future reference I did ran the fitting a few times founding very(+-2%) similar results. Also Random Forests do an average so probably not much to improve on that particular algorithm.

Re:Basic Neural Network on Python by mbq on Friday July 05, 2013 @04:36PM (#5996651)
To be honest I don't expect the results to change; but this is an only way to attach significance to the observed differences and to ensure this wasn't a lucky shot.