News for hackers. Stuff that matters.
Re:How deep learning on GPUs wins datamining contest without... by doobwa on Friday November 02, 2012 @02:42PM (#4734116)
I agree these methods still require a fair amount of expert knowledge and intuition in order to make the various choices you mention. On the other hand, Bayesian optimization can prove useful for exploring such a space. A recent paper (http://arxiv.org/pdf/1206.2944.pdf) used Bayesian optimization with GPs to find hyperparameter settings for a deep convolutional network. The resulting hyperparameters gave state of the art performance, beating those chosen by an expert (Krizhevsky, the researcher who recently won ImageNet).
Re:How deep learning on GPUs wins datamining contest without... by danger on Friday November 02, 2012 @02:51PM (#4734161)
Agreed. Here's a previous HN discussion on that topic: http://news.ycombinator.com/item?id=4281630