Tips for Better Deep Learning Models

Re:Tips for Better Deep Learning Models by prajit on Friday July 18, 2014 @03:41PM (#8055183)

A question about the actual slides: why don't they use unsupervised pretraining (i.e. Sparse Autoencoder) for predicting MNIST? Is it just to show that they don't need pretraining to achieve good results or is there something deeper?

[ Parent | on HN ]

Re:Tips for Better Deep Learning Models by colincsl on Friday July 18, 2014 @07:23PM (#8056088)

I've only been watching from the Deep Learning sidelines -- but I believe people have steered away from pretraining over the past year or two. I think on practical datasets it doesn't seem to help.

[ Parent | on HN ]