News for hackers. Stuff that matters.
Re:Deep Learning 101 by kkjkok on Thursday November 14, 2013 @08:57PM (#6737219)
Check out this paper:

Practical recommendations for gradient-based training of deep architectures, Y. Bengio

http://arxiv.org/abs/1206.5533

There is a section on weight initialization on page 15. In general, this paper has a lot of good information in one place.

There are no comments on this comment yet.