News for hackers. Stuff that matters.
Re:Deep Learning: What, Why and Applications by DavidSJ on Friday December 02, 2016 @04:17AM (#13087228)
What BinRoo called "parameters" are usually known as "hyperparameters" (parameters are the settings that are learned through gradient descent). There are methods to learn hyperparameters automatically [1], but they're extremely computationally intensive. Even with a single set of hyperparameters, it can take hours to days for training to converge. Now imagine having to run hundreds of experiments to find the best setting.

[1] https://papers.nips.cc/paper/4443-algorithms-for-hyper-param...

There are no comments on this comment yet.