News for hackers. Stuff that matters.
Re:Deep Learning: What, Why and Applications by visarga on Friday December 02, 2016 @04:52AM (#13087381)
> Why can't tweaking parameters be automated?

Not only that it can be done, but it works even by random trial. Sophisticated optimization techniques work out just 2x faster, so if you have cheap GPU, you can run 2x more trials and get your hyperparameters fine tuned.

If you want to apply optimization, you can use one of the popular libraries like hyperopt and MOE.

Re:Deep Learning: What, Why and Applications by kdelok on Friday December 02, 2016 @07:14AM (#13087961)
This really depends on what the hyperparameter landscape looks like. In general, global optimisation is a very hard problem and doing it by random sampling might take longer than the lifetime of the universe (cf Levinthal's paradox for proteins).