Re:Deep Learning: What, Why and Applications
by kdelok on Friday December 02, 2016 @07:14AM
(#13087961)
This really depends on what the hyperparameter landscape looks like. In general, global optimisation is a very hard problem and doing it by random sampling might take longer than the lifetime of the universe (cf Levinthal's paradox for proteins).
Not only that it can be done, but it works even by random trial. Sophisticated optimization techniques work out just 2x faster, so if you have cheap GPU, you can run 2x more trials and get your hyperparameters fine tuned.
If you want to apply optimization, you can use one of the popular libraries like hyperopt and MOE.