Re:“Deep Learning has outlived its usefulness as a buzz-phrase”
by jclos on Saturday January 06, 2018 @05:56AM
(#16084742)
Its simplicity is its power. More complex methods (e.g. second order methods) tend to get attracted to saddle points and produce bad results. Some metaheuristics like evolution strategies are also used in some specific cases (reinforcement learning). Minibatch gradient descent + reasonable minibatch size + some form of momentum is the best we have.
[ Parent
| on HN ]
There are no comments on this comment yet.