Re:Optimization Methods for Large-Scale Machine Learning
by oliwaw on Tuesday June 21, 2016 @03:43PM
(#11948830)
>Not necessarily, often derivatives are analytically known in ML.
The focus here is largely on deep neural networks. In this domain, the Hessian cannot be computed and SGD (with minor variants) continues to be the golden standard.
The focus here is largely on deep neural networks. In this domain, the Hessian cannot be computed and SGD (with minor variants) continues to be the golden standard.