Re:Power Method for Approximating Eigenvalues [pdf]
by antognini on Wednesday December 27, 2017 @03:08PM
(#16017610)
The eigenvalues of the Hessian of a neural network describe the curvature of the loss function. It is generally believed that in NNs trained with stochastic gradient descent regions with high curvature tend to generalize poorly.
[ Parent
| on HN ]
There are no comments on this comment yet.