Re:Why deep learning works even though it shouldn’t
by blackbear_ on Wednesday October 21, 2020 @02:32AM
(#24845272)
These two papers are not necessarily contradicting each other, but perhaps my description was a bit sloppy.
Sagun et al. (and derivative works) only focus on the Hessian on the trajectory followed by gradient descent, while Li et al. give a broader look at the loss surface as a whole.
Sagun et al. (and derivative works) only focus on the Hessian on the trajectory followed by gradient descent, while Li et al. give a broader look at the loss surface as a whole.