Re:“Deep Learning has outlived its usefulness as a buzz-phrase”
by jph00 on Saturday January 06, 2018 @01:18AM
(#16084121)
Second order methods are attracted to saddle points in high dimensional spaces. The math and practice of optimizing these surfaces has a lot of nuances like this so much of the stuff you learn in your convex optimization class doesn't apply too well.
[ Parent
| on HN ]
Re:“Deep Learning has outlived its usefulness as a buzz-phrase”
by steev on Saturday January 06, 2018 @08:23AM
(#16085145)
Do you have any recommendations on sources to read about this? Everything I've read discusses the use of the Hessian to not only determine you are at a saddle point but to also use its eigenvalues to escape.