Re:How to Escape Saddle Points Efficiently
by Cacti on Friday September 01, 2017 @12:45PM
(#15150137)
Well, in general, no, there is no perturbation method large (or good) enough to get out of saddle points, including via stochastic gradient descent. It might work in a particularly specific problem, but not in general.
[ Parent
| on HN ]
Re:How to Escape Saddle Points Efficiently
by Eridrus on Friday September 01, 2017 @12:50PM
(#15150179)
Fine, but I mostly care about ML applications, where I'm wondering if this is expected to help at all.