News for hackers. Stuff that matters.
Re:The zen of gradient descent by alfiedotwtf on Monday October 10, 2016 @05:08AM (#12675966)
"on Convex functions"

Ah thanks, I thought I missed something. That makes total sense.

"SA/RR are global optimization methods"

RR is definitely global, but (depending on your cooling function I guess) I would say SA is not.

Re:The zen of gradient descent by akssri on Monday October 10, 2016 @05:14AM (#12675982)
It should be noted that things like momentum etc in DNN training are inspired directly from Nesterov, and apparently work very well.