News for hackers. Stuff that matters.

A comment on Understanding gradient descent. Parent comment

Re:Understanding gradient descent by thatsadude on Friday August 05, 2016 @11:37AM (#12233109)
Check out Nesterov's Accelerate gradient. Its convergence rate is O(1/t^2).
[ Parent | on HN ]
Re:Understanding gradient descent by pmarreck on Friday August 05, 2016 @02:16PM (#12234611)
https://blogs.princeton.edu/imabandit/2013/04/01/accelerated...

for anyone else curious

[ Parent | on HN ]