News for hackers. Stuff that matters.
Re:The limitations of gradient descent as a principle of bra... by bjourne on Sunday June 10, 2018 @08:34PM (#17280924)
Isn't it only the trajectory that is sensitive to the parametrization? Afaik, the location of the minimas do not depend on it.
Re:The limitations of gradient descent as a principle of bra... by simonster on Tuesday June 12, 2018 @12:25AM (#17290696)
Yep, the minima are in the same locations. However, if the problem has multiple minima, then the parametrization can affect which minimum gradient descent actually reaches.