News for hackers. Stuff that matters.

A comment on The Matrix Calculus You Need for Deep Learning. Parent comment

Re:The Matrix Calculus You Need for Deep Learning by mxwsn on Friday June 29, 2018 @10:58AM (#17424885)
In optimization it's known as Newton's method.

See the third section here for an intuitive image of repeated parabola-fitting. https://ardianumam.wordpress.com/2017/09/27/newtons-method-o...

Wiki: https://en.wikipedia.org/wiki/Newton%27s_method_in_optimizat...

[ Parent | on HN ]
Re:The Matrix Calculus You Need for Deep Learning by mlevental on Friday June 29, 2018 @01:18PM (#17425928)
i feel silly for never realizing before that this was the appropriate geometric interpretation of newton's method.
[ Parent | on HN ]