The Matrix Calculus You Need for Deep Learning

Re:The Matrix Calculus You Need for Deep Learning by mlevental on Friday June 29, 2018 @10:23AM (#17424671)

what is the name of the first method (fit parabolic surface)?

[ Parent | on HN ]

Re:The Matrix Calculus You Need for Deep Learning by mxwsn on Friday June 29, 2018 @10:58AM (#17424885)

In optimization it's known as Newton's method.

See the third section here for an intuitive image of repeated parabola-fitting. https://ardianumam.wordpress.com/2017/09/27/newtons-method-o...

[ Parent | on HN ]

Re:The Matrix Calculus You Need for Deep Learning by mlevental on Friday June 29, 2018 @01:18PM (#17425928)

i feel silly for never realizing before that this was the appropriate geometric interpretation of newton's method.

[ Parent | on HN ]