News for hackers. Stuff that matters.

A comment on Learning to think critically about machine learning. Parent comment

Re:Learning to think critically about machine learning by Filligree on Monday May 02, 2022 @02:27PM (#31238890)
Why are there so few local minima, you mean?

I think it’d have to be related to the huge number of dimensions it works on. But I have no idea how I’d even begin to prove that.

[ Parent | on HN ]
Re:Learning to think critically about machine learning by srean on Monday May 02, 2022 @02:47PM (#31239169)
Its not even certain that they are few. Whats rather unsettling is that with these local moves of SGD the parameters settle on a good enough local minima in spite of the fact that we know that many local minima exists that have zero or near zero training loss. There are glimmers or insight here and there but the thing is yet to be fully understood
[ Parent | on HN ]