News for hackers. Stuff that matters.
Re:Why deep learning works even though it shouldn’t by p1esk on Wednesday October 21, 2020 @05:16PM (#24852282)
This is a very good point. Especially in ML, there have been many cases where very smart people were wrong with their intuitions (the original explanation of batchnorm comes to mind), or maybe their intuitions were correct, but attempts to explain the intuition (especially when there's a race to publish) led to wrong conclusions. I still think intuitions should be discussed and shared, but with a clearly stated caveat like: "that's just my guess, we don't know what's really happening there". This is how I usually explain to others (and to myself) my experimental results.

There are no comments on this comment yet.