Neural Network Loss Landscapes: What do we know? (2021)

Re:Neural Network Loss Landscapes: What do we know? (2021) by evolvingstuff on Sunday July 17, 2022 @06:16PM (#32131983)

Here are some "animated" loss landscapes I made quite a long time ago:

http://evolvingstuff.blogspot.com/2011/02/animated-fractal-f...

These are related to recurrent neural networks evolved to maximize fitness whilst wandering through a randomly generated maze and picking up food pellets (the advantage being to remember not to revisit where you have already been.)

[ Parent | on HN ]

Re:Neural Network Loss Landscapes: What do we know? (2021) by gildandstain on Sunday July 17, 2022 @11:00PM (#32134108)

These are wonderful, great work.

[ Parent | on HN ]

Re:Neural Network Loss Landscapes: What do we know? (2021) by evolvingstuff on Monday July 18, 2022 @02:19PM (#32141533)

Thank you!

[ Parent | on HN ]