News for hackers. Stuff that matters.

A comment on Neural network training makes beautiful fractals. Parent comment

Re:Neural network training makes beautiful fractals by paulrudy on Monday February 12, 2024 @11:38PM (#39354498)
I'm only a fractal enthusiast, but my impression is that the key distinction that makes these fractals, or at least fractal-like, is not their detail per se, but that there is complexity at every scale. From the article:

> we find intricate structure at every scale

> At every length scale, small changes in the hyperparameters can lead to large changes in training dynamics

[ Parent | on HN ]
Re:Neural network training makes beautiful fractals by bob88jg on Tuesday February 13, 2024 @09:15AM (#39357781)
"small changes in the hyperparameters can lead to large changes in training dynamics"

This is the definition of Chaos though no? Butterfly flaps its wings, hurricane on other side of the planet...

[ Parent | on HN ]
Re:Neural network training makes beautiful fractals by paulrudy on Thursday February 15, 2024 @12:55PM (#39385899)
As far as I am aware, these kinds of nonlinear relationships are a feature of fractal dynamics, but I'm not a mathematician.
[ Parent | on HN ]