News for hackers. Stuff that matters.
Re:Neural network training makes beautiful fractals by 7e on Monday February 12, 2024 @11:20PM (#39354360)
Today I learned that if something is detailed, it is now fractal.
Re:Neural network training makes beautiful fractals by lifthrasiir on Monday February 12, 2024 @11:58PM (#39354591)
Fractal is not necessarily self-similar; it just has to show enough detailed structures when zoomed in ad infinitum. While no single defiition for fractals exists, at least that's one of the common denominators (because otherwise many "fractals" in the nature can't be called so).
Re:Neural network training makes beautiful fractals by paulrudy on Monday February 12, 2024 @11:38PM (#39354498)
I'm only a fractal enthusiast, but my impression is that the key distinction that makes these fractals, or at least fractal-like, is not their detail per se, but that there is complexity at every scale. From the article:

> we find intricate structure at every scale

> At every length scale, small changes in the hyperparameters can lead to large changes in training dynamics

Re:Neural network training makes beautiful fractals by bob88jg on Tuesday February 13, 2024 @09:15AM (#39357781)
"small changes in the hyperparameters can lead to large changes in training dynamics"

This is the definition of Chaos though no? Butterfly flaps its wings, hurricane on other side of the planet...

Re:Neural network training makes beautiful fractals by paulrudy on Thursday February 15, 2024 @12:55PM (#39385899)
As far as I am aware, these kinds of nonlinear relationships are a feature of fractal dynamics, but I'm not a mathematician.
Re:Neural network training makes beautiful fractals by magicalhippo on Tuesday February 13, 2024 @04:01AM (#39355873)
It would be interesting to compute the fractal dimension[1] to see if it really is fractal[2] or just looks like it.

I recall similar tests being done on paintings by Pollock and of other artists trying to copy his style to determine authenticity[3].

[1]: https://en.wikipedia.org/wiki/Fractal_dimension

[2]: https://mathworld.wolfram.com/Fractal.html

[3]: https://cpb-us-e1.wpmucdn.com/blogs.uoregon.edu/dist/e/12535...

Re:Neural network training makes beautiful fractals by bluetintedfort on Tuesday February 13, 2024 @04:55AM (#39356140)
The sister paper[1] contains the fractal dimensions of some of the images using a boxcount paper.

[1]: https://arxiv.org/pdf/2402.06184.pdf

Re:Neural network training makes beautiful fractals by magicalhippo on Tuesday February 13, 2024 @07:19AM (#39356953)
Ah I had a quick read before I went to bed last night, missed that bit, cheers.
Re:Neural network training makes beautiful fractals by bob88jg on Tuesday February 13, 2024 @09:13AM (#39357768)
Thanks!! I was also under the impression Fractals required self similarity and not just infinite detail but glad to have that misconception corrected!

I think it probably stems from the fact that all the fractals, I have seen, for which the dimension can be analytically calculated do show obvious patterns of similarity at different scales.

Re:Neural network training makes beautiful fractals by magicalhippo on Tuesday February 13, 2024 @09:53AM (#39358125)
Searching I stumbled over this paper[1], which I found interesting, on characterizing the fractal-ness of geological structures.

They point out that the usual measure of fractal dimension, or capacity dimension[2], doesn't consider the physical size of the features and can thus be inaccurate. Instead they suggest using the information dimension[3], which is bounded by the capacity dimension.

[1]: https://doi.org/10.1016/j.chaos.2018.05.008 (full text available on that hub of science)

[2]: https://mathworld.wolfram.com/CapacityDimension.html

[3]: https://mathworld.wolfram.com/InformationDimension.html

Re:Neural network training makes beautiful fractals by tudorw on Saturday February 17, 2024 @10:41PM (#39415964)
Seems there are a few more, Higuchi Dimension, Box Counting Dimension (D0), Generalized Rényi Dimension and others are discussed mid-way through this;

https://medium.com/@h.a.papageorgiou/the-reality-of-the-ruli...