top | item 39354498

(no title)

paulrudy | 2 years ago

I'm only a fractal enthusiast, but my impression is that the key distinction that makes these fractals, or at least fractal-like, is not their detail per se, but that there is complexity at every scale. From the article:

> we find intricate structure at every scale

> At every length scale, small changes in the hyperparameters can lead to large changes in training dynamics

discuss

order

bob88jg|2 years ago

"small changes in the hyperparameters can lead to large changes in training dynamics"

This is the definition of Chaos though no? Butterfly flaps its wings, hurricane on other side of the planet...

paulrudy|2 years ago

As far as I am aware, these kinds of nonlinear relationships are a feature of fractal dynamics, but I'm not a mathematician.