top | item 39431938

(no title)

otaviogood | 2 years ago

This is much more interesting if you see the animations. https://x.com/jaschasd/status/1756930242965606582

discuss

order

notfed|2 years ago

Fractal zoom videos are worth infinite words.

catlifeonmars|2 years ago

So what exactly are we looking at here? Did the authors only use two hyperparameters for the purpose of this visualization?

yazzku|2 years ago

It's explained in the post:

> Have you ever done a dense grid search over neural network hyperparameters? Like a really dense grid search? It looks like this (!!). Blueish colors correspond to hyperparameters for which training converges, redish colors to hyperparameters for which training diverges.