top | item 47160022

(no title)

Wowfunhappy | 4 days ago

> If you could have gotten the same result with any input, or with /dev/random, then effectively no useful information was encoded in the input.

It's not that the input contained useful information—obviously it does not—it's that it's causing the output to be more random, and thus more "creative".

Without the gibberish, "generate a random game" would likely repeatedly surface high-probability concepts—platformers, space shooters, tower defense—whatever sits near the top of the model's prior distribution for "game." The gibberish causes the model to land on concepts like "frog" that it would almost never reach otherwise.

discuss

order

No comments yet.