(no title)
Wowfunhappy | 4 days ago
It's not that the input contained useful information—obviously it does not—it's that it's causing the output to be more random, and thus more "creative".
Without the gibberish, "generate a random game" would likely repeatedly surface high-probability concepts—platformers, space shooters, tower defense—whatever sits near the top of the model's prior distribution for "game." The gibberish causes the model to land on concepts like "frog" that it would almost never reach otherwise.
No comments yet.