[jawarner]

The tweet is in response to a preliminary paper [1] [2] studying text found in images generated by, e.g., "Two whales talking about food, with subtitles." DALL-E doesn't generate meaningful text strings in the images, but if you feed the gibberish text it produces -- "Wa ch zod ahaakes rea." back into the system as a prompt, you would get semantically meaningful images, e.g., pictures of fish and shrimp.

[1] https://giannisdaras.github.io/publications/Discovering_the_...

[2] https://twitter.com/giannis_daras/status/1531693093040230402

[dekhn]

I think the tweeter is being a bit too pedantic. Personally I spent some time thinking about embeddings, manifolds, the structure of language, scientific naming, and what the decoding of the points near the center of clusters in embedding spaces look like (archetypes), after seeing this paper. I think making networks and asking them to explain themselves using their own capabilities is a wonderful idea that will turn out to be a fruitful area of research in its own right.

[lotaezenwa]

I concur that the tweeter is being pedantic.

This is largely some embedding of semantics that we currently do not fully have a mapping for, precisely because it was generated stochastically.

Saying it was "not true" seems like clickbait.

[austinjp]

> asking [neural networks] to explain themselves using their own capabilities

Exactly. This could be profound. I'm looking forward to further work here. Sure, the examples here are daft, but developing this approach could be like understanding a talking lion [0] only this time it's a lion of our making.

[0] https://tzal.org/understanding-the-lion-the-in-joke-of-psych...

[LudwigNagasena]

It’s a fruitful area of research for sure, but there is a huge gap between “it invented pig Latin” and “it invented Esperanto/Lojban”. Referring to the first as inventing a language is very misleading.

[numpad0]

> "Wa ch zod ahaakes rea."

“Watch those sea creatures.”?

[nomel]

Are you claiming it has learned to read using hooked on phonics? No wonder it can't spell!