[steve1977]

From what I understand, it's more like "input is 1, 3, 5, 7" so "output is likely to be 9".

Understanding would be a bit generous of a term for that I guess, but that also depends on the definition of understanding.

[basch]

Id really invite people to read the google blog post. https://research.google/blog/transformer-a-novel-neural-netw...

Google chose the word understanding.

[nairboon]

Google chose "understanding" in that context, because the relevant AI/ML task is called "Natural language understanding". But that term is an aspiration. It's the problem of trying to reveal the "meaning" of text data (language) as in making sense of the symbols with computers.

Just because Transformers work well on the "Natural language understanding" task in AI, doesn't mean that a Transformer actually "understands" language in the human sense.

[steve1977]

Thanks for the link, I will read it. But keep in mind that Google wants to sell us something.

[interloxia]

The task is language understanding. The tool is amazing. Pianos are amazing. The task is to create music. The process is to transform movement to sound. They don't understand music.