top | item 43170971

(no title)

csr86 | 1 year ago

Animals are not next token predictors. Most animals don't have language and don't generate sentences/ideas. It is unique feature of humans and big part of our success.

Animals do have sensors and can reason about real world quite intelligently. This is what LLM- models don't have. Surely, all the text in Internet has a lot of textual information about real world, but something "obvious to animal" might not be there.

I feel us humans are kind of both: We have sensors and experiences about real world, but also oral and written tradition.

Once we develope LLM- with cabability to sense and experience real word (perhaps with some evolutionary algorithm to make it better over time) it should start to be close to human beings.

discuss

order

No comments yet.