[viach]

> 1 The tech industry has accidentally invented the initial stages a completely new kind of mind, based on completely unknown principles...

> 2) The intelligence illusion is in the mind of the user and not in the LLM itself.

3) The intelligence of the users is illusion either?

[scandox]

You're right! AI makes us ask really important questions about our own intelligence. I think it will lead to greater recognition that we are first and foremost animals: creatures of intention and action. I think we've put way too much emphasis on our intellectual dimension in the last few hundred years. To the point that some people started to believe that was what we are.

[viach]

Yup. And the real danger of AI is not that it enslaves humans but in that it will bring great disillusionment and existential crisis.

Someone should write a blog post about this to warn humanity.

[Earw0rm]

Perhaps we're confusing intelligence with awareness.

What LLMs seem to emulate surprisingly well is something like a person's internal monologue, which is part of but not the whole of our mind.

It's as if it has the ability to talk to itself extremely quickly and while plugged directly into ~all of the written information humanity has ever produced, and what we see is the output of that hidden, verbally-reasoned conversation.

Something like that could be called intelligent, in terms of its ability to manipulate symbols and rearrange information, without having even a flicker of awareness, and entirely lacking the ability to synthesise new knowledge based on an intuitive or systemic understanding of a domain, as opposed to a complete verbal description of said domain.

Or to put it another way - it can be intelligent in terms of its utility, without possessing even an ounce of conscious awareness or understanding.