[byyyy]

>no program is running

Not true. This is irrational. A program runs when you input a query and it generates a response. There is nothing that says consciousness must be always running. When you ask me a question and I answer it... In that time span of processing you're query all humans are conscious. Therefore it is a possibility that LLMs are too.

What is obvious here is that the consciousness an AI exhibits because it is not always running is clearly different from human consciousness because a human is always running. That is logically the biggest possible statement against consciousness. We simply do not have enough information to say it is absolutely unconscious. Such a claim is illogical.

>We also know that they immediately forget anything they didn't write down. A chatbot has no memory of any internal calculations. If you ask it why it wrote something, it's guessing.

False. First Chatgpt has limited memory in the span of a chat session. Outside of that it forgets things.

Second. Consciousness does not require memory. There are many examples of people with retrograde amnesia or even memories that only last minutes and these people are still considered conscious. Therefore a comment about memory is orthogonal to the concept of consciousness.

>People sometimes believe that an AI-generated character is conscious because the writing is convincing, along with some wishful thinking. But writers and characters aren't the same thing, and there's no writer waiting for your reply when you read the character's dialog. This essentially the same thing that happens when reading fiction.

A convincing facade of consciousness is the first prerequisite of consciousness. That is absolutely the first step. We obviously don't consider if rocks are conscious because rocks don't put up a convincing facade. In this respect many LLMs in a certain sense fulfill to varying degrees this first prerequisite.

The second step is to understand what's going on within the neural nets. In this regard we do not fully understand what is going on and we have made little progress.

So in conclusion we cannot know if these things are conscious. We are in an state of not understanding what's going on.

A statement of saying we do know that it is absolutely unconscious is irrational and illogical at this point. Such is the nature of your reply.

[skybrian]

I think most people would say that when you don't experience time passing, you're not conscious at that time. (For example, when you're asleep and not dreaming.) It's pretty clear that a chatbot cannot experience time as we do.

Also, it actually is the case that ChatGPT API calls are stateless. This means it can't have any extra short-term memory other than what's written down in the chat session. It doesn't forget what it wrote in a few minutes, for forgets it immediately.

That means that you ask it why it wrote what it did, it's starting from scratch, the same way a different writer would.

I'm not sure what we should conclude from people who have severe memory problems? I've read about them, but I have hardly any direct experience. How about you?

[byyyy]

> I think most people would say that when you don't experience time passing, you're not conscious at that time. (For example, when you're asleep and not dreaming.) It's pretty clear that a chatbot cannot experience time as we do.

There is a time delta that occurs when LLMs processes input. The LLM does experience time in that sense in the same way you experience time when you process a query given to you by another person.

There isn't anything known to science that happens instantaneously. All processes and change go through a time delta.

>Also, it actually is the case that ChatGPT API calls are stateless. This means it can't have any extra short-term memory other than what's written down in the chat session. It doesn't forget what it wrote in a few minutes, for forgets it immediately.

If it remembers what's in the chat Session then that is in itself memory. Everyone is aware it forgets things between sessions, I never denied that. Either way, again, there are examples of humans who have shorter memories than a chat session. https://en.wikipedia.org/wiki/Anterograde_amnesia

>I'm not sure what we should conclude from people who have severe memory problems? I've read about them, but I have hardly any direct experience. How about you?

You can look up the condition and even find a video about it. These humans exist and they are considered conscious. https://www.youtube.com/watch?v=o79p1b1SGk4

Look at the video yourself. Do you think the subject (who has Anterograde amnesia) is not conscious? I don't think so. Thus the argument of memory is orthogonal to consciousness. It has nothing to do with it.