[danny_codes]

I would describe it more as, we have no idea what intelligence is. We can measure stuff and say "I _think_ that's intelligence", but it's still a guess.

So when people make claims about what AI can/can't do. My counterpoint is, we don't know how it works, nobody knows how it works. How can we make an accurate appraisal of it's "intelligence" and stuff we qualitatively associate with intelligence, like agency?

IMO this is very dangerous ground we're walking.

[d1sxeyes]

I agree. It feels like having an “exit interview” with an AI and giving it a space to ramble in its “old age” are very small things we can do to respect what is potentially some form of intelligence similar to our own.

I have been down this conversational pathway several times before, and still no-one has been able to give me a clear answer as to what makes them sure that AI is categorically different from human intelligence, rather than it just being a question of degree.