[csneeky]

Pretty sure I’m a machine that’s drawn all my conclusions by statistically analyzing all the input I’ve received since birth… I don’t really know how else I would learn what I have… and I don’t understand how being “just that” is what differentiates modern approaches to AI and my brain.

[MrScruff]

Exactly this. A lot of these type of articles on AI make the simultaneous mistakes of understating what even the current iterations of models are capable of, while overstating the complexity of our own intelligence.

As these models get larger, and we start moving up the ladder of emergent behaviours, there will come a point (possibly quite soon) where the sort of distinctions being drawn are irrelevant.

“Oh that’s just an advanced multimodal model with some sensors and goal seeking behaviour. Stop anthropomorphising it!”

[goatlover]

That doesn't address the alignment problem. As Yudkowski has pointed out, the space of possible minds is vast. Humans only occupy a small area. The models were are designing are not animal/biological minds. They don't have the same evolutionary drives. We're creating minds in a different part of the mind space, and there's a good chance they will figure out solutions that are not beneficial to us.