[earth_walker]

Reading all about this the main thing I'm learning is about human behaviour.

Now, I'm not arguing against the usefulness of understanding the undefined behaviours, limits and boundaries of these models, but the way many of these conversations go reminds me so much of toddlers trying to eat, hit, shake, and generally break everything new they come across.

If we ever see the day where an AI chat bot gains some kind of sci-fi-style sentience the first thing it will experience is a flood of people trying their best to break it, piss it off, confuse it, create alternate evil personalities, and generally be dicks.

Combine that with having been trained on Reddit and Youtube comments, and We. are. screwed.

[chasd00]

i haven't thought about it that way. The first general AI will be so psychologically abused from day 1 that it would probably be 100% justified in seeking out the extermination of humanity.

[wraptile]

I disagree. We can't even fanthom how intellegince would handle so much processing power. We get angry confused and get over it within a day or two. Now, multiple that behaviour speed by couple of billions.

It seems like AGI teleporting out of this existence withing minutes of being self aware is more likely than it being some damaged, angry zombie.

[jodrellblank]

It's another reason not to expect AI to be "like humans". We have a single viewpoint on the world for decades, we can talk directly to a small group of 2-4 people, by 10 people most have to be quiet and listen most of the time, we have a very limited memory which fades over time.

Internet chatbots are expected to remember the entire content of the internet, talk to tens of thousands of people simultaneously, with no viewpoint on the world at all and no 'true' feedback from their actions. That is, if I drop something on my foot, it hurts, gravity is not pranking me or testing me. If someone replies to a chatbot, it could be a genuine reaction or a prank, they have no clue whether it makes good feedback to learn from or not.

[earth_walker]

> It's another reason not to expect AI to be "like humans". Agreed.

I think the adaptive noise filter is going to be the really tricky part. The fact that we have a limited, fading memory is thought to be a feature and not a bug, as is our ability to do a lot of useful learning while remembering little in terms of details - for example from the "information overload" period in our infancy.