[kristov]

That's a really great point. General Artificial Intelligence doesn't look like human intelligence. I guess that's the fear: we have never met another general intelligence before. We may as well be about to meet alien intelligence. One that is not constrained by a moral or social framework, and can copy itself at will.

[tayo42]

Are other animals on earth not generally intelligent? Dogs octopus, monkeys, dolphins. They have social structures and can problem solve.

[snowwrestler]

Good time for the classic line by Douglas Adams:

> For instance, on the planet Earth, man had always assumed that he was more intelligent than dolphins because he had achieved so much—the wheel, New York, wars and so on—whilst all the dolphins had ever done was muck about in the water having a good time. But conversely, the dolphins had always believed that they were far more intelligent than man—for precisely the same reasons.

[dotnet00]

They're certainly not general intelligences of an average adult human level (limited abstract reasoning ability, limited ability to transmit their reasoning), which is typically what is referred to as AGI.

[fullstackchris]

you dont think a super intelligence will inherit any amount of moral or social framework from being trained on data that is 100% from humans?