top | item 13175924

(no title)

mti | 9 years ago

Regular humans have, for over half a century, possessed the ability to annihilate the entirety of civilization by basically pushing a button. So it always amazes me when people feel the need to make science fictional assumptions like AGI in their doomsday scenarios.

discuss

order

TeMPOraL|9 years ago

AGI isn't a replacement doomsday scenario; it's a set of additional scenarios to be considered together with the usual ones - nuclear war, biological war, global pandemic, gamma ray bursts, etc.

LordKano|9 years ago

A malevolent AI is a particularly terrifying prospect.

Despite the fact that humanity has possessed the ability to destroy ourselves for quite so long, fortunately because we're still flesh and blood, biological entities and our evolution has lead to some more or less universal truths about us. We tend to love our families. We tend to want what we consider to be the best for our offspring. We tend to have some sense of obligation to protect our parents when they can no longer do so for themselves.

All of these (and many other) things that act to mediate our civilization-destroying traits wouldn't necessarily apply to an AI.