top | item 46073123

(no title)

Voultapher | 3 months ago

I like to call them slow-AI. They are paperclip optimizing AIs. No single component wants the larger outcomes, yet they happen. These slow-AIs are terraforming our planet into a less habitable one in order to make GDP number go up, at any cost.

discuss

order

beeflet|3 months ago

The slow AIs are driven by consumer behavior. Paperclip optimizers die pretty quickly without demand for paperclips.

The inputs and the outputs of the AI are always human-facing, so the goals vaguely resemble human values (even if the values are greed).

MangoToupe|3 months ago

I've said for years that the market itself is the best real-world parallel to skynet, not some AGI or superintelligent machine.

vladms|3 months ago

People changed environment even before these optimizations. I think now it's more a problem of fast enough "catch-up and converge", for example for CO2 : https://ourworldindata.org/grapher/co-emissions-per-capita?c... - if the rich countries would reduce a bit faster (using better technologies) then those technologies could be used by the others and impact would be reduced.

Voultapher|3 months ago

It would be great if we could engineer our way out of this situation, but we can't. For many years I strongly believed in our cleverness, after all I was clever and in the narrow domain I worked in - tech - cleverness was enough to overcome most issues. So why not human climate change?

In Tom Murphy's words:

> Energy transition aspirations are similar. The goal is powering modernity, not addressing the sixth mass extinction. Sure, it could mitigate the CO2 threat (to modernity), but why does the fox care when its decline ultimately traces primarily to things like deforestation, habitat fragmentation, agricultural runoff, pollution, pesticides, mining, manufacturing, or in short: modernity. Pursuit of a giant energy infrastructure replacement requires tremendous material extraction—directly driving many of these ills—only to then provide the energetic means to keep doing all these same things that abundant evidence warns is a prescription for termination of the community of life.