[13years]

> Myself I believe technology and eventually AI were our fate once we became intelligence optimizers.

Yes, everyone talks about the Singularity, but I see the instrumental point of concern to be something prior which I've called the Event Horizon. We are optimizing, but without any understanding any longer for the outcomes.

"The point where we are now blind as to where we are going. The outcomes become increasingly unpredictable, and it becomes less likely that we can find our way back as it becomes a technology trap. Our existence becomes dependent on the very technology that is broken, fragile, unpredictable, and no longer understandable. There is just as much uncertainty in attempting to retrace our steps as there is in going forward."

[pixl97]

>but without any understanding any longer for the outcomes.

A concept in driving where your braking distance exceeds your view/headlight range at any given speed. We've stomped on the accelerator and the next corner is rather sharp.

Isaac Asimov did a fictional version of this in the Foundation trilogy.

[13years]

Yes, that's an excellent description.

[exe34]

> We are optimizing, but without any understanding any longer for the outcomes.

That's how the Vile Offspring is born.

[psychoslave]

That's a very idealistic view to believe there ever was something as a point were some people had a really more clear and precise representation which was accurate of what was going to come.

[gsf_emergency]

Iirc Eva's Instrumentality comes from Cordwainer-Smith..

Subtlety missed by TFA but not necessarily Eva: Government is meant to be the Instrument (like AI), NOT the people/meat.

https://en.wikipedia.org/wiki/Instrumentality_of_Mankind#Cul...

Eva's optimization: Human instrumentality=> self governance. Which is not that ambiguous, one could say, less so than Star Child (2001)

"Of the people" vs <of the people>