[supafastcoder]

imagine the hubris and arrogance of trying to control a “superintelligence” when you can’t even control human intelligence

[ben_w]

No more so than trying to control a supersonic aircraft when we can't even control pigeons.

[softg]

I know nothing about physics. If I came across some magic algorithm that occasionally poops out a plane that works 90 percent of the time, would you book a flight in it?

Sure, we can improve our understanding of how NNs work but that isn't enough. How are humans supposed to fully understand and control something that is smarter than themselves by definition? I think it's inevitable that at some point that smart thing will behave in ways humans don't expect.

[skjoldr]

Correct, pidgeons are much more complicated and unpredictable than supersonic aircraft, and the way they fly is much more complex.

[sroussey]

I can shoot down a pigeon that’s overhead pretty easily, but not so with an overhead supersonic jet.