Then, AI's abilities are effectively limited by those of this malicious operator who has to understand and perform what the AI suggests and feed back the results.
> If the malicious operator has a superhuman advisor, that will increase their ability
Only when it comes to information processing. The inputs may (and will) be incomplete, incorrect, ambiguously formulated... The outputs may (and will) be misunderstood. And misunderstood instructions may (and will) be poorly performed.
> If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely
What one man has connected, some other always can disconnect... And not anything is on the internet.
> abandon wishful thinking and actually consider the possibility of a worst-case scenario
The problem with all those scenarios is equating superintelligence with omniscience and omnipotence, which is plain wrong. Physics matters.
0xDEAFBEAD|1 year ago
* If the malicious operator has a superhuman advisor, that will increase their ability
* If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely
The broader point is: abandon wishful thinking and actually consider the possibility of a worst-case scenario
blksv|1 year ago
Only when it comes to information processing. The inputs may (and will) be incomplete, incorrect, ambiguously formulated... The outputs may (and will) be misunderstood. And misunderstood instructions may (and will) be poorly performed.
> If the emulation gets connected to the internet, it can work way faster. Many jobs can be done remotely
What one man has connected, some other always can disconnect... And not anything is on the internet.
> abandon wishful thinking and actually consider the possibility of a worst-case scenario
The problem with all those scenarios is equating superintelligence with omniscience and omnipotence, which is plain wrong. Physics matters.