[tenthirtyam]

> "AI" will probably lead to some kind of "digital cancer"

Gosh I've just imagined someone asking an AI agent to code a computer virus to infect software "X". The virus' code will be wonderfully complex and therefore so will the response of the AI responsible for keeping "X" uninfected and in good working order.

I was imagining code becoming awesomely complex even without the adversarial element in play.

[tenthirtyam]

Replying to myself here. Maybe coding will eventually be simply learning how to give an AI the right prompt. e.g. instead of

  "Hey AI, create my new banking app with such-and-such functionality, appearance,  properties, APIs, network connections etc"

we will instead do:

  "Hey AI, you are a banking app on a user's cellphone. Connect to mybank.com, authenticate the user and allow the user to perform these-and-those actions in a sensible interface in accordance with the API spec. Don't let yourself be jailbroken."

Then the virus writer's job changes into jailbreaking the AI. Obviously with an AI's assistance...?

Then it would be logical to have a single AI on the phone managing all the prompts in parallel: e.g. "Hey AI, be android by doing [actions]", "Hey AI, be firefox...", "Hey AI, be snapchat...", "Hey AI, be [insert app name]...".