[yxre]

For the most part, ML doesn't control high-risk things with a human in the loop. The worst cases for ML so far have been stock market crashes from algo trading.

Its entirely possible that an update to self-driving car's algorithms cause a day of chaos as the self-driving cars lose control and crash. Worst case scenario.

I agree that the secondary effects of the ML systems are going to be far worse than the primary. We can only see how it goes.

[mlyle]

> For the most part, ML doesn't control high-risk things with a human in the loop.

That was never my argument. (I assume you mean "without")

You said:

> > ML risks can range from accidents to annoyances.

Ignoring second-order effects isn't reasonable. Global warming is an indirect, nth-order effect from an industrialized economy based on fossil fuels.