[ahmeni]

The first big AI disaster has already happened and it is the thousand little cuts from people putting faith into systems that aren't built to be trustworthy. It is the software dev missing a critical safety check because "ai coding tools" at work have promised 10x delivery results and now they must use them or be seen as falling behind. It is the engineering manager throwing concrete flexural strength questions into the unaccountable void of ChatGPT because he doesn't want to pay for the overtime of asking someone accountable. It is the foolhardy amount of money being shoveled into the entire ecosystem that absolutely cannot provide the returns people need for any of it to make financial sense.

[latexr]

> The first big AI disaster has already happened and it is the thousand little cuts

I agree with your point, but per your own words that isn’t a big disaster but multiple little ones. Each person might have learned about some of them but only in passing and without too much information.

“The big one” will be something which everyone will be made aware of from the news, like the CrowdStrike outage.

[soulofmischief]

This is the research part of research and development, this time though it's sort of like a distributed Manhattan project happening in the open. Research takes a lot of money. Anyone can jump in and help improve these models and the ecosystem.

[ahmeni]

There's a reason real research has controls around it to prevent harm.