[kwhitefoot]

Ai in practice doesn't have anything to do with simulation, nor with 'solving a significant part of the most complex brains'.

The immediate threat is that humans will use the leverage that LLMs give to replace and to influence other humans, in other words to gain power over us.

Whether this is AGI or not is beside the point.

[semi-extrinsic]

Ah, but the replacing humans issue is a completely different "threat", and one we've overcome many many times since the Luddites and even before. Every time we make something more efficient we face this exact problem, and we eventually solve it.

As for the influencing part, what specific actions to gain power over us can be achieved now with LLMs, that could not be achieved before using a few tens of thousands of paid humans?

[kwhitefoot]

> what specific actions to gain power over us can be achieved now with LLMs, that could not be achieved before using a few tens of thousands of paid humans?

It's being able to do it without having to employ the tens of thousands of humans that makes it different. With the LLM you are able to react much faster and pay fewer people more money.