[ekidd]

As I keep pointing out, if the model ever stops needing you to complete ambitious goals, then what does the model actually need you for?

People somehow imagine an agent that can crush the competition with minimal human oversight. And then they somehow think that they'll be in charge, and not Sam Altman, a government, or possibly the model itself.

If the model's that good, nobody's going to sell it to you.

[handoflixue]

A Dark Factory is a lot more work than the model, and often perpendicular to the goal of general model improvement. A Dark Factory specializes in building one particular thing, whereas the AI labs care about generalization and what you can do absent such advanced scaffolding.

It is so named because we have literal Dark Factories in the real world, run by robotics instead of AI, producing cellphones without any need for humans.

None the less, said literal Dark Factory that actually exists, in the real world, is still owned by the corporation that built it. The robots did not take over, the government did not seize it.

[darkwater]

> None the less, said literal Dark Factory that actually exists, in the real world, is still owned by the corporation that built it. The robots did not take over, the government did not seize it.

It's probably worth pointing out that hardware and software are two completely different things. At least until the day we have robots that can create and put to work other robots with 0 or minimal human intervention.