[thenfcm]

Well isnt the point humans wouldn't need to do basically anything?

It would be 'desirable' because the value is in the product of the labour not the labour itself. (Of course the resulting dystopian hellscape might be considered undesirable)

[ekidd]

As I keep pointing out, if the model ever stops needing you to complete ambitious goals, then what does the model actually need you for?

People somehow imagine an agent that can crush the competition with minimal human oversight. And then they somehow think that they'll be in charge, and not Sam Altman, a government, or possibly the model itself.

If the model's that good, nobody's going to sell it to you.

[handoflixue]

A Dark Factory is a lot more work than the model, and often perpendicular to the goal of general model improvement. A Dark Factory specializes in building one particular thing, whereas the AI labs care about generalization and what you can do absent such advanced scaffolding.

It is so named because we have literal Dark Factories in the real world, run by robotics instead of AI, producing cellphones without any need for humans.

None the less, said literal Dark Factory that actually exists, in the real world, is still owned by the corporation that built it. The robots did not take over, the government did not seize it.