[proc0]

Good points. Design has a higher amount of creativity than the implementation based on specs, and AI is missing something that hampers its creativity, if it even has anything analogous to it.

I suspect this is also related to agency, and why we need to spell things out in the prompt and run multiple agents in a loop, not to mention the MoE and CoT, all of which would not be needed if the model could sustain a single prompt until it is finished, creating its own subgoals and reevaluating accordingly. Agency requires creativity and right now that's the human part, whether it's judging the output or orchestration of models.