[BrainInAJar]

probably?

even if the LLM is trained on flawless C code (which it isn't) it still has no way of reasoning about a complex system, it's just "what token is statistically most likely to come next"

[smolder]

I said that because it's very possible for someone to write a more flawed program without an LLMs help. The exact probabilities weren't central to my point.