[chaoz_]

but do you think "next token prediction is enough for AGI" though?

[aster0id]

I think AGI is less a "generation" problem and more a "context retrieval" problem. I am an outsider looking in to the field, though, so I might be completely wrong.