[garspin]

LLMs are text compression algos. They are very good at memorising & retrieving text related to the user input. They can even pass bar exams based on that - some misinterpret that as intelligence.

However, no amount of scaling will change a text memorisation algo into a symbolic reasoning or composability algo, both of which are necessary for progress towards AGI.

So yes, LLMs are a dead end in the quest for AGI. However, they have their uses as a google/stackoverflow replacement.