[bwood]

Thank you, that was a fascinating talk and I learned quite a bit.

However, it did not provide a convincing argument as to why LLMs cannot be a part of a "doomer" AI. In fact, I got the opposite vibe from Andrej explaining expected future developments. The whole section on System 2 thinking sounds like a layer constructed around dumb LLMs that would result in vastly improved and more generalizable intelligence.

I agree that just scaling the size of LLMs is probably not sufficient for AGI...but that just seems like one relatively minor piece of all the possible ways it might be achieved.

[mianos]

No argument from me. LLMs would be a component of AI, much like we kind of have long term read only memory. But the extra bits could in the form of some dynamic functions on each tensor network node (G* functions LOL!)

It's interesting to go back and read the MIT OpenAI story from 2020 to hear how thinking about these moral implications was an important part OpenAI.