[cm277]

After being initially dazzled, I've drifted firmly into the camp of "this hype cycle is nonsense". I get why VCs/Startups/investors/legislators want (or even need) a hype cycle in a post-ZIRP economy, in an election year, with geo instability. But there's nothing, neither data/evidence that LLM === AGI or even a path that points towards LLM → AGI.

AFAICT, LLMs are stochastic predictors of words within a large context. If you transfer (pun intended) that behavior over to humans, you would call a person like that a bullshitter, or at best a salesguy :-) A bullshitter as a person or team member is useful, but not scalable in the singularity sense: you can scale its output in terms of quantity, but not quality: the stochastic parrot may move prospects through the funnel (necessarily to a higher-IQ actual salesperson) but it will not create a patent from scratch (and probably will not close a deal).

So, we're not getting AGI. Given that the stochastic approach has hit scalability limits (there's no more data to feed), we need a new approach. Are there approaches that can bring AGI outside of LLMs? (AlphaZero?) Or is our industry just a bunch of stochastic parrots that complete every sentence with "eventually we'll have AGI and everything will be either great or destroyed" (which is exactly what an LLM would say at this point)?

[tim333]

From the article

>...The smartest people I have ever met—and they are the ones building this technology.

That's how you go beyond current LLMs. They'll figure something.