[project2501a]

> Nobody knows how LLMs work.

I'm sorry, come again?

[threethirtytwo]

Nobody knows how LLMs work.

Anybody who claims otherwise is making a false claim.

[bdangubic]

nobody can how how something that is non-deterministic works - by its pure definition

[threethirtytwo]

LLMs are deterministic simply because computers are at the core deterministic machines. LLMs run on computers and therefore are deterministic. The random number generator is an illusion and an LLM that utilizes it will produce the same illusion of indeterminism. Find the seed and the right generator and you can make an LLM consistently produce the same output from identical input.

Despite determinism, we still do not understand LLMs.

[NateEag]

I think they meant "Nobody knows why LLMs work."

[threethirtytwo]

same thing? The how is not explainable. This is just pedantic. Nobody understands LLMs.

[measurablefunc]

Because they encode statistical properties of the training corpus. You might not know why they work but plenty of people know why they work & understand the mechanics of approximating probability distributions w/ parametrized functions to sell it as a panacea for stupidity & the path to an automated & luxurious communist utopia.