[ericlewis]

Perhaps it’s because I know human beings that have the exact same operation and failure mode as the LLM here and I’m probably not the only one. Failing at something you’ve never seen and faking through it is a very human endeavor.

[martin-t]

Regarding errors: I don't know the exact mechanism in the brain that causes humans to make them but i believe it's a combination of imperfect memory, attention span and general lack of determinism. None of these affect logical reasoning as performed by a machine.

Regarding faking it till making it: This is a more general point that there's a difference between simulating human behavior and logical reasoning.

[danielmarkbruce]

If you teach your kids to read, they behave almost exactly like an LLM in so many cases it's eery.