LLMs are a calculator for language, but not for reasoning.
When you realize that language and reasoning are in fact two separate skills, only one of which an LLMs is good at, they make much more sense.
Until now, language skill and reasoning skill have been correlated - people with greater skill using language are usually better skilled at reasoning. Put another way, we typically discount poorly written material regardless of it's actual content.
LLMs turn this on its head - great at language, poor at reasoning. So the crutch, the heuristic, we used before no longer applies. We MUST recognize that language ability and reasoning ability are now independent.
kelseyfrog|10 months ago
When you realize that language and reasoning are in fact two separate skills, only one of which an LLMs is good at, they make much more sense.
Until now, language skill and reasoning skill have been correlated - people with greater skill using language are usually better skilled at reasoning. Put another way, we typically discount poorly written material regardless of it's actual content.
LLMs turn this on its head - great at language, poor at reasoning. So the crutch, the heuristic, we used before no longer applies. We MUST recognize that language ability and reasoning ability are now independent.