top | item 36718944 (no title) d110af5ccf | 2 years ago Information loss, or the result of useful computation? VAEs exist after all. discuss order hn newest chriswarbo|2 years ago LLMs can't reason about spelling, e.g. asking for a sentence which contains no letter "a"; and can also struggle with rhyming, etc. The most obvious explanation is that they never 'see' the underlying letters/spelling, only tokens.
chriswarbo|2 years ago LLMs can't reason about spelling, e.g. asking for a sentence which contains no letter "a"; and can also struggle with rhyming, etc. The most obvious explanation is that they never 'see' the underlying letters/spelling, only tokens.
chriswarbo|2 years ago