top | item 45915873 (no title) AlwaysRock | 3 months ago I would love an LLM that says, “I don’t know” or “I’m not sure” once in a while. discuss order hn newest mrguyorama|3 months ago An LLM is mathematically incapable of telling you "I don't know"It was never trained to "know" or not.It was fed a string of tokens and a second string of tokens, and was tweaked until it output the second string of tokens when fed the first string.Humans do not manage "I don't know" through next token prediction.Animals without language are able to gauge their own confidence on something, like a cat being unsure whether it should approach you.
mrguyorama|3 months ago An LLM is mathematically incapable of telling you "I don't know"It was never trained to "know" or not.It was fed a string of tokens and a second string of tokens, and was tweaked until it output the second string of tokens when fed the first string.Humans do not manage "I don't know" through next token prediction.Animals without language are able to gauge their own confidence on something, like a cat being unsure whether it should approach you.
mrguyorama|3 months ago
It was never trained to "know" or not.
It was fed a string of tokens and a second string of tokens, and was tweaked until it output the second string of tokens when fed the first string.
Humans do not manage "I don't know" through next token prediction.
Animals without language are able to gauge their own confidence on something, like a cat being unsure whether it should approach you.