top | item 47201694

(no title)

lacunary | 1 day ago

What's the difference between comprehending and understanding in this context?

discuss

order

wizzwizz4|17 hours ago

"Understanding" is a metaphor, used to describe an upper bound on model capability without excess verbiage. "Comprehending" includes the ability to appropriately manipulate the concepts when they're taken out of their ordinary framing context, which in principle a transformer model should be able to mimic a lot better than the systems we have; but in practice the training processes we're using do not teach the models to do this.