There's things which small models can't do, and where obviously a large model works better. Not emergence, I agree.
I think they're using emergent for a different category of things - still things that a small model couldn't do, but specifically which a large model can just do without any of the work we thought we'd have to do for that ability.
Or at least, that's how I see emergent being a useful term, both in a behavior and a value context.
jmull|2 years ago
This also makes clear its relative nature (that is, what "large" and "small" mean), which the use of the word "emergent" obscures.
LawTalkingGuy|2 years ago
I think they're using emergent for a different category of things - still things that a small model couldn't do, but specifically which a large model can just do without any of the work we thought we'd have to do for that ability.
Or at least, that's how I see emergent being a useful term, both in a behavior and a value context.
1123581321|2 years ago