top | item 41653152

(no title)

incognition | 1 year ago

Ilya was the Google researcher..

discuss

order

ants_everywhere|1 year ago

Wasn't he at OpenAI when transformers and Google's pretrained transformer BERT came out?

ants_everywhere|1 year ago

Oh, oops, the piece I was missing was Radford et al. (2018) and probably some others. That's perhaps what you were referring to?