top | item 41653152

(no title)

Ilya was the Google researcher..

discuss

Wasn't he at OpenAI when transformers and Google's pretrained transformer BERT came out?

Oh, oops, the piece I was missing was Radford et al. (2018) and probably some others. That's perhaps what you were referring to?