top | item 38547429

(no title)

ma2rten | 2 years ago

No this is not correct. Arguably OpenAI invented LLMs with GPT3 and the preceding scaling laws paper. I worked on LAMDA, it came after GPT4 and was not as capable. Google did invent the transformer, but all the authors of the paper have left since.

discuss

order

visarga|2 years ago

This is like the Ship of Theseus. If all transformer authors reunited under one startup rival of Google, who would have the bragging rights?

corethree|2 years ago

Isn't a transformer an LLM?

avarun|2 years ago

No. You’re confused. Most LLMs in production today use transformers under the hood but a transformer is most certainly not a type of LLM.