top | item 35560598

(no title)

frozencell | 2 years ago

> ChatGPT competitors of EU origin?

ChatGPT is not research. If you want real research: https://ai.facebook.com/blog/large-language-model-llama-meta...

Edit: end paper is https://arxiv.org/abs/2302.13971

> Hugo Touvron, Thibaut Lavril, Gautier Izacard, Xavier Martinet, Marie-Anne Lachaux, Timothée Lacroix, Baptiste Rozière, Naman Goyal, Eric Hambro, Faisal Azhar, Aurelien Rodriguez, Armand Joulin, Edouard Grave, Guillaume Lample

> We introduce LLaMA, a collection of foundation language models ranging from 7B to 65B parameters. We train our models on trillions of tokens, and show that it is possible to train state-of-the-art models using publicly available datasets exclusively, without resorting to proprietary and inaccessible datasets. In particular, LLaMA-13B outperforms GPT-3 (175B) on most benchmarks, and LLaMA-65B is competitive with the best models, Chinchilla-70B and PaLM-540B. We release all our models to the research community.

discuss

order

olabyne|2 years ago

That's a lot of french names there