top | item 34958362

(no title)

levesque | 3 years ago

Yes and no. You wouldn't say GPT to mean large language models or autoregressive language models. I would've thought the same to be true for ChatGPT instead of Chatbots with RL from human feedback (RLHF), perhaps the field is moving towards adopting ChatGPT as a paradigm name. Note that the title doesn't say a ChatGPT-like model based on LLaMa, it says outright opensource implementation of ChatGPT.

discuss

order

basch|3 years ago

> You wouldn't say GPT to mean large language models or autoregressive language models.

In the analogy, that’s exactly what you are saying. Identical to Toyota and BMW meaning “the make of the car.”

Maybe reimplementation is a more precise word, a black box re-engineering/cloning. In this case I inferred it by knowing it was a different LLM underneath, and that this group didn’t have access to the chatgpt source code.