top | item 34957874

(no title)

levesque | 3 years ago

I think I prefer the other commenter's point, referring to ChatGPT as a known learning paradigm for chatbots. But thanks for the little crash course on analogies ;)

discuss

order

basch|3 years ago

Isn't that consistent with, and the same as, my original comment?

ChatGPT:GPT3::ChatLLaMa:LLaMa::Chatbot-through-RLHF:LLM

aka ChatGPT is a known chatbot implementation, and GPT3 and LLaMa are known LLMs.

levesque|3 years ago

Yes and no. You wouldn't say GPT to mean large language models or autoregressive language models. I would've thought the same to be true for ChatGPT instead of Chatbots with RL from human feedback (RLHF), perhaps the field is moving towards adopting ChatGPT as a paradigm name. Note that the title doesn't say a ChatGPT-like model based on LLaMa, it says outright opensource implementation of ChatGPT.