WingNews logo WingNews
top | item 34430584

(no title)

karfly | 3 years ago

1. You’re right, it’s not ChatGPT exactly. ChatGPT = GPT-3.5 + finetuning on conversational data + alignment (RLHF). But I found out, that GPT-3.5 + proper prompting gives comparable results and works really good.

2. The context of the conversation is preserved by adding whole (or some parts of) dialog to the prompt.

discuss

order

kelsolaar|3 years ago

Given it is not ChatGPT and it is especially missing RLHF, I would suggest amending the repo name and description. Maybe “ChatGPT-like” would be more appropriate here.