Re:ChatGPT recreated with GPT-3.5?
by karfly on Wednesday January 18, 2023 @01:17PM
(#34430584)
1. You’re right, it’s not ChatGPT exactly. ChatGPT = GPT-3.5 + finetuning on conversational data + alignment (RLHF). But I found out, that GPT-3.5 + proper prompting gives comparable results and works really good.
2. The context of the conversation is preserved by adding whole (or some parts of) dialog to the prompt.
Re:ChatGPT recreated with GPT-3.5?
by kelsolaar on Wednesday January 18, 2023 @01:28PM
(#34430764)
Given it is not ChatGPT and it is especially missing RLHF, I would suggest amending the repo name and description. Maybe “ChatGPT-like” would be more appropriate here.
2. The context of the conversation is preserved by adding whole (or some parts of) dialog to the prompt.