News for hackers. Stuff that matters.
Re:ChatGPT recreated with GPT-3.5? by xg15 on Wednesday January 18, 2023 @01:48PM (#34431061)
Ok, so OpenAI says that ChatGPT is GPT-3.5, but with extensive fine-tuning applied, based on a complex multi-stage feedback process with human evaluators.

But at the same time, you can apparently just take the "raw" GPT-3.5, give it a prompt to behave like an assistant and get comparable results?

So was the whole RLHF process just cargo cult?

Re:ChatGPT recreated with GPT-3.5? by karfly on Wednesday January 18, 2023 @01:56PM (#34431192)
IMO all RLHF stuff is mainly about aligning model not to reply with offensive and inappropriate answers, but NOT about making model's answers better.
Re:ChatGPT recreated with GPT-3.5? by xg15 on Wednesday January 18, 2023 @02:06PM (#34431360)
Ah, that makes sense. Thanks!