News for hackers. Stuff that matters.
Re:Capabilities of GPT-4 on Medical Challenge Problems by og_kalu on Sunday March 26, 2023 @06:18PM (#35320246)
Seems it was fine with instruction fine-tuning. Then gone with the RLHF.
Re:Capabilities of GPT-4 on Medical Challenge Problems by cubefox on Sunday March 26, 2023 @06:34PM (#35320401)
I don't think the paper says that. I would guess both SL and RL cause mode collapse.