News for hackers. Stuff that matters.
Re:RLHF a LLM in <50 lines of Python by numeri on Monday February 12, 2024 @12:38PM (#39347780)
I don't know about strictly superior. It's certainly strictly easier for people with a budget, who just need "good enough" results the first try. I don't have any evidence whatsoever, but I'd expect that enough tuning and retries can get squeeze a bit more performance out of RLHF than you can get out of DPO.

There are no comments on this comment yet.