News for hackers. Stuff that matters.
Re:Training and Aligning LLMs with RLHF and RLHF Alternatives by ShamelessC on Sunday September 10, 2023 @03:10PM (#37458947)
That goes without saying.

edit: I don't like your linked article at all. Subtly misleading and/or misinformed. Like a yahoo news but for ML.

to clarify: No one (certainly not OpenAI) ever suggested that RLHF was even remotely useful at dealing with the problem of hallucinations. It's not for that. The insinuation that it was designed for that purpose (at least partially) and yet _failed_ is a faulty one. It was not designed for that purpose. Hallucinations are a known issue with large language models, and while I appreciate LeCunn re-iterating that; far lesser researchers than LeCunn are aware of that fact.

There are no comments on this comment yet.