News for hackers. Stuff that matters.

A comment on RLHF is just barely RL. Parent comment

Re:RLHF is just barely RL by WithinReason on Thursday August 08, 2024 @06:55AM (#41190067)
Adversarial networks are a straightforward solution to this. The reward for generating and solving tests is different.
[ Parent | on HN ]
Re:RLHF is just barely RL by imtringued on Thursday August 08, 2024 @10:27AM (#41191912)
That's a good point. A model that is capable of implementing a nonsense test is still better than a model that can't. The implementer model only needs a good variety of tests. They don't actually have to translate a prompt into a test.
[ Parent | on HN ]