Re:OpenAI Misled You on RLHF
by markisus on Sunday August 17, 2025 @12:55PM
(#44933005)
Just speculating but proximity to a reference answer is a much denser reward signal. In contrast, parsing out a final answer into a pass/fail only provides a sparse reward signal.
[ Parent
| on HN ]