News for hackers. Stuff that matters.

A comment on OpenAI Reinforcement Fine-Tuning Research Program. Parent comment

Re:OpenAI Reinforcement Fine-Tuning Research Program by whimsicalism on Saturday December 07, 2024 @05:30PM (#42353360)
Online RL for LLMs means you are sampling from the model, scoring immediately, and passing gradients back to the model.

As opposed to, sampling from the model a bunch, getting scores offline, and then fine tuning the model on those offline scored generations.

[ Parent | on HN ]

There are no comments on this comment yet.