News for hackers. Stuff that matters.
Re:Using GRPO to Beat o1, o3-mini and R1 at "Temporal Clue" by fc417fc802 on Friday March 07, 2025 @04:57AM (#43288804)
> only if you do a gradient step with data sampled from the exact same weights is it an online step.

Bit pedantic, but amusing thought; wouldn't that imply that asynchronous actor critic is an offline training methodology?

Re:Using GRPO to Beat o1, o3-mini and R1 at "Temporal Clue" by bradhilton on Friday March 07, 2025 @09:06AM (#43290247)
Yes, pedantically, it is! But as I said, everything's on a spectrum. Online-ish data can still work just fine.