Re:Using GRPO to Beat o1, o3-mini and R1 at "Temporal Clue"
by bradhilton on Thursday March 06, 2025 @04:25PM
(#43285213)
As for why they dropped suddenly, I don't really know. Sometimes models develop degenerate behaviors, but even when forking from the best checkpoint and lowering the learning rate or changing other hyperparameters, performance stills drops.
It's as if its fate has already been sealed many iterations ago.
[ Parent
| on HN ]
There are no comments on this comment yet.