Re:Collapse of Self-Trained Language Models
by tempusalaria on Wednesday April 17, 2024 @04:36PM
(#40069806)
In InstructGPT there is a direct pretraining gradient addition as well as KL penalty
[ Parent
| on HN ]
There are no comments on this comment yet.