News for hackers. Stuff that matters.
Re:Collapse of Self-Trained Language Models by tempusalaria on Wednesday April 17, 2024 @04:36PM (#40069806)
In InstructGPT there is a direct pretraining gradient addition as well as KL penalty

There are no comments on this comment yet.