News for hackers. Stuff that matters.
Re:Magistral — the first reasoning model by Mistral AI by danielhanchen on Tuesday June 10, 2025 @11:32AM (#44238091)
Oh it's the KL term sorry - beta * KL ie they set beta to 0.

The goal of it was to "force" the model not to stray to far away from the original checkpoint, but it can hinder the model from learning new things

There are no comments on this comment yet.