Re:Magistral — the first reasoning model by Mistral AI
by danielhanchen on Tuesday June 10, 2025 @11:32AM
(#44238091)
Oh it's the KL term sorry - beta * KL ie they set beta to 0.
The goal of it was to "force" the model not to stray to far away from the original checkpoint, but it can hinder the model from learning new things
Wait, how are they computing the loss?