News for hackers. Stuff that matters.
Re:Magistral — the first reasoning model by Mistral AI by gyrovagueGeist on Tuesday June 10, 2025 @01:58PM (#44239510)
Does anyone know why they added minibatch advantage normalization (or when it can be useful)?

The paper they cite "What matters in on-policy RL" claims it does not lead to much difference on their suite of test problems, and (mean-of-minibatch)-normalization doesn't seem theoretically motivated for convergence to the optimal policy?

Re:Magistral — the first reasoning model by Mistral AI by danielhanchen on Tuesday June 10, 2025 @07:05PM (#44242496)
Tbh I'm unsure as well I took a skim of the paper so if I find anything I'll post it here!