News for hackers. Stuff that matters.
Re:The Training Example Lie Bracket by eden-u4 on Friday April 10, 2026 @12:30AM (#47713666)
I don't understand the RMS table, shouldn't it be non commutative? Eg "example 0 vs 1"'s RMS != "example 1 vs 0"'s RMS? Which doesn't seem the case for the checkpoints I checked.
Re:The Training Example Lie Bracket by pb1729 on Friday April 10, 2026 @06:47AM (#47716113)
If I understand your question correctly, the answer is that not only are the Lie brackets non-commutative, they're anti commutative (swapping the order negates the bracket). But this ironically means they end up having the same RMS, because the squaring part of the RMS gets rid of the sign.