Re:Quadrillion-parameter transformers and how to train them
by alwa on Sunday November 08, 2026 @01:33PM
(#50415747)
Is this the line of “single shared weight” work that you’re referring to?
Re:Quadrillion-parameter transformers and how to train them
by magicalhippo on Sunday November 08, 2026 @03:14PM
(#50416681)
[delayed]
I'm also reminded of that car AI using a neural net with a single shared weight, where the topology of the neural graph was what made the AI work.
How stuff is connected is what our DNA is about, so seems obvious the topology must encode behavior and such and it's not all learned.