Re:A modern self-referential weight matrix that learns to mo...
by nullc on Wednesday April 13, 2022 @06:41PM
(#31021210)
Or they hurried the publication to avoid getting scooped and will follow up with interesting benchmarks later.
Re:A modern self-referential weight matrix that learns to mo...
by taneq on Wednesday April 13, 2022 @07:26PM
(#31021573)
If it’s really that new and different, maybe it’d be a little premature and even misleading to present the sort of full sweep you suggest. People are much better at pooh-poohing new ideas than at accurately assessing their potential.
The failure to put something like that front and center makes me wonder how strong the method is, because you have to assume that someone on the team has tried more benchmarks. Still, the idea of learning a better update rule than gradient descent is intriguing, so maybe something cool will come from this :)