Re:Symbolic Discovery of Optimization Algorithms
by im3w1l on Saturday February 18, 2023 @09:58AM
(#34847344)
Optimization algorithm they arrived at was (quoting from the paper)
The key thing they do, sending the update through sign, means all weight updates turn into either 1 or -1.
[ Parent
| on HN ]