Re:Symbolic Discovery of Optimization Algorithms
by mtcrawshaw on Saturday February 18, 2023 @11:26AM
(#34848102)
The second line appears unnecessary because the formula in that comment is missing one line from the definition of LION. See my above comment.
c ← 0.9m + (0.1)g
There doesn't seem to be a significant difference between their code:
θ ← θ + η sign(0.9m + (0.1)g)
and just not having the 2nd line at all:
θ ← θ + η sign(m)