Re:No Train No Gain:Revisiting Efficient Training Algrthm fo...
by froster on Tuesday July 25, 2023 @01:32AM
(#36858336)
Recent paper highlights the difficulty of creating a new optimizer as drop-in replacement. Sophia and Lion were recently proposed as superior alternatives to Adam, but appeared worse in an independent eval
[ Parent
| on HN ]
There are no comments on this comment yet.