Re:What Is Machine Learning Anyway?
by NavinF on Thursday July 07, 2022 @02:50AM
(#32010692)
It’s really hard to compare optimizers. Common architectures and default hyperparameters were discovered alongside Adam so you’d have to redo a bunch of sweeps if you wanted a “fair” comparison. In practice this doesn’t really matter and everyone just uses Adam. If you had infinite compute, you’d try every combo and select the one with the best results.
[ Parent
| on HN ]
There are no comments on this comment yet.