Re:Gradient Free Optimizers: A collection of modern optimiza...
by morelandjs on Sunday February 28, 2021 @10:11AM
(#26293897)
I'm wondering the same. I'd be concerned that Random Restart Hill climbing would essentially chase random noise.
[ Parent
| on HN ]
Re:Gradient Free Optimizers: A collection of modern optimiza...
by simonblanke on Sunday February 28, 2021 @10:52AM
(#26294189)
You could be right. I must confess, that i have a (probably) very narrow understanding of typical optimization problems. Most of the objective functions i optimize have machine learning algorithms in it (to optimizer hyperparameters). Depending on the evaluation those can have low noise.
If you like you could provide other use cases and applications for optimization algorithms.