News for hackers. Stuff that matters.
Re:The quest to evolve neural networks through evolutionary ... by pavelchristof on Monday October 30, 2017 @04:25AM (#15583670)
Absolutely no. Random search does not work in high dimensions because of the "curse of dimensionality" - the number of directions to search grows exponentially with dimension. Gradient descent avoids the problem because it knows the right direction.

Evolutionary strategies are doing (natural) gradient descent using an estimate of the gradient. Here's a good article: http://www.inference.vc/evolutionary-strategies-embarrassing...

There are no comments on this comment yet.