The quest to evolve neural networks through evolutionary algorithms

Re:The quest to evolve neural networks through evolutionary ... by halflings on Monday October 30, 2017 @12:27AM (#15583085)

I think the premise (neural nets get stuck in local optima) is not trivial, and there has been a lot of research about non-convex optimisation showing that this is not much of an issue. I am not a researcher, but this answer [0] points to this research.

I would also say that there are multiple ways to escape local optima (setting a larger learning rate, multiple random initialisations, ensembling).

https://www.quora.com/How-come-neural-networks-dont-get-stuc...

[ Parent | on HN ]

Re:The quest to evolve neural networks through evolutionary ... by Turing_Machine on Monday October 30, 2017 @12:33AM (#15583114)

You say "not much of an issue" but your link says that it's an "open question that is probably being worked on in the community".

Those aren't the same thing at all.

[ Parent | on HN ]