News for hackers. Stuff that matters.
Re:Evolution Is the New Deep Learning by XnoiVeX on Thursday March 22, 2018 @12:22PM (#16650034)
A philosophical tangent: Evolution did not always produce the best outcomes. Would neuroevolution be vulnerable to similar effects? Probably a good research area. https://www.wired.com/2009/07/st-best-5/
Re:Evolution Is the New Deep Learning by blacksmith_tb on Thursday March 22, 2018 @12:31PM (#16650153)
A can think of a few objections to that argument. First, evolution isn't 'over' for any of the species on that list, and if any of those seemingly maladaptive traits really do cause serious problems for those species, we would expect them to be selected against (there are some cases where they are associated with other traits that are important and helpful, and so won't be tossed overboard even then). Evolution also proceeds fairly slowly, in the sense that it may take many generations for a mutation to really become a positive adaptation and not just an oddity.
Re:Evolution Is the New Deep Learning by klmr on Thursday March 22, 2018 @01:32PM (#16650762)
I agree, the examples aren’t the best chosen. But there are cases which are pretty well established in biology as being maladaptations. — The laryngeal nerve is the most famous of those [1] because there’s really no advantage to the way it develops, and its characteristics poses significant health problems that do affect evolutionary fitness negatively. Yet there’s no easy fix to solve its positioning through gradual mutations.

[1] https://en.wikipedia.org/wiki/Recurrent_laryngeal_nerve#Evid...

Re:Evolution Is the New Deep Learning by bckygldstn on Thursday March 22, 2018 @02:33PM (#16651306)
That nerve seems like an example of a local optimum. The way to avoid this is either to increase the mutation rate, or modify the fitness function so the intermediate states aren't so heavily penalised.

We can't easily do that with real evolution but it's configurable with evolutionary algorithms, as with most machine learning algorithms. The hard part is finding those parameters.

Re:Evolution Is the New Deep Learning by glup on Thursday March 22, 2018 @12:29PM (#16650126)
Biological evolution seem pretty susceptible to overfitting to ecological circumstances—I worry that there would be an analog for these techniques with NNs
Re:Evolution Is the New Deep Learning by eafan on Thursday March 22, 2018 @07:38PM (#16653756)
There are well known problems that evolutionary systems are much better at solving than NNs. The multiplexer problem, for instance, or sorting networks, where the search space is too rugged or deceptive for neural network solutions.
Re:Evolution Is the New Deep Learning by sewercake on Thursday March 22, 2018 @12:41PM (#16650256)
Yeah, agreed -- evolution doesn't produce best, just good enough. But for large classes of 'problems', we can't (from a computational complexity standpoint) find best outcomes efficiently.

'Evolutionary' techniques, are, in some sense, 'trial and error'. For many tasks where we already have efficient algorithms, this isn't particularly useful. However, where we DONT have efficient algorithms, or know what the concept of what an 'efficient' algorithm even is, trial and error techniques, like evolutionary algorithms, seem like great choices.

Re:Evolution Is the New Deep Learning by eafan on Thursday March 22, 2018 @09:03PM (#16654190)
In a rainforest there is no ‘best’ solution - John Holland
Re:Evolution Is the New Deep Learning by cvaidya1986 on Thursday March 22, 2018 @12:29PM (#16650128)
What’s the definition of best
Re:Evolution Is the New Deep Learning by sabertoothed on Thursday March 22, 2018 @01:53PM (#16650935)
Not having a 5 meter detour [1] of a nerve.

[1] https://en.wikipedia.org/wiki/Recurrent_laryngeal_nerve

Re:Evolution Is the New Deep Learning by goatlover on Thursday March 22, 2018 @12:31PM (#16650154)
350,000 species of beetles.
Re:Evolution Is the New Deep Learning by TheOtherHobbes on Thursday March 22, 2018 @01:20PM (#16650675)
In music, evolution produced Bach, so it can't really be considered a failure.

It took a while though, and it's possible alternative approaches would have been produced a similar result more efficiently.

Re:Evolution Is the New Deep Learning by goatlover on Thursday March 22, 2018 @11:17PM (#16654816)
It also produced Justin Bieber and Weird Al. Point being, if the goal of your evolutionary algorithm is Bach, how do you filter for that result among the other million possibilities? And what makes Bach the success of music? Maybe more people prefer listening to Taylor Swift.
Re:Evolution Is the New Deep Learning by cvaidya1986 on Thursday March 22, 2018 @03:45PM (#16652002)
I love HN community. Awesome responses!