News for hackers. Stuff that matters.
Re:10B Parameter Neural Networks in Your Basement [pdf] by darkmighty on Thursday July 02, 2015 @12:57AM (#9816929)
Those training algorithms should accomplish the same goal, but backpropagation (or some variant) turns out to be the best choice for the kind of network shown here (large, non-recurrent), because it directly uses the learning gradient, while evolutionary methods don't usually make use of this information. I'm not a researcher in this area, but I'm quite sure you'd have a bad time going with pure evolutionary methods for this kind of network.

There are no comments on this comment yet.