Re:10B Parameter Neural Networks in Your Basement [pdf]
by darkmighty on Thursday July 02, 2015 @12:57AM
(#9816929)
Those training algorithms should accomplish the same goal, but backpropagation (or some variant) turns out to be the best choice for the kind of network shown here (large, non-recurrent), because it directly uses the learning gradient, while evolutionary methods don't usually make use of this information. I'm not a researcher in this area, but I'm quite sure you'd have a bad time going with pure evolutionary methods for this kind of network.
[ Parent
| on HN ]
There are no comments on this comment yet.