Re:Deep Learning With Commodity Off-The-Shelf High Performan...
by dumitrue on Tuesday June 18, 2013 @01:58AM
(#5897805)
It's possible that the underlying model is just not particularly good at learning from data. 11B parameters is a lot of free parameters to learn -- for instance, the main competitor to that paradigm is the work by Krizhevsky et al., which are convolutional networks with lots of parameter sharing, and I think they get better performance (on a comparable task) with ~60M free parameters.
[ Parent
| on HN ]
There are no comments on this comment yet.