Re:Distributing a Fully Connected Neural Network Across a Cl...
by iamtrask on Monday November 24, 2014 @11:18PM
(#8656322)
This also might help... here are some slides graphically showing how the distribution works. http://prezi.com/hdctecihctdr/?utm_campaign=share&utm_medium...
For anyone actually interested in some interesting techniques for multi-GPU DNN training, http://arxiv.org/pdf/1404.5997v2.pdf and references therein are probably a good start.