News for hackers. Stuff that matters.
Re:MXNet – Deep Learning Framework of Choice at AWS by piiswrong on Tuesday November 22, 2016 @02:21PM (#13016721)
Amazon probably used P2 because they want to advertise it. We can get almost linear speedup on 10 8xM40 machines using MXNet. Batch size is linearly increased with # of machines but empirically it doesn't hurt convergence, at least on imagenet.

I mean who cares about AlexNet any more? It's 2016 already. It trains in under 2h on a single machine. Distributing it doesn't make much sense

Re:MXNet – Deep Learning Framework of Choice at AWS by oneshot908 on Tuesday November 22, 2016 @03:39PM (#13017451)
Publish those numbers with the sample code to reproduce them. Your first paragraph is enough for an awesome white paper/use case to drive adoption. Don't let silly AWS internal politics get in the way if you work there. Find a workaround.

Amazon is at its best when it's customer obsessed and at its worst when it puts politics first.

All IMO of course.

Re:MXNet – Deep Learning Framework of Choice at AWS by p1esk on Tuesday November 22, 2016 @02:37PM (#13016865)
2 hours to train Alexnet on a single machine? Link please.
Re:MXNet – Deep Learning Framework of Choice at AWS by piiswrong on Tuesday November 22, 2016 @02:49PM (#13016990)
https://developer.nvidia.com/cudnn Alex did it on 2x580 in 2012. Took him 1 week. It's 60x faster now even compared to K40