Re:Microsoft releases CNTK, its open source deep learning to...
by binarymax on Monday January 25, 2016 @10:23AM
(#10967627)
Yes it looks like they have architected for low communication overhead and true parallelization when you have multiple GPUs. 1:4 gives 1:2 on Torch and Caffe, and 1:4 = 1:4 on CNTK.
No idea what the catch is :)