Re:Amazon DSSTNE: Deep Scalable Sparse Tensor Network Engine
by romerocesar on Tuesday May 10, 2016 @10:08PM
(#11672168)
One important difference is model-parallel training. From the FAQ:
DSSTNE instead uses “model-parallel training”, where each layer of the network is split across the available GPUs so each operation just runs faster. Model-parallel training is harder to implement, but it doesn’t come with the same speed/accuracy trade-offs of data-parallel training.
DSSTNE instead uses “model-parallel training”, where each layer of the network is split across the available GPUs so each operation just runs faster. Model-parallel training is harder to implement, but it doesn’t come with the same speed/accuracy trade-offs of data-parallel training.
https://github.com/amznlabs/amazon-dsstne/blob/master/FAQ.md