Re:NGraph: A New Open Source Compiler for Deep Learning Systems
by wenzhexue on Wednesday March 21, 2018 @11:33AM
(#16638938)
We have an allreduce op in nGraph to support data parallel using OpenMPI, and are investigating the best approaches to integrate with frameworks. We also plan to add more collective communication ops to support model parallel in future.
Assuming also that this has support for AVX-512 acceleration?