Re:DMTK: Distributed Machine Learning Toolkit from Microsoft
by x0x0 on Wednesday November 11, 2015 @02:47PM
(#10548791)
distributed ml tends not to work well on aws. Many (most?) distributed ml algorithms are essentially limited by network speed. In a p2p topology, many are effectively limited by the slowest peer-to-peer link of the (nodes choose 2) links. aws networking is mediocre at best; even the rack-local instances are relatively slow.
cred: helped build a distributed in-memory ml toolkit
cred: helped build a distributed in-memory ml toolkit