Re:Simplifying Parallel Applications for C++: An Example usi...
by vmarsy on Friday March 17, 2017 @02:18PM
(#13896502)
Thanks for commenting!
> Between nodes, it gets more fun...however it's still a rather well understood problem.
Indeed it's understood, but the scalability problems switch somewhere else once your communication becomes the bottleneck. One advantage of dataflow-like paradigms like yours is that you can avoid major barriers like in Bulk-Syhnchronous-style programs. Those barriers start to become costly when you run with ten/hundreds of thousands processors. That'd be super interesting to see your library scale in those settings, similar to [1].
> Between nodes, it gets more fun...however it's still a rather well understood problem.
Indeed it's understood, but the scalability problems switch somewhere else once your communication becomes the bottleneck. One advantage of dataflow-like paradigms like yours is that you can avoid major barriers like in Bulk-Syhnchronous-style programs. Those barriers start to become costly when you run with ten/hundreds of thousands processors. That'd be super interesting to see your library scale in those settings, similar to [1].
[1] https://www.researchgate.net/profile/Mani_Zandifar/publicati...