Re:Regent: A Language for Implicit Dataflow Parallelism
by lightsighter on Tuesday June 23, 2020 @06:34AM
(#23612102)
Please correct me if I'm wrong, but I think all of those system only work inside of a single process. Legion/Regent support distributed multi-node multi-process execution both on supercomputers and in the cloud.
Do you have a set of benchmarks that others can reimplement to compare the approaches?
I've added Dataflow Parallelism to my own multithreading runtime[1] but I didn't had dataflow focused benchmarks yet, well I could add Cholesky Decomposition but it's quite involved.
I expect the people from TaskFlow[2] and Habanero[3] (via Data-Driven Futures) would be quite interested as well in a common set of dataflow parallelism benchmarks.
By the way if you didn't read the DaCe paper[4] you absolutely should, seems like the age of Dataflow parallelism and properly optimizing for data is coming.
[1]: https://github.com/mratsim/weave#dataflow-parallelism
[2]: https://github.com/taskflow/taskflow
[3]: https://github.com/habanero-rice/hclib
[4]: https://github.com/spcl/dace, https://arxiv.org/abs/1902.10345