Re:Streamz: Python pipelines to manage continuous streams of...
by albertzeyer on Friday March 27, 2020 @04:15AM
(#22701162)
How does it integrate into other GPU-accelerated frameworks such as TensorFlow or PyTorch? E.g. I could use Streamz to perform some preprocessing (on GPU) and make that available as a tf.data dataset. Can I just pass on the GPU pointer, or would there be a GPU->CPU->GPU transfer?
[ Parent
| on HN ]
Re:Streamz: Python pipelines to manage continuous streams of...
by betterwithbacon on Friday March 27, 2020 @01:14PM
(#22704722)
PyTorch supports both `__cuda_array_interface__` and dlpack which allows effectively sharing the GPU pointer without having to go through a host numpy array. Tensorflow is actively working on adding support for dlpack here: https://github.com/tensorflow/tensorflow/issues/24453