betterwithbacon
betterwithbacon on Hacker News
Re:Streamz: Python pipelines to manage continuous streams of data
on Friday March 27, 2020 @01:18PM (#22704771)
cuStreamz defers its computation down to cuDF which uses a combination of ahead of time compiled kernels via libcudf and just in time compiled kernels via Numba, CuPy, and Jitify for its execution.
As far as I know none of the above technologies use texture memory.
The RAPIDS docs site has an overview presentation that is a good source of architecture diagrams and would likely be a good start to further reading: https://docs.rapids.ai/overview
Re:Streamz: Python pipelines to manage continuous streams of data
on Friday March 27, 2020 @01:14PM (#22704722)
PyTorch supports both `__cuda_array_interface__` and dlpack which allows effectively sharing the GPU pointer without having to go through a host numpy array. Tensorflow is actively working on adding support for dlpack here: https://github.com/tensorflow/tensorflow/issues/24453