sdandu
Re:Streamz: Python pipelines to manage continuous streams of data
on Friday March 27, 2020 @02:14AM (#22700754)
Good summary @chinmaychandak. One thing to add - streamz is a native python streaming and RAPIDS cuDF(https://rapids.ai/) is a GPU accelerated data science toolkit. cuStreamz acts as a bridge b/w streamz & Rapids cuDF with native kafka integration to GPU accelerate end-end streaming use cases.
Re:Streamz: Python pipelines to manage continuous streams of data
on Friday March 27, 2020 @01:53AM (#22700687)
We are investing heavily on streamz @ Nvidia as a python streaming library. One of the core requirement is "Kafka checkpointing" for reliable end-end pipelines which we implemented recently and commited to the trunk. With that big milestone, we are one step closer to moving to production