News for hackers. Stuff that matters.

A comment on cuDF – GPU DataFrame Library. Parent comment

Re:cuDF – GPU DataFrame Library by hack_ml on Monday June 03, 2024 @02:50AM (#40560008)
There is dask cudf which gets a lot of the way there.

https://docs.rapids.ai/api/dask-cudf/stable/

[ Parent | on HN ]
Re:cuDF – GPU DataFrame Library by 3abiton on Monday June 03, 2024 @03:10AM (#40560103)
This is huge, this was my only gripe with cudf!
[ Parent | on HN ]
Re:cuDF – GPU DataFrame Library by xs83 on Monday June 03, 2024 @03:23AM (#40560169)
I did a conversion of 500GB of data using dask_cudf on a GTX 1060 with 6GB of VRAM and was able to do it faster than a 20 node m3.xlarge Cluster.

What you can do on even consumer GPU's is mind blowing.

[ Parent | on HN ]
Re:cuDF – GPU DataFrame Library by ashvardanian on Monday June 03, 2024 @12:19PM (#40564212)
Last time I’ve used it, Dask was a lot worse than simple manual batching.
[ Parent | on HN ]
Re:cuDF – GPU DataFrame Library by iamcreasy on Monday June 03, 2024 @02:44PM (#40565963)
How does it perform when it comes to plotting these large data points? Can I use matplotlib?
[ Parent | on HN ]