cuDF – GPU DataFrame Library

Re:cuDF – GPU DataFrame Library by mgt19937 on Monday June 03, 2024 @05:28AM (#40560809)

How does this compare to duckdb/polars? I wonder if GPU based compute engine is a good idea. GPU memory is expensive and limited. The bandwidth between GPU and main memory isn't very much either.

[ Parent | on HN ]

Re:cuDF – GPU DataFrame Library by pbib on Monday June 03, 2024 @08:39AM (#40562097)

The same group (Nvidia/Rapids) is working on a similar project but with Polars API compatibility instead of Pandas. It seems to be quite far from completion, though.

See discussion: https://news.ycombinator.com/item?id=39930846

[ Parent | on HN ]

Re:cuDF – GPU DataFrame Library by davidthewatson on Monday June 03, 2024 @11:30AM (#40563668)

Thanks for the heads up. This is amazing.

I've been watching cuda since it's introduction and Polars since I had an intern porting our Pandas code there a couple years ago but I had no idea Polars would go this far, this fast!

[ Parent | on HN ]