News for hackers. Stuff that matters.

A comment on DuckDB in Action. Parent comment

Re:DuckDB in Action by jasonjmcghee on Monday March 18, 2024 @04:39PM (#39749720)
In Python, I think of them as, DuckDB is for getting the data you want, in the form you want it, from a file / remote place. Polars is for when you want to do something with that data, like visualize it.

`duckdb.sql("SELECT foo, bar * 2 as bar_times_2 FROM ...").pl()` (now in polars format) -> other stuff

In Rust, it's a bit fuzzier to me, as DuckDB is a pretty heavy dependency. I'm looking more and more fondly at DataFusion.

[ Parent | on HN ]
Re:DuckDB in Action by nozzlegear on Monday March 18, 2024 @07:36PM (#39751367)
Do you mean Polars depends on/uses DuckDB pretty heavily in Rust? I'm only just now dabbling in Rust myself so I'm not familiar.
[ Parent | on HN ]
Re:DuckDB in Action by jasonjmcghee on Tuesday March 19, 2024 @03:14PM (#39759228)
No not at all. Polars is not dependent on DuckDB.

DuckDB is a heavy dependency in terms of size. It's written in C++, so you can't work with it like a native rust dep.

[ Parent | on HN ]