News for hackers. Stuff that matters.

A comment on Debugging Compiled Code for R with Positron. Parent comment

Re:Debugging Compiled Code for R with Positron by vhhn on Friday November 01, 2024 @01:42PM (#42019537)
Unlike many other languages, R has a native/built-in tabular data structure. So when your data have tabular structure R is by far the best glue for building pipes between external libreries. If the data fits in RAM it literally doesn't have to leave the data.table object throughout the whole pipeline (including all the cleaning and transformations).

The only meaningful alternative I see is Python with maybe Polars or DuckDB.

[ Parent | on HN ]
Re:Debugging Compiled Code for R with Positron by stevenae on Friday November 01, 2024 @02:15PM (#42019924)
Fellow R / Polars user here. How (in what applications) do you use DuckDB?
[ Parent | on HN ]
Re:Debugging Compiled Code for R with Positron by tylermw on Friday November 01, 2024 @08:57PM (#42023153)
DuckDB is great for medium data: Too big for memory, but small enough to fit on local storage. It's also extremely performant for loading data and supports a wide range of storage backends. It's also really well integrated with R and can really speed up certain queries, as long as the DuckDB engine can translate them to valid SQL.
[ Parent | on HN ]