News for hackers. Stuff that matters.

A comment on 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark. Parent comment

Re:650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. D... by data_marsupial on Friday November 14, 2025 @06:09AM (#45925767)
There are real advantages from having a managed data platform compared to managing everything yourself, especially if you have a large number of data teams that need to collaborate.
[ Parent | on HN ]
Re:650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. D... by hobs on Friday November 14, 2025 @07:08AM (#45926028)
Yep, and Databricks will have you churning and changing everything on your stack every 18 months (if you want to keep up to date at all) - its not what I would choose as a data partner unless I was just picking what all the other kids at lunch were.
[ Parent | on HN ]