News for hackers. Stuff that matters.

A comment on 650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. Daft vs. Spark. Parent comment

Re:650GB of Data (Delta Lake on S3). Polars vs. DuckDB vs. D... by jellyfishbeaver on Sunday November 16, 2025 @09:57AM (#45945564)
We actually baked a rule to catch UDF usage into our Python linter. Almost always, a UDF can be refactored to use only native PySpark functions.
[ Parent | on HN ]

There are no comments on this comment yet.