News for hackers. Stuff that matters.
Re:Polars by qwertox on Tuesday January 09, 2024 @03:26AM (#38923697)
Any recommendations on which binary format to use when I want to store all the DataFrames to disk in order to load them at a later point? My data as an indented JSON file takes up around 800 MB.
Re:Polars by congoe on Tuesday January 09, 2024 @05:22AM (#38924427)
Parquet works well as it natively support Apache Arrow, the underlying data structure.