News for hackers. Stuff that matters.
Re:Python Data Science Handbook by porker on Tuesday December 02, 2025 @10:52AM (#46122464)
> No, polars or spark is not a good answer, those are optimized for data engineering performance, not a holistic approach to data science.

Can you expand on why Polars isn't optimised for a holistic approach to data science?

Re:Python Data Science Handbook by fifilura on Tuesday December 02, 2025 @12:08PM (#46123497)
I have not work with Polars, but I would imagine any incompatibility with existing libraries (e.g. plotting libraries like plotnine, bokeh) would quickly put me off.

It is a curse I know. I would also choose a better interface. Performance is meh to me, I use SQL if i want to do something at scale that involves row/column data.

Re:Python Data Science Handbook by rbartelme on Tuesday December 02, 2025 @12:14PM (#46123590)
This is a non-issue with Polars dataframes to_pandas() method. You get all the performance of Polars for cleaning large datasets, and to_pandas() gives you backwards compatibility with other libraries. However, plotnine is completely compatible with Polars dataframe objects.
Re:Python Data Science Handbook by maleldil on Tuesday December 02, 2025 @12:14PM (#46123593)
You can always convert from Polars to Pandas. Plotnine will do it automatically for you, even.