News for hackers. Stuff that matters.
Re:Pandas Should Go Extinct by minimaxir on Friday September 11, 2026 @11:20PM (#49668408)
At my work I had convinced the ML pipeline engineers to switch from pandas to polars for even small ETL pipelines and there were notable performance gain with better CPU/memory utilization.

If a library is performant at large datasets, it is likely performant at small ones too.

Re:Pandas Should Go Extinct by sjtrny on Friday September 11, 2026 @11:31PM (#49668463)
I’m not disagreeing with that statement at all. You missed my point that there are thousands of people making small Python scripts for education and personal projects everyday. In those circumstances the performance concerns are irrelevant and the ergonomics of good pandas documentation and community knowledge make it a better choice.
Re:Pandas Should Go Extinct by minimaxir on Friday September 11, 2026 @11:36PM (#49668501)
That inertia is not a good thing, and it's partially why there's stagnation in data science. Polars is more than mature enough in both documentation and resources for it to be a daily driver.