Farewell Pandas, and thanks for all the fish

Re:Farewell Pandas, and thanks for all the fish by softwaredoug on Thursday August 29, 2024 @08:39AM (#41390181)

One thing I do like about pandas is it’s pretty extensible to columns of new types. Maybe I’m missing something, but does Polars allow this? Last time I checked there wasn’t a clear path forward.

[ Parent | on HN ]

Re:Farewell Pandas, and thanks for all the fish by deadlypointer on Thursday August 29, 2024 @11:59AM (#41392185)

OTOH the list and struct types allow lots of complex operations, e.g with `.eval`, which run blazingly fast.

[ Parent | on HN ]

Re:Farewell Pandas, and thanks for all the fish by porker on Thursday August 29, 2024 @09:57AM (#41390880)

I'm curious, when do you want to add a new column type? It's not a situation I've been in.

[ Parent | on HN ]

Re:Farewell Pandas, and thanks for all the fish by softwaredoug on Thursday August 29, 2024 @11:12AM (#41391626)

GeoPandas is one popular library (https://geopandas.org/en/stable/)

I added a column type for full text search, searching tokenized text (https://github.com/softwaredoug/searcharray)

The pandas support for extensions is very robust with extensive testing to make sure you can do all the data aggregations functionality you expect in and pandas column.

[ Parent | on HN ]

Re:Farewell Pandas, and thanks for all the fish by datadrivenangel on Thursday August 29, 2024 @09:31AM (#41390623)

Ibis allows this with custom datatypes.

[ Parent | on HN ]