PandaPy has the speed of NumPy and the usability of Pandas

Re:PandaPy has the speed of NumPy and the usability of Pandas by cerved on Saturday January 25, 2020 @02:38AM (#22145263)

I imagine OP is referring to things like conditional selection on multiple columns, not by AND && operators but by bitwise & operators.

I've mostly use comprehensions to filter and manipulate data and I find the Panda API to be a bit clunky and esoteric.

There are nice built in functions and it displays well in a jupyter notebook but I'm not a fan of the interface.

[ Parent | on HN ]

Re:PandaPy has the speed of NumPy and the usability of Pandas by missosoup on Saturday January 25, 2020 @02:44AM (#22145276)

I mean yes, it's a bit esoteric, but so is every other data manipulation package/language. Look at numpy, dplyr, q, spark, or even sql for similar use cases. There's no easymode way to express arbitrary data operations, especially not when you want them to be performant.

If you don't need the advanced data manipulation capabilities of tools like pandas/dplyr (and if you're using comprehensions only, you don't), there are much easier to use options like apache nifi. Horses for courses.

[ Parent | on HN ]