News for hackers. Stuff that matters.
Re:Apache Arrow and the “Things I Hate About Pandas” by wesm on Tuesday September 26, 2017 @12:43AM (#15336238)
Wes here. From what I understand, pandas is the middleware layer powering about 90% (if not more) of analytical applications in Python. It is what people use for data ingest, data prep, and feature engineering for machine learning models.

The existence of other database systems that perform equivalent tasks isn't useful if they are not accessible to Python programmers with a convenient API.

Re:Apache Arrow and the “Things I Hate About Pandas” by FridgeSeal on Tuesday September 26, 2017 @01:12AM (#15336366)
This is exactly how I use it.

I pull the relevant data out of a production database, clean it, add relevant columns, filter out trash data, use seaborn to produce some simple plots to see what my data approximately looks/structured like then off to sklearn.

Re:Apache Arrow and the “Things I Hate About Pandas” by atupis on Tuesday September 26, 2017 @03:18AM (#15336809)
Definitely this and I like how simple plotting is at pandas, usually df['some_column'].plot() gives decent plot out of box.