Apache Arrow and the “Things I Hate About Pandas”

Re:Apache Arrow and the “Things I Hate About Pandas” by wesm on Tuesday September 26, 2017 @12:40AM (#15336225)

Hi, Wes here. R data frames have limited to no query planning and are not multithreaded in general, so Problems 10 and 11 are problems in R also.

[ Parent | on HN ]

Re:Apache Arrow and the “Things I Hate About Pandas” by hn_throw_1234 on Tuesday September 26, 2017 @12:18PM (#15340045)

Native data.frames don't but data.table does to some extent. It's parallelization is still relatively new/nascent and requires OpenMP which doesn't have good support on MacOS but it is present.

[ Parent | on HN ]

Re:Apache Arrow and the “Things I Hate About Pandas” by gigatexal on Tuesday September 26, 2017 @01:36AM (#15336454)

And R’s syntax leaves much to be desired: it’s ugly compared to python’s.

[ Parent | on HN ]

Re:Apache Arrow and the “Things I Hate About Pandas” by huac on Tuesday September 26, 2017 @02:07AM (#15336552)

To each their own - I find the grammar of dplyr and the tidyverse is quite elegant.

[ Parent | on HN ]

Re:Apache Arrow and the “Things I Hate About Pandas” by shoyer on Tuesday September 26, 2017 @02:18AM (#15336610)

Agreed! Sadly it is difficult to fully emulate in Python without some form of delayed evaluation in the language.

[ Parent | on HN ]

Re:Apache Arrow and the “Things I Hate About Pandas” by digitalzombie on Tuesday September 26, 2017 @04:29PM (#15342239)

R is one of the few language that popularize data frame.

Out of SAS, R, and Python or even C++ and Java. Data frame are native.

So personally, the syntax especially for data frame is beautiful compares to python.

Python don't even have missing value built in or subsetting data frame.

[ Parent | on HN ]