News for hackers. Stuff that matters.

A comment on Pyston v2: Faster Python. Parent comment

Re:Pyston v2: Faster Python by ihnorton on Wednesday October 28, 2020 @08:45PM (#24925870)
10x reflects both experience and expert recommendations. You may recognize the author [1]:

> Nowadays, my rule of thumb for pandas is that you should have 5 to 10 times as much RAM as the size of your dataset

[1] https://wesmckinney.com/blog/apache-arrow-pandas-internals/

[ Parent | on HN ]
Re:Pyston v2: Faster Python by willseth on Thursday October 29, 2020 @12:52PM (#24932514)
I don't doubt Wes' upper bound for Pandas OOTB, without optimization. The context was web applications. If you're seeing 10x on a web app, either something is wrong or you probably shouldn't be using Pandas.
[ Parent | on HN ]
Re:Pyston v2: Faster Python by mlyle on Thursday October 29, 2020 @07:40PM (#24937417)
I think most of us use Pandas for data exploration and one-offs, so it is completely reasonable to discuss what our likely use of RAM is going to be in this circumstance.

Web application using Pandas and "highly optimized web application" would seem to be nearly disjoint sets...

[ Parent | on HN ]