News for hackers. Stuff that matters.
Re:Farewell Pandas, and thanks for all the fish by halfcat on Thursday August 29, 2024 @08:40PM (#41396760)
> YAGNI - For lots of small data tasks, pandas is perfectly fine.

There’s a real possibility the growth of single node RAM capacity will perpetually outpace the growth of a business’s data. AWS has machines with 32 TB RAM now.

It’s a real question as to whether big data systems become more accessible before single node machines become massive enough to consume almost every data set.

(Also love your work, thank you)

Re:Farewell Pandas, and thanks for all the fish by __mharrison__ on Thursday August 29, 2024 @10:44PM (#41397331)
But... but we have to have big data and a cluster...

The hoops folks will jump through...

(Thanks!)