News for hackers. Stuff that matters.
Re:Loading Data into Pandas: Tips and Tricks You May or May ... by Helmut10001 on Thursday August 04, 2022 @10:47PM (#32350968)
Not to taunt about the article, but the most important pandas parameters to me are `iterator=True` and `chunksize=x`, for streamed processing. Here's an example for processing a CSV file with 400 Million latitude and longitude coordinates.[1]

[1]: https://ad.vgiscience.org/twitter-global-preview/00_Twitter_...

Re:Loading Data into Pandas: Tips and Tricks You May or May ... by jwilber on Thursday August 04, 2022 @10:58PM (#32351026)
This is a great mention, ty!