News for hackers. Stuff that matters.
Re:Polars by YetAnotherNick on Monday January 08, 2024 @10:44PM (#38922044)
Where is it written in pandas documentation? Pandas dataframe is stored in list of 1d numpy arrays, not a single 2d array.
Re:Polars by ayhanfuat on Tuesday January 09, 2024 @05:21AM (#38924419)
The columns with common dtypes are grouped together in something called "blocks" and inside those blocks are 2D numpy arrays. It is probably not in the documentation because it is seen as implementation detail but you can see the block manager's structure in this article (https://dkharazi.github.io/blog/blockmanager/) or in this talk (https://thomasjpfan.github.io/scipy-2020-lightning-talk-pand...).