News for hackers. Stuff that matters.
Re:PDEP-13: The Pandas Logical Type System by nerdponx on Tuesday May 07, 2024 @09:40PM (#40293514)
Snowflake and Pandas already have the ability to decode/encode "logical" type information stored in a Parquet file header, which is how you can do things like round-trip categorical-dtype data and data frame indexes between Pandas and Parquet. So I think things are already heading in that direction, but a coherent vision is absolutely necessary to keep it up and drive adoption.

There are no comments on this comment yet.