Re:Parquet: More than just “Turbo CSV”
by glogla on Tuesday April 04, 2023 @02:30AM
(#35435857)
Parquet doesn't really do timestamp with time zone. Also relevantly for processing Parquet, Apache Spark doesn't really do timestamp with time zone. Meaning that if your data go through parquet (e.g. in a data lake) you have to store timestamps as strings, or lose the time zone.
It sucks.