News for hackers. Stuff that matters.
Re:Parquet: More than just “Turbo CSV” by spacetime_cmplx on Monday April 03, 2023 @10:43PM (#35434320)
Storing (UTC, latitude, longitude, altitude) is the holy grail, I guess. Everything else is too leaky.

I mean, that's literally the four dimensions of space-time.

Re:Parquet: More than just “Turbo CSV” by spenczar5 on Monday April 03, 2023 @10:50PM (#35434376)
UTC is discontinuous because of leap seconds, so TAI + lat + long + altitude is actually required.

I work on software for astronomy, and that quadruplet is what’s used to describe an observing location. You can actually get a little in trouble because of changes in the shape of the earth over time, so latitude and longitude and altitude need to be treated as time-dependent values, which matters once you are accounting for relativistic effects.

Re:Parquet: More than just “Turbo CSV” by agalunar on Tuesday April 04, 2023 @02:21AM (#35435798)
UTC times are unique: when a positive leap second is inserted, 23:59:60 is added; when a negative leap second is inserted, 23:59:59 is skipped.

Unix timestamps, on the other hand, are not unique.

Re:Parquet: More than just “Turbo CSV” by roywiggins on Monday April 03, 2023 @10:54PM (#35434395)
That sort of assumes there's one time zone that's being used per spacetime coordinate, which isn't guaranteed. You can get political situations where de facto and de jure time diverge, or where different authorities nominally in charge of the time in a place disagree.

Lebanon seems to have experienced exactly this recently:

https://www.bbc.com/news/world-middle-east-65079574

It does unambiguously give you a spacetime coordinate (useful) but it doesn't unambiguously tell you what local time you should use for an occurrence, and the answer would really depend on who was asking.

Re:Parquet: More than just “Turbo CSV” by masklinn on Tuesday April 04, 2023 @01:30AM (#35435472)
> Storing (UTC, latitude, longitude, altitude) is the holy grail, I guess.

It’s not.

If I set up a meeting next year in NYC at 10 and the legislature decides to change the timezone’s offset, the meeting remains at 10 NY time on that date, it does not shift in NY time. It’s the UTC which shifts.

And UTC alone is sufficient for past events, as they are fixed instants in the time-stream. Unless you’re at a stage where you need to take relativistic effects in account, then you need to add the referential.