News for hackers. Stuff that matters.
Re:Apache Iceberg now supports geospatial data types natively by ZeroCool2u on Saturday February 15, 2025 @09:44AM (#43058863)
This is such a big deal. Trying to get stuff done with geospatial data in native formats in big companies has been somewhat painful for a while, because a lot of them tend to default to using DataBricks and Delta format.

At least now there's a great open source tech stack combo with Trino as your query engine (which is decidedly a lot less annoying to run at scale than OSS Spark) and Iceberg as your storage format that a lot of your "Enterprise Architecture" types can be comfortable enough with.

Re:Apache Iceberg now supports geospatial data types natively by tiems on Saturday February 15, 2025 @10:10AM (#43059023)
Since it’s getting added to the parquet spec itself, it should hopefully make its way to delta too soon.
Re:Apache Iceberg now supports geospatial data types natively by Mosarwat on Saturday February 15, 2025 @08:08PM (#43064290)
Please note that not all query engines supports the native geo type in Iceberg yet. The first one to support it is Apache Sedona, which works well with Spark:

https://github.com/apache/sedona

However, the ultimate goal is to make more engines (e.g., Arrow, Trino...) support the geo type too