News for hackers. Stuff that matters.
Re:Embedding user-defined indexes in Apache Parquet by alamb on Tuesday July 15, 2025 @06:52AM (#44569838)
We are actively working on supporting extension types. The mechanism is likely to be using the Arrow extension type mechanism (a logical annotation on top of existing Arrow types https://arrow.apache.org/docs/format/Columnar.html#format-me...)

I expect this to be used to support Variant https://github.com/apache/datafusion/issues/16116 and geometry types

(note I am an author)

There are no comments on this comment yet.