News for hackers. Stuff that matters.
Re:Embedding user-defined indexes in Apache Parquet by dkdcio on Monday July 14, 2025 @08:02PM (#44566612)
Lance (from LanceDB folks), Nimble (from Meta folks, formerly known as Alpha); I think there are a few others

https://github.com/lancedb/lance

https://github.com/facebookincubator/nimble

Re:Embedding user-defined indexes in Apache Parquet by kernelsanderz on Tuesday July 15, 2025 @09:53AM (#44571196)
I’ve been excited about lancedb and its ability to support vector indexes and efficient row level lookups. I wonder if this approach would work for their design goals and still allow broader backwards compatibility with the parquet ecosystem. Have been intrigued by Ducklake, and they’ve leaned into parquet. Perhaps this approach will allow more flexible indexing approaches with support for the broader parquet ecosystem which is significant.