News for hackers. Stuff that matters.

A comment on Apache Hudi 1.0 released with secondary indexes for data lakehouses.

Re:Apache Hudi 1.0 released with secondary indexes for data ... by redhouse on Tuesday December 17, 2024 @11:35AM (#42442756)
Really curious of the performance gain we can get from the secondary index, and the cost of it.
[ Parent | on HN ]
Re:Apache Hudi 1.0 released with secondary indexes for data ... by v5c6 on Tuesday December 17, 2024 @12:31PM (#42443287)
It’s comparable to and depends on selectivity of the query, like any database index. On a 10TB tpc-ds web_sales with 1:150 selectivity, we see an impressive 95% gain.

If the query fetches out most records for e.g, then gains will be lower

[ Parent | on HN ]