News for hackers. Stuff that matters.
Re:Feldera Incremental Compute Engine by lsuresh on Sunday September 29, 2024 @03:44PM (#41689849)
We use monotonicity detection for various things. I believe (can double check) that it's used for max as well. But you're correct that in the general case, max is non-linear, so will need to maintain state.

Update from Leonid on current implementation: each group is ordered by the column on which we compute max, so it's O(1) to pick the last value from the index.

Re:Feldera Incremental Compute Engine by nikhilsimha on Monday September 30, 2024 @12:12PM (#41698828)
So the writes are O(N) then - to keeps reads at O(1)?
Re:Feldera Incremental Compute Engine by ryzhyk on Monday September 30, 2024 @12:20PM (#41698928)
Both reads and writes are O(1) in time complexity. Writes additionally have the log(N) amortized cost of maintaining the LSM tree.
Re:Feldera Incremental Compute Engine by nikhilsimha on Monday September 30, 2024 @12:50PM (#41699306)
gotcha! thanks for the clarification