News for hackers. Stuff that matters.

A comment on Chronon, Airbnb's ML Feature Platform, Is Now Open Source.

Re:Chronon, Airbnb's ML Feature Platform, Is Now Open Source by evolutionblues on Tuesday April 09, 2024 @04:21PM (#39983814)
great work! When it comes to batched computations, why not leverage intermediate state much like streaming jobs. For example, if we need to calculate past 30 day sum for a value daily - it seems like this would compute so from scratch daily. Would it not make sense to model this as a sliding window that's updated daily?
[ Parent | on HN ]
Re:Chronon, Airbnb's ML Feature Platform, Is Now Open Source by nikhilsimha on Tuesday April 09, 2024 @04:30PM (#39983909)
We do this for training data generation already.

We have plans to implement this behavior for computing the batch arm of feature serving.

[ Parent | on HN ]
Re:Chronon, Airbnb's ML Feature Platform, Is Now Open Source by evolutionblues on Wednesday April 10, 2024 @01:04PM (#39993052)
can you point to documentation/ examples which talk about it - I could not find this while exploring the pages (or maybe I missed it altogether).
[ Parent | on HN ]