News for hackers. Stuff that matters.
Re:Chronon, Airbnb's ML Feature Platform, Is Now Open Source by better365 on Thursday April 11, 2024 @01:45PM (#40004804)
We utilize a lambda architecture, which incorporates the concept of precomputed tables as well. Those precomputed tables store intermediate representation of the final results. These precomputed tables are capable of providing snapshot or daily accuracy features. However, when it comes to real-time features that require point-in-time correctness, using precomputed tables may present challenges.

For the offline computations, we will reuse those intermediate results to avoid calculation from the beginning again. So the engine can actually scale sub-linearly.

Re:Chronon, Airbnb's ML Feature Platform, Is Now Open Source by mulmen on Thursday April 11, 2024 @02:56PM (#40005550)
Thanks. How does Chronon serve the real-time features without precomputed tables?