Re:Machine Learning Engineer Guide: Feature Store vs. Data W...
by jamesblonde on Thursday October 08, 2020 @12:38PM
(#24720837)
You can do real-time feature engineering in your application as well. But we recommend to do it in a feature pipeline that also syncs the features to the feature store. We have a talk about it coming out at the spark/ai summit:
https://databricks.com/session_eu20/real-time-feature-engine...
Re:Machine Learning Engineer Guide: Feature Store vs. Data W...
by skingkong on Thursday October 08, 2020 @11:50AM
(#24720277)
Yeah in this type of architecture there is some sort of join required. Interestingly, @maycotte talking about the Molecula feature store – it serves real-time and historical features in the same storage layer. Significant performance gains with that approach.
Re:Machine Learning Engineer Guide: Feature Store vs. Data W...
by jamesblonde on Thursday October 08, 2020 @12:39PM
(#24720847)
If you want to reuse features, and not write a new pipeline for every model, you need JOINs. Both for the online and offline feature stores.
My question is about the operational aspect of online vs offline stores.
I.e. what happen if the features needed for a prediction are not in the ONLINE store?