Re:Machine Learning Engineer Guide: Feature Store vs. Data W...
by curiousllama on Thursday October 08, 2020 @11:34AM
(#24720088)
Yea, data lakes are a tech solution to an org problem. Good or bad, it’s what it is.
Re:Machine Learning Engineer Guide: Feature Store vs. Data W...
by disgruntledphd2 on Thursday October 08, 2020 @01:57PM
(#24721813)
Done right, they are awesome though. As a DS you can iterate a lot faster if you don't have to access multiple different stores for features or data.
It's not so much about data itself as an attempt to solve a communications and coordination organizational problem; you decouple sources of data and consumers of data (not the technical systems/databases, but the people and organizational units) to a 'hub-and-spoke' model where the providers of data just supply raw data without getting into a multinational project that takes a year just to identify the potential stakeholders for that data throughout a distributed organization with tens of thousands of employees.