Re:Databricks open-sources Delta Lake to make data lakes mor...
by xwkk on Wednesday April 24, 2019 @05:29PM
(#19742765)
I have heard these promises of a single query language for different data formats many times and the results (foisted upon developers and customers) have always far more painful than just sticking to SQL.
Re:Databricks open-sources Delta Lake to make data lakes mor...
by alexchamberlain on Thursday April 25, 2019 @01:31PM
(#19750475)
To be fair, most data stores have an SQL layer available, even if it's not optimal
Re:Databricks open-sources Delta Lake to make data lakes mor...
by wldata on Wednesday April 24, 2019 @11:48PM
(#19744812)
Plug: We help discover, catalog and search for metadata and lineage in your data lake. We support all major hadoop distros and cloud platforms. Check us out! https://www.waterlinedata.com
A data lake is like you said a collection of data stores, and the industry as a whole hasn't defined it very well past that.
IMHO - A (useful) data lake is a platform that can support any type of data store in any format (be it relational, flat, graph, document, etc) and offer a way to consistently query it. A (useful) data lake does much in the way of managing metadata about those data stores that makes it easy to consume.