Re:The Evolution of the Data Engineer Role
by dijksterhuis on Sunday October 30, 2022 @01:05PM
(#33396256)
Just seen this response. Thanks for the comment.
I was on the fence about including mentions of querying mechanisms like AWS Athena and the like, but you’re right it’s all part of the same horse (or house).
Was 5am by the time I finished writing this though… so I kind of had to stop (hence the very short data mesh section!).
The goal for a Lakehouse is to create a platform/stack that can effectively do everything a DW does, everything a Data Lake does (so, all your pros above), get rid of most of the cons and also allow mixing and matching of the functionalities. Acknowledging this need to handle all kinds of data is not new; having the technology to deliver on it is, and that’s what the Lakehouse is.