Re:What Is the Data Lakehouse Pattern?
by Traster on Tuesday September 14, 2021 @07:14PM
(#28532795)
Maybe I'm missing something, but what I need (and what the data team at my company spectacularly fails to deliver) is fast access to post-ETL data as well as pre-ETL data. I need the raw data sometimes, I need the processed data sometimes. What I get instead is no access to the raw data, and broken/slow/uninsured access to the processed data. I don't know about other people but in general I think a decent data warehouse would make me happy and the aspiration to be a datalake is what causes the data team to make me unhappy - they fail to provide the basics because they've heard too many buzzwords.
[ Parent
| on HN ]
Re:What Is the Data Lakehouse Pattern?
by tzsdata on Wednesday September 15, 2021 @07:32AM
(#28537762)
We use a data vault architecture as the raw/semi-structured source for a 'traditional' data warehouse built on Snowflake. Data vault gives more advanced users access to the raw data and Snowflake gives us all the scalability we need in terms of data volume. Will of course depend on the data model in your data warehouse but works well for us.