Re:Build your own “data lake” for reporting purposes
by rockostrich on Sunday March 14, 2021 @10:41PM
(#26462044)
> BugQuery
Is this a typo or some kind of joke about BigQuery being buggy?
Anyway, agreed on this being needlessly complex and I stopped reading pretty much immediately when I saw the article continue to talk about postgres when it came to the "data lake". If you already have a postgres database backing every service and already have views defined for the data then just set up exports of those views to BigQuery/Snowflake/Redshift/etc. All of them have out of the box templates for doing exactly that.
Is this a typo or some kind of joke about BigQuery being buggy?
Anyway, agreed on this being needlessly complex and I stopped reading pretty much immediately when I saw the article continue to talk about postgres when it came to the "data lake". If you already have a postgres database backing every service and already have views defined for the data then just set up exports of those views to BigQuery/Snowflake/Redshift/etc. All of them have out of the box templates for doing exactly that.