News for hackers. Stuff that matters.

A comment on Introducing dbt + Materialize.

Re:Introducing dbt + Materialize by efangs on Monday March 01, 2021 @05:50PM (#26309574)
Is it possible to backfill a materialized view? I'm maybe confused, but does this potentially replace a traditional data lake or is it specifically for streaming applications?
[ Parent | on HN ]
Re:Introducing dbt + Materialize by jldlaughlin on Monday March 01, 2021 @06:49PM (#26310128)
It is! We recently added support for S3 sources [0], which you could use to backfill data and union with a stream.

To your other question, we're currently well-suited for streaming applications. Moving forward, as we add support for features like persistence, we could certainly replace at least parts of a traditional data lake.

[0]: https://materialize.com/docs/sql/create-source/json-s3/

[ Parent | on HN ]