Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by adrianbr on Tuesday November 05, 2024 @02:04PM
(#42054276)
The whole idea is pretty nuts! I can imagine it being used as the dev env for teams that use SQLMesh and can thus port the sql. Might be worth investigating with them
[ Parent
| on HN ]
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by ryanwaldorf on Tuesday November 05, 2024 @02:32PM
(#42054487)
That's really interesting! Could you tell me a bit more of what you're thinking? I'm not the most familiar with SQL Mesh and the typical workflows there.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by chrisjc on Tuesday November 05, 2024 @08:25PM
(#42056640)
Perhaps similar to https://github.com/duckdb/dbt-duckdb , but SQLMesh instead of DBT obviously.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by ryanwaldorf on Tuesday November 05, 2024 @08:45PM
(#42056710)
Ah gotcha! Do you have a use case where you'd look to remodel/transform the data between warehouses?
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by chrisjc on Tuesday November 05, 2024 @09:01PM
(#42056766)
Not the original parent, so unsure of their use-case. But I've seen the approach where some/basic development can be done on duckdb, before making its way to dev/qa/prd.
Something like your project might enable grabbing data (subsets of data) from a dev enviroment (seed) for offline, cheap (no SF warehouse cost) development/unit-testing, etc.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica...
by ryanwaldorf on Wednesday November 06, 2024 @07:46AM
(#42061417)
This makes sense, thank you!