News for hackers. Stuff that matters.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by adrianbr on Tuesday November 05, 2024 @02:04PM (#42054276)
The whole idea is pretty nuts! I can imagine it being used as the dev env for teams that use SQLMesh and can thus port the sql. Might be worth investigating with them
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by ryanwaldorf on Tuesday November 05, 2024 @02:32PM (#42054487)
That's really interesting! Could you tell me a bit more of what you're thinking? I'm not the most familiar with SQL Mesh and the typical workflows there.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by chrisjc on Tuesday November 05, 2024 @08:25PM (#42056640)
Perhaps similar to https://github.com/duckdb/dbt-duckdb , but SQLMesh instead of DBT obviously.
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by ryanwaldorf on Tuesday November 05, 2024 @08:45PM (#42056710)
Ah gotcha! Do you have a use case where you'd look to remodel/transform the data between warehouses?
Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by chrisjc on Tuesday November 05, 2024 @09:01PM (#42056766)
Not the original parent, so unsure of their use-case. But I've seen the approach where some/basic development can be done on duckdb, before making its way to dev/qa/prd.

Something like your project might enable grabbing data (subsets of data) from a dev enviroment (seed) for offline, cheap (no SF warehouse cost) development/unit-testing, etc.

Re:Show HN: Melchi – Open-Source Snowflake to DuckDB Replica... by ryanwaldorf on Wednesday November 06, 2024 @07:46AM (#42061417)
This makes sense, thank you!