Re:Preview: Amazon S3 Tables and Lakehouse in DuckDB
by pletnes on Tuesday March 18, 2025 @03:13PM
(#43403646)
I have the same thoughts. However my impression is also that most orgs would choose eg databricks or something for the permission handling, web ui, ++ so what is the equivalent «full rig» with duckdb and S3 / blob storage?
[ Parent
| on HN ]
Re:Preview: Amazon S3 Tables and Lakehouse in DuckDB
by RobinL on Tuesday March 18, 2025 @03:39PM
(#43404007)
Yeah I think that's fair, especially from the 'end consumer of the data' point of view, and doing things like row-level permissions.
For the ETL side, where often whole-table access is good enough, I find Spark in particular very cumbersome - there's more than can go wrong vs. DuckDB and it's harder to troubleshoot.