News for hackers. Stuff that matters.

A comment on Show HN: BemiDB – Postgres read replica optimized for analytics.

Re:Show HN: BemiDB – Postgres read replica optimized for ana... by jakozaur on Thursday November 07, 2024 @04:55PM (#42081527)
Cool. Every database or data source (e.g. CRM) should produce Iceberg format for you.

Though a little sceptical of embedding DuckDB. It is easy and better to isolate Read/Write paths, and it has a lot of other benefits.

[ Parent | on HN ]
Re:Show HN: BemiDB – Postgres read replica optimized for ana... by exAspArk on Thursday November 07, 2024 @05:02PM (#42081596)
Iceberg for the win!

We actually separate Read/Write paths. BemiDB reads by levering DuckDB as a query engine. And it writes to Iceberg completely separately from DuckDB. I'm curious if that's what you imagined.

[ Parent | on HN ]
Re:Show HN: BemiDB – Postgres read replica optimized for ana... by jakozaur on Thursday November 07, 2024 @05:58PM (#42082053)
Ideally, I would love many places writing to the Iceberg catalogue and then using it as a data lake.

In the data lake, I would have a gateway provisioning DuckDB on demand for each user.

[ Parent | on HN ]
Re:Show HN: BemiDB – Postgres read replica optimized for ana... by exAspArk on Thursday November 07, 2024 @06:01PM (#42082088)
Oh, interesting, thanks for sharing it!
[ Parent | on HN ]