News for hackers. Stuff that matters.
Re:Pg_lake: Postgres with Iceberg and data lake access by qaq on Tuesday November 04, 2025 @02:02PM (#45814673)
Have you interacted with Snowflake teams much? We are using external iceberg tables with snowflake. Every interaction pretty much boils down to you really should not be using iceberg you should be using snowflake for storage. It's also pretty obvious some things are strategically not implemented to push you very strongly in that direction.
Re:Pg_lake: Postgres with Iceberg and data lake access by ozkatz on Tuesday November 04, 2025 @02:32PM (#45814997)
Out of curiosity - can you share a few examples of functionality currently not supported with Iceberg but that works well with their internal format?
Re:Pg_lake: Postgres with Iceberg and data lake access by qaq on Tuesday November 04, 2025 @02:46PM (#45815141)
even partition elimination is pretty primitive. For Query optimizer Iceberg is really not a primary target. The overall interaction with even technical people gives strong this is a sales org that happens to own an OLAP db product vibe.
[dead]
Re:Pg_lake: Postgres with Iceberg and data lake access by qaq on Thursday November 06, 2025 @11:05PM (#45843472)
sure select distinct customer_id ... customer_id is first part of partition key you really don't need to do a tablescan to resolve that do you ?
Re:Pg_lake: Postgres with Iceberg and data lake access by barrrrald on Tuesday November 04, 2025 @04:35PM (#45816155)
Not surprised - this stuff isn’t fully mature yet. But I interact with their team a lot and know they have a commitment to it (I’m the other guy in that video)