News for hackers. Stuff that matters.

alexmerced

We’ll start beginner-friendly, clarifying what a table format is and why it’s essential, then progressively dive into expert-level topics: metadata internals (snapshots, logs, manifests, LSM levels), row-level change strategies (COW, MOR, delete vectors), performance trade-offs, ecosystem support (Spark, Flink, Trino/Presto, DuckDB, warehouses), and adoption trends you should factor into your roadmap.
Re:And 2026 Ultimate Guide to the Data Lakehouse on Thursday September 25, 2025 @08:00AM (#45371814)
2025 also cemented a practical reference architecture. A successful lakehouse now looks less like a monolith and more like a layered system: cloud object storage for durability and cost, an open table format for transactions and evolution, ingestion that blends batch and streaming, a catalog for governance and discoverability, and a flexible consumption layer that serves SQL, BI, notebooks, and AI agents with consistent semantics.
Together, Apache Iceberg and Dremio not only offer a robust foundation for data management but also embody the future of data analytics, where accessibility, efficiency, and collaboration are key.
From the integration-friendly Hive catalog to the innovative Nessie catalog that brings git-like versioning to data, each catalog serves a unique purpose and caters to different architectural needs and preferences.
I'll be presenting this content at this meetup if you want to learn more: https://www.meetup.com/subsurface-global/events/286442080/
I'll be presenting this content at this meetup if you want to learn more: https://www.meetup.com/subsurface-global/events/286442080/
Project Nessie also powers Dremio's Arctic service, so you can get all the branching and benefits of Nessie with an intuitive UI to browse branches, create branches and merge branches. Also, it is a cloud managed service with a free tier.
Yep, in this talk I go over an example from Netflix where Apache Iceberg originated: https://www.youtube.com/watch?v=LiC9vZATv0o&t=8s