Re:Apache Hudi vs. Delta Lake vs. Apache Iceberg Lakehouse F...
by glogla on Thursday January 12, 2023 @08:53AM
(#34353462)
> We have recently added support for Hudi and Delta Lake; you can check here: https://clickhouse.com/docs/en/engines/table-engines/integra...
Just tried it out. It seems to only support partitioned Delta tables, non-partitioned return CANNOT_EXTRACT_TABLE_STRUCTURE. Is that on purpose or is it a bug?
We have recently added support for Hudi and Delta Lake; you can check here: https://clickhouse.com/docs/en/engines/table-engines/integra...
It is a read-only implementation: ClickHouse can read and process the external data in the Hudi or Delta Lake format.
Apache Iceberg is pending. There is no good C++ library for it. But at least the overall structure is simple, as it is not hard to implement it.
The overall principle - whatever data format it is, ClickHouse should support it in a fast, stable, and ALWAYS CORRECT manner.
If you have more experience to share, please do it.