News for hackers. Stuff that matters.

A comment on Understanding Parquet, Iceberg and Data Lakehouses. Parent comment

Re:Understanding Parquet, Iceberg and Data Lakehouses by jamesblonde on Saturday December 30, 2023 @12:54AM (#38813084)
I guess you are referring to delta-rs (for Python in particular). An interesting factoid here is that Databricks started delta-rs, and other companies are now driving it forward - not Databricks. I guess it is not in Databricks interest to push the non JVM ecosystem. PyIceberg is catching up. Write support is almost there - https://github.com/apache/iceberg-python/pull/41
[ Parent | on HN ]
Re:Understanding Parquet, Iceberg and Data Lakehouses by alexott on Saturday December 30, 2023 @01:45AM (#38813270)
As I remember, delta-rs was started by Scribd, not by Databricks: https://youtu.be/2jgfpJD5D6U, https://youtu.be/scYz12UK-OY
[ Parent | on HN ]
Re:Understanding Parquet, Iceberg and Data Lakehouses by jamesblonde on Saturday December 30, 2023 @02:38AM (#38813460)
I stand corrected, then.
[ Parent | on HN ]