News for hackers. Stuff that matters.

A comment on Apache Iceberg. Parent comment

Re:Apache Iceberg by mritchie712 on Sunday January 26, 2025 @06:27AM (#42829429)
Why don't you want a catalog? The SQL or REST catalogs are pretty light to set up. I have my eye on lakekeeper[0], but Polaris (from Snowflake) is a good option too.

PyIceberg is likely the easiest way to write without Spark.

0 - https://github.com/lakekeeper/lakekeeper

[ Parent | on HN ]
Re:Apache Iceberg by anktor on Sunday January 26, 2025 @10:20AM (#42830607)
PyIceberg is nice but we had to drop it because it's behind Java API and it's unclear when it will match up, so depending on which features are needed I'd look it up
[ Parent | on HN ]
Re:Apache Iceberg by mritchie712 on Sunday January 26, 2025 @12:13PM (#42831661)
what are you using instead?
[ Parent | on HN ]
Re:Apache Iceberg by datancoffee on Monday January 27, 2025 @03:51AM (#42838848)
We did an evaluation of various REST catalog options and went with Open Catalog from Snowflake (a Polaris-based managed service that works independently from their data warehousing solution). Lakekeeper is nice - it's one of the few catalogs with FGAC and table maintenance.

https://tower.dev/blog/picking-snowflake-open-catalog-as-a-m...

[ Parent | on HN ]