News for hackers. Stuff that matters.
Re:Apache Iceberg by mritchie712 on Sunday January 26, 2025 @06:23AM (#42829408)
If you're looking to give Iceberg a spin, here's how to get it running locally, on AWS[0] and on GCP[1]. The posts use DuckDB as the query engine, but you could swap in Trino (or even chdb / clickhouse).

0 - https://www.definite.app/blog/cloud-iceberg-duckdb-aws

1 - https://www.definite.app/blog/cloud-iceberg-duckdb

Re:Apache Iceberg by romperstomper on Sunday January 26, 2025 @02:39PM (#42833256)
you can just use iceberg tables with AWS Glue/Athena
Re:Apache Iceberg by hipadev23 on Sunday January 26, 2025 @07:06PM (#42835728)
aws glue/athena has the most absurd setup process. duckdb and clickhouse is “select * from s3(…)”
Re:Apache Iceberg by romperstomper on Monday January 27, 2025 @03:14PM (#42845119)
I'm not sure what do you mean by "absurd setup". In case of Athena you just use the iceberg type for a table as you create it and that's it. Under the hood AWS also uses Trino or Presto as far as I know.
Re:Apache Iceberg by adesh_nalpet on Monday January 27, 2025 @04:23PM (#42845780)
You can just used Iceberg Java API: https://iceberg.apache.org/docs/1.6.1/api/#file-level

Use it with Dropwizard/Springboot, you get to expose rest APIs too.