News for hackers. Stuff that matters.
Re:Apache Iceberg by volderette on Sunday January 26, 2025 @01:37AM (#42828196)
How do you query your iceberg tables? We are looking into moving away from Bigquery and Starrocks [1] looks like a good option.

[1] https://www.starrocks.io/

Re:Apache Iceberg by macqm on Sunday January 26, 2025 @02:16AM (#42828362)
Trino is pretty good (open source presto).

https://trino.io/

Re:Apache Iceberg by jl6 on Sunday January 26, 2025 @03:24AM (#42828681)
Why away from bigquery? Just wondering if it’s a cost thing.
Re:Apache Iceberg by volderette on Sunday January 26, 2025 @01:14PM (#42832305)
Yes, mainly driven by cost. BigQuery is really unpredictable when dashboards with filters are being used intensively by users. We don’t want to limit our users in their data exploration.
Re:Apache Iceberg by mritchie712 on Sunday January 26, 2025 @06:29AM (#42829436)
right now, starrocks or trino are likely your best options, but all the major query engines (clickhouse, snowflake, databricks, even duckdb) are improving their support too.
Re:Apache Iceberg by czwief on Sunday January 26, 2025 @07:14PM (#42835793)
Starburst (full disclosure: I work there) provides a query engine (trino under the hood) with Iceberg support [1] -- worth checking out.

[1] https://www.starburst.io/platform/icehouse/

Re:Apache Iceberg by adesh_nalpet on Monday January 27, 2025 @04:29PM (#42845835)
Common opensource options (other than Spark and Flink): 1. Dremio: https://www.dremio.com/ 2. Trino: https://trino.io/ 3. Iceberg Java API: https://iceberg.apache.org/docs/1.6.1/api/