News for hackers. Stuff that matters.
Re:Ask HN: Simple No-Code EL Tool for Postgres > BigQuery by yashap on Friday January 06, 2023 @08:06PM (#34283835)
We're using BigQuery as our data warehouse, with a dashboarding UI (Metabase) connected to it. Not looking to do local analysis (clickhouse-local), this is about dumping data into a central data warehouse. The data warehouse could indeed be ClickHouse, but we're using BigQuery.

Either way, the need would be similar - a simple, cheap tool, with a web UI, that lets analysts easily setup nightly jobs to dump data out of Postgres, into the data warehouse.

Re:Ask HN: Simple No-Code EL Tool for Postgres > BigQuery by qoega on Saturday January 07, 2023 @05:53AM (#34286981)
There is no need to use clickhouse-local for 'local' analysis. It just the same ClickHouse, but it will not store any local data. Just use it as ETL tool. Something like this will work: INSERT INTO FUNCTION s3('https://storage.googleapis.com/BUCKET/test_data/file.csv', 'XXXXX','XXXXX',CSV) SELECT col1, col2 FROM postgresql(postgres1, schema='schema1', table='table1') WHERE col1 > col2;