News for hackers. Stuff that matters.
Re:Show HN: ClickHouse-local – a small tool for serverless d... by whinvik on Friday January 06, 2023 @03:24AM (#34272325)
Can Clickhouse local query from files on AWS S3?

We recently had some issues querying parquet files on AWS S3. I tried benchmarking various tools and DuckDB seemed the most promising. Didn't find good documentation for clickhouse local with AWS.

Re:Show HN: ClickHouse-local – a small tool for serverless d... by qoega on Friday January 06, 2023 @04:15AM (#34272647)
Sure you can read from S3.

You can define table that will look at your files like this https://clickhouse.com/docs/en/integrations/s3/s3-table-engi...

Or just use s3 table functions https://clickhouse.com/docs/en/integrations/s3/s3-table-func...

You can use it as a command line tool running one query at a time or in interactive mode.

Re:Show HN: ClickHouse-local – a small tool for serverless d... by denvrede on Friday January 06, 2023 @06:19AM (#34273499)
Do you know if it's possible to tell clickhouse-local (without the need of a config file) to use environment variables for AWS authentication? I know there is the "use_environment_credentials" property in the config, but I really don't want to create a config for easy use-cases like just querying some data in a private S3 bucket.