Re:Show HN: ClickHouse-local – a small tool for serverless d...
by qoega on Friday January 06, 2023 @04:15AM
(#34272647)
Sure you can read from S3.
You can define table that will look at your files like this https://clickhouse.com/docs/en/integrations/s3/s3-table-engi...
Or just use s3 table functions https://clickhouse.com/docs/en/integrations/s3/s3-table-func...
You can use it as a command line tool running one query at a time or in interactive mode.
Re:Show HN: ClickHouse-local – a small tool for serverless d...
by denvrede on Friday January 06, 2023 @06:19AM
(#34273499)
Do you know if it's possible to tell clickhouse-local (without the need of a config file) to use environment variables for AWS authentication? I know there is the "use_environment_credentials" property in the config, but I really don't want to create a config for easy use-cases like just querying some data in a private S3 bucket.
We recently had some issues querying parquet files on AWS S3. I tried benchmarking various tools and DuckDB seemed the most promising. Didn't find good documentation for clickhouse local with AWS.