We built a new powerful JSON data type for ClickHouse

Re:We built a new powerful JSON data type for ClickHouse by wiredfool on Wednesday October 23, 2024 @07:43AM (#41923954)

Easiest way is to post csv/json/whatever through the http endpoint into a replacing merge tree table.

Duplicates get merged out, and errors can be handles at the http level. (Admittedly, one bad row in a big batch post is a pain, but I don’t see that much)

[ Parent | on HN ]

Re:We built a new powerful JSON data type for ClickHouse by Narhem on Wednesday October 23, 2024 @10:37AM (#41925475)

HTTP errors aren’t the most readable, although traditional database errors aren’t too readable most of the time.

[ Parent | on HN ]

Re:We built a new powerful JSON data type for ClickHouse by wiredfool on Wednesday October 23, 2024 @11:24AM (#41925994)

What I meant is that you'll get an HTTP error code from the insert if it didn't work, so that can go through the error handling. This isn't really an "explore this thing", it's a "splat this data in, every minute/file/whatever". I've churned through TBs of CSVs this way, with a small preprocessor to fix some idiosyncratic formatting.

[ Parent | on HN ]