News for hackers. Stuff that matters.
Re:ClickHouse: An open-source column-oriented database manag... by pibi on Friday May 28, 2021 @05:37AM (#27313354)
Great software. We are managing terabytes of stocks data and realtime market scanners queries across all market (billions of books and timesales) with hundreds of concurrent requests.

We were using kdb before, but clickhouse is more scalable, way cheaper and much more easy to grasp for a newbie.

Re:ClickHouse: An open-source column-oriented database manag... by qeternity on Friday May 28, 2021 @07:06AM (#27313941)
You’re ingesting real time data into Clickhouse?
Re:ClickHouse: An open-source column-oriented database manag... by joshstrange on Tuesday June 01, 2021 @10:03AM (#27354645)
I know it's been a few days but what was the driver behind this question? My company uses CH and has near-real-time data being added (~5min delay from live), is this a problem and/or is there something about CH that doesn't play nice with this method? Or were you just interested in this particular case of inserting real time data?
Re:ClickHouse: An open-source column-oriented database manag... by pibi on Friday May 28, 2021 @08:59AM (#27314842)
Actually not, but we are ingesting a whole day of EOD market data (thousands of symbols, millions of timesales, billions of books events) in less than a couple of hours. This is 4x faster than the pace of the realtime market (not counting the extended hours due to the limited volume).
Re:ClickHouse: An open-source column-oriented database manag... by tototom on Friday May 28, 2021 @06:29AM (#27313711)
How much data? And which types of application/apis are connected to CH?
Re:ClickHouse: An open-source column-oriented database manag... by pibi on Friday May 28, 2021 @09:18AM (#27314986)
Years of daily intraday market data. We have an ingestion engine written in c# and a nodejs backend to run the queries (with an in-house driver built on top of the HTTP APIs)
Re:ClickHouse: An open-source column-oriented database manag... by hawk_ on Friday May 28, 2021 @08:26AM (#27314538)
any info on costs?