Re:ClickHouse: An open-source column-oriented database manag...
by qeternity on Friday May 28, 2021 @07:06AM
(#27313941)
You’re ingesting real time data into Clickhouse?
Re:ClickHouse: An open-source column-oriented database manag...
by joshstrange on Tuesday June 01, 2021 @10:03AM
(#27354645)
I know it's been a few days but what was the driver behind this question? My company uses CH and has near-real-time data being added (~5min delay from live), is this a problem and/or is there something about CH that doesn't play nice with this method? Or were you just interested in this particular case of inserting real time data?
Re:ClickHouse: An open-source column-oriented database manag...
by pibi on Friday May 28, 2021 @08:59AM
(#27314842)
Actually not, but we are ingesting a whole day of EOD market data (thousands of symbols, millions of timesales, billions of books events) in less than a couple of hours. This is 4x faster than the pace of the realtime market (not counting the extended hours due to the limited volume).
Re:ClickHouse: An open-source column-oriented database manag...
by tototom on Friday May 28, 2021 @06:29AM
(#27313711)
How much data? And which types of application/apis are connected to CH?
We were using kdb before, but clickhouse is more scalable, way cheaper and much more easy to grasp for a newbie.