News for hackers. Stuff that matters.
Re:ClickHouse: An open-source column-oriented database manag... by qeternity on Friday May 28, 2021 @07:06AM (#27313941)
You’re ingesting real time data into Clickhouse?
Re:ClickHouse: An open-source column-oriented database manag... by joshstrange on Tuesday June 01, 2021 @10:03AM (#27354645)
I know it's been a few days but what was the driver behind this question? My company uses CH and has near-real-time data being added (~5min delay from live), is this a problem and/or is there something about CH that doesn't play nice with this method? Or were you just interested in this particular case of inserting real time data?
Re:ClickHouse: An open-source column-oriented database manag... by pibi on Friday May 28, 2021 @08:59AM (#27314842)
Actually not, but we are ingesting a whole day of EOD market data (thousands of symbols, millions of timesales, billions of books events) in less than a couple of hours. This is 4x faster than the pace of the realtime market (not counting the extended hours due to the limited volume).