Re:NewSQL databases fail to guarantee consistency and I blam...
by evanweaver on Friday September 21, 2018 @10:04AM
(#18039763)
Do these concerns also apply in an HTAP or OLAP context e.g. systems like Cloudera's Kudu, which uses Hybrid Time? Or maybe Volt which you also worked on?
[ Parent
| on HN ]
Re:NewSQL databases fail to guarantee consistency and I blam...
by nickerten on Friday September 21, 2018 @08:09PM
(#18043648)
I've worked on a system that loaded data into Kudu in near real time and simultaneously ran queries on the data. Kudu has no transactions, consistency is eventual which was sufficient due to our near-real time constraint, however you do need a stable NTP source. We have lost data when the cluster could not get a reliable NTP connection, decided to shut down and tablet servers' data files became corrupted.
Re:NewSQL databases fail to guarantee consistency and I blam...
by kwillets on Friday September 21, 2018 @04:06PM
(#18042286)
Vertica seems to include some of these observations, such as global consistency and group commit. I believe these are easier to achieve (lower overhead) in OLAP due to fewer, larger transactions.