Re:VoltDB is out, benchmarks against Cassandra
by jbellis on Wednesday May 26, 2010 @04:20PM
(#1381537)
Most use cases also don't have the entire data set equally active, and it's silly to pay to keep everything in RAM instead of just the hot parts.
Re:VoltDB is out, benchmarks against Cassandra
by hdiedrich on Wednesday May 26, 2010 @09:19PM
(#1382377)
That's part of the proposal: real world data requirements will soon completely fit into RAM available on a rather standard system.
Re:VoltDB is out, benchmarks against Cassandra
by cx01 on Wednesday May 26, 2010 @04:29PM
(#1381569)
In-memory doesn't imply "unreliable". If you need high-availability you'll want to use replication anyway.
Re:VoltDB is out, benchmarks against Cassandra
by jbellis on Wednesday May 26, 2010 @06:25PM
(#1381940)
In-memory with periodic snapshots sure implies "not durable," though. (That is, you will lose whatever data has not yet been snapshotted on a power failure or crash.) Replication doesn't fix that, unless you're willing to impose the latency of replication to different datacenters for each update. (I don't think Volt even supports this. Most systems don't.)
Re:VoltDB is out, benchmarks against Cassandra
by cx01 on Wednesday May 26, 2010 @07:04PM
(#1382055)
Why? If a single node fails, you still have the data on 2 other nodes. Nothing is lost. Of course, assuming you have a reliable UPS.
Re:VoltDB is out, benchmarks against Cassandra
by shpxnvz on Wednesday May 26, 2010 @10:29PM
(#1382490)
Because the data may not have replicated to the other nodes yet. As the parent comment noted, you could synchronously write to all replica nodes, but thats a big performance penalty and not partition tolerant.
Re:VoltDB is out, benchmarks against Cassandra
by hdiedrich on Thursday May 27, 2010 @05:35AM
(#1383137)
They pay the penalty in latency, not in throughput. That's like no performance penalty at all if you work asynchronously. They make sure that the data cannot become inconsistent between nodes by ordering the transactions. The penalty that comes from this is that latency can become high, i.e. the answer time for individual transactions. While maintaining a maximized throughput of millions of transactions a second. It's like an internal 'pumping rhythm' with tightly synched timestamps.
Re:VoltDB is out, benchmarks against Cassandra
by aweisberg on Thursday May 27, 2010 @08:51AM
(#1383408)
VoltDB replicates synchronously.
Re:VoltDB is out, benchmarks against Cassandra
by jhugg on Wednesday May 26, 2010 @07:43PM
(#1382166)
So if your entire data center loses power...
If you have any notice (local UPS, etc), you snapshot to disk.
If you have no notice, you lose some number of transactions depending on your data size, snapshot frequency and disk speed. Seconds or minutes, but probably not hours.
Future versions of VoltDB will do more address this single-data-center catastrophe scenario.
Re:VoltDB is out, benchmarks against Cassandra
by aquark on Wednesday May 26, 2010 @06:59PM
(#1382037)
Can anyone suggest problem domains where it is useful to have the ability to do 100K writes per second, but not have durable transactions?
I can see the in memory story for read only queries, or transient data.
most people, most systems, aren't so hot about in memory datastores -- MySQL had MySQL-Cluster/NDB, and for lots of reasons it had trouble ever taking off.
For certain use cases, and definitely for benchmarking purposes, in memory datastores will always crush the competitors, but in the end, most people like reliable data storage.