News for hackers. Stuff that matters.
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by jandrewrogers on Thursday October 02, 2014 @01:11AM (#8399501)
It is generally not that difficult to greatly out-perform Oracle on specific benchmarks. Postgres can do it too. Companies do not buy Oracle for the performance per se but as time has gone on Oracle has definitely been losing ground in that arena.

MemSQL makes a good product but nothing about their architecture is particularly novel, and other systems have a similar design. I've designed several database engines; I would expect numbers like they demonstrated on a decent columnar implementation with the tradeoffs MemSQL has made. And Oracle has never been optimized for these types of queries because those tradeoffs adversely impact performance in other areas Oracle cares about. Features like compiling queries are mundane; many commercial databases did that a decade ago and it is a standard design element today. Same with the two-tier in-memory and columnar disk storage.

I'm sure MemSQL is fast, but "world's fastest" should be assumed to be hyperbole. Most of their benchmarks are table stakes for a modern, real-time analytical database kernel. It is apparently a well-designed product but nothing many other companies are not doing.

Here is what I tell people a properly designed database kernel on modern mid-range hardware should be able to do per server: continuously insert millions of records per second all the way through storage, leaving virtually all of the cores idle for some large number of concurrent queries. If you can't saturate 10 GbE on ingest concurrent with saturating 10 GbE on query output, your design is most likely obsolete or broken.

Things have moved a very long way since I first started designing massive scale database systems (on Oracle, way back in the day).

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by jma24 on Thursday October 02, 2014 @11:54PM (#8404247)
Oracle designed their Database In-Memory Option specifically for these sorts of scenarios. But it's a fairly crudely designed column store cache and MemSQL are right to bash them.

But the strength of Oracle remains OLTP and I don't see customers fleeing to MemSQL for this.

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by jl6 on Thursday October 02, 2014 @02:54AM (#8399671)
What in your opinion counts as modern mid-range hardware?
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by jandrewrogers on Thursday October 02, 2014 @03:38AM (#8399737)
The physical servers used in clusters I buy today run about $4k per server without storage. Outside of the dual 10 GbE interfaces, they are like most other budget servers. Storage costs per node vary depending on the size, type, and mix of disks. Driving the disk I/O at 10 GbE can be trivial with a good I/O scheduler design, so ironically the details of the storage device are almost irrelevant for many workloads. Cheap SSDs are the default target but cheap spinning disk works surprisingly well for many workloads.

Various AWS nodes are also used in clusters quite a bit (though we use ephemeral disks rather than EBS). Nothing exotic.

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by carterschonwald on Thursday October 02, 2014 @01:47AM (#8399561)
any good reading for the engineering/algorithms one can use to hit those throughput targets?
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by nikita on Thursday October 02, 2014 @02:30AM (#8399642)
- C-store paper - Provably correct lockfree skiplist - Mass tree - BW Tree