News for hackers. Stuff that matters.
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by tkyjonathan on Wednesday October 01, 2014 @09:09PM (#8398893)
There is a lot of use case optimization going on here. The sorting inside the columnar store is in and of itself a huge performance boost. And saying that it scans 138Billion rows per second is completely wrong because it uses a lot of short cuts to get the result and it doesnt even use rows to store the data.

There is nothing stopping Oracle using the same optimization for their use case, although they would be better suited if someone from the crowd queried something that MemSQL didnt sort/optimize for.

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by nikita on Wednesday October 01, 2014 @09:17PM (#8398919)
It's hard to define what a "fair" columnar store scan is. We use a technique that is called "segment elimination", which allows to skip over compressed segments of data as you scan. However every solid columnar database uses such techniques. It just happens that Oracle 12c doesn't have the ability to sort columnar indexes, and neither does it have the ability to store columnar indexes on flash or disk, which bloats the overall cost.
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by jma24 on Thursday October 02, 2014 @11:55PM (#8404251)
The much bigger problem with Oracle In-Memory is that a lot of operations like joins and sorts often happen in the SGA, in row form. So you end up needing a truckload of SGA for temporary calculations. And when the SGA runs out, which it invariably does, you end up using TEMPDB. And everything comes to a crawl.
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by mbesto on Wednesday October 01, 2014 @09:41PM (#8399018)
How does your tech differ from SAP HANA's columnar DB?
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by zdw on Wednesday October 01, 2014 @09:37PM (#8398998)
Isn't this tanamount to saying: "You used an O(log(n)) solution, but I mandated a O(n) solution, and therefore your solution is wrong even though it's faster"

At some point, how you solved the problem becomes moot if you get the same answer and your way is faster in most cases. That's the entire point of most algorithms texts.

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by acbart on Wednesday October 01, 2014 @10:13PM (#8399096)
Assuming the correctness of the algorithm is maintained!
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by t1m on Wednesday October 01, 2014 @10:03PM (#8399078)
Then again, MemSQL didn't design the benchmark. They beat Oracle at their own benchmark on massively cheaper nodes.
Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by pyre on Wednesday October 01, 2014 @10:45PM (#8399178)
That doesn't mean a whole lot. Back in the early '00s, ATI and Nvidia were caught optimizing for certain benchmarks that were commonly used to compare video card performance (IIRC one of them was caught with code that specifically cut corners if it detected being run by the benchmark program).

I'm not saying MemSQL is doing anything nefarious, but the fact that the benchmark tests are controlled by someone else doesn't carry a lot of weight.

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by t1m on Wednesday October 01, 2014 @11:23PM (#8399287)
I would say that doing the other guy's benchmark is the most objective thing you can do. You should take it one step further and include other competitive products. In this case, it's pretty easy to beat the crap out of Oracle, it's an elephant. I would challenge the MemDB guys to run the same benchmark against VoltDB and report on that.

Also, let's get down to brass tacks - I don't see the actual queries that are being graphed in the MemDB post, and what is that graph actually measuring?

I think the LMDB team has done a really good job with this type of comparative benchmark. They took the LevelDB benches, then ran them against a lot of competitive products, both new and legacy, and gave a really good view of the entire field, in terms of performance on a number of dimensions:

http://symas.com/mdb/inmem/

http://symas.com/mdb/inmem/scaling.html

Re:MemSQL Does Oracle’s Own Demo Ten Times as Fast, Sixty Ti... by yellow_and_gray on Wednesday October 01, 2014 @09:52PM (#8399043)
> There is nothing stopping Oracle using the same optimization

There is. Skill, bureaucracy, grit, and the right motive.

The meat here is MemSQL's sophisticated indexing with splay trees. http://en.wikipedia.org/wiki/Splay_tree