News for hackers. Stuff that matters.
Re:The Bw-Tree: A B-tree for New Hardware by ldng on Wednesday April 10, 2013 @08:10AM (#5524569)
I did not delve into the details as you might have, but whenever I see mmap associated with huge perf I tend to wonder about corruption. I've seen to many bench comparing ondisk stores with in mmap stores flushed to disk one in a while. Then you need extra steps/configs to get good enough reliability that hinder perf.
Re:The Bw-Tree: A B-tree for New Hardware by jules on Wednesday April 10, 2013 @10:29AM (#5525335)
That's certainly a possibility but I'll have to assume that they are running with the same durability guarantees unless proven otherwise :)
Re:The Bw-Tree: A B-tree for New Hardware by hyc_symas on Wednesday April 10, 2013 @11:21AM (#5525669)
Correct. In synchronous mode full ACID semantics are guaranteed. Writable mmap avoids memcpy()/write() overhead but msync() is still performed.
Re:The Bw-Tree: A B-tree for New Hardware by snaky on Wednesday April 10, 2013 @09:59AM (#5525156)
>whenever I see mmap associated with huge perf I tend to wonder about corruption

If that was the case with lmdb implementation, that works as OpenLDAP backend all over the world, most probably you would have heard about it from the news.

Re:The Bw-Tree: A B-tree for New Hardware by ldng on Thursday April 11, 2013 @10:32AM (#5532166)
You've have a point. But then, it's a bench mark and it would not be the first time that a bench is done using different settings than in production. Like I said, that lmdb is used in OpenLDAP doesn't automatically mean it is used with the exact same configuration as in the benchmark ;-) Nor did I say a memory store is bad, it's just you're not comparing the same things. Redis could be added to the bench for instance.
Re:The Bw-Tree: A B-tree for New Hardware by hyc_symas on Friday April 12, 2013 @04:55AM (#5537322)
IMO main-memory stores are bad, for multiple reasons. LMDB is not a main memory store, it is a fully ACID-compliant transactional store.