News for hackers. Stuff that matters.

sbtourist

Re:Looking with Cassandra into the future of Atlas on Tuesday July 17, 2012 @10:42AM (#4255833)
I disagree here.

First, in order to achieve strong consistency in a distributed system with replication enabled, you will always have to write to multiple replicas: provided the number of replicas is the same, whether you're using a consistent-hashing based replication (Cassandra) or a distributed file system (HBase) it really doesn't matter much, as I/O latencies (both network and disk related) will always play a large role here.

That said, you can have different performances if you:

1) Change the replication factor: this is something you can do regardless of the actual system you're using, so it doesn't count.

2) Change the number of "acknowledged" writes/reads as a fraction of the replication factor: strongly consistent systems will always provide at least as much acknowledges as Cassandra's QUORUM, so no big win here.

3) Change the point where you acknowledge writes, either memory, disk or physical sync: this is about durability, and if you use different settings for different systems (i.e. Mongo VS Cassandra) it is apples and oranges.

4) Change your physical storage structure (provided same level of durability as explained above): different databases use different structures, Cassandra uses Memtables+SSTables, which I don't expect to be slower than HBase HDFS-based ones.

So in the end, Cassandra is at least as fast as other distributed databases, even when working in strongly consistent fashion.

Re:Looking with Cassandra into the future of Atlas on Tuesday July 17, 2012 @06:02AM (#4255015)
And talking about consistency, as already pointed out by Jonathan, Cassandra actually provides a way to allow for strong consistency: also, with its tunable consistency levels, it provides greater freedom to implement different access patterns depending on the use case, as described on the blog post.
Re:Looking with Cassandra into the future of Atlas on Tuesday July 17, 2012 @05:59AM (#4254999)
We already have an HBase cluster in-house we use together with Hadoop for social analytics. By the way, we ruled it out as our operational experience with it was a little bit of a pain, in particular around version updates.

Talking about DynamoDB, it is certainly attractive as it scales, is managed by Amazon and all the yadda-yadda, but we didn't want to be lock-in to Amazon, and costs were another concern.

Re:Looking with Cassandra into the future of Atlas on Tuesday July 17, 2012 @05:51AM (#4254975)
Agreed, we had a pleasant operational experience, except for some not-so-well documented details around auto-bootstrapping and host names, as briefly mentioned in the blog post.

But cluster elasticity and resiliency has been working really good so far.

Re:Terrastore Project Ideas on Tuesday January 05, 2010 @03:46AM (#1032102)
Terrastore is a new born project, and one of its main objectives is to build an healthy open source community and ecosystem.

So feel free to comment on those project ideas, as well as propose new ones!

Re:Terrastore - Scalable, elastic, consistent document store on Thursday December 31, 2009 @04:20AM (#1024072)
Sure, I was just kidding. Thanks for your kind words, hope you'll find it useful.
Re:Terrastore - Scalable, elastic, consistent document store on Thursday December 31, 2009 @04:18AM (#1024071)
Exactly: clustering and storage are more and more "commodity" features, as I see it. The most important thing is going to be what you build upon them, the real value you provide to the user: is data partitioned or replicated? What data manipulation features are provided? And so on ...
Re:Terrastore - Scalable, elastic, consistent document store on Thursday December 31, 2009 @02:14AM (#1023985)
Clustering and storage are completely based on Terracotta, and this is great: relying on a rock solid technology gives you the freedom to focus on more advanced features, such as communication, partitioning, data manipulation and querying.

Which is the same reason Voldemort and Riak rely on third-party storage, or HBase relies on Hadoop.

Re:Terrastore - Scalable, elastic, consistent document store on Thursday December 31, 2009 @02:07AM (#1023980)
Call it "marketing" ;) Joking aside, the article you mentioned is linked on the home page for that exact reason: put things in the correct context.
Re:Terrastore - Scalable, elastic, consistent document store on Thursday December 31, 2009 @02:05AM (#1023979)
Terrastore already implements lightweight "stored procedures" in terms of server side updates: functions which atomically update a value based on some custom logic.

Future versions will provide map/reduce functions as well, probably in both Java and Javascript.