News for hackers. Stuff that matters.
Re:RethinkDB 2.1 is out: high availability by mikegioia on Tuesday August 11, 2015 @02:20PM (#10043263)
I'm evaluating a move from CouchDB to another system purely as an easily sharded/replicated KV document store. Do you recommend Rethink for that specific use-case or is it overkill? Your docs seem to convey that this isn't really in Rethink's wheelhouse (in that RDB is more suited for querying or real-time updating).
Re:RethinkDB 2.1 is out: high availability by coffeemug on Tuesday August 11, 2015 @02:23PM (#10043279)
RethinkDB can definitely act as a distributed key-value store (and a pretty good one). But I think the choice is highly dependent on your use-case and requirements. Could you go into a little more depth wrt your workload? (e.g. number of records, average record size, read/write ratio, expected ops/second, etc.)
Re:RethinkDB 2.1 is out: high availability by mikegioia on Tuesday August 11, 2015 @02:31PM (#10043338)
Yea of course. We're basically talking about 10/90 write/read on JSON documents ~100kb in size with very low load, probably no more than 10-20 ops/second at peak. Records now are at 200,000 projected to grow 250k/year.
Re:RethinkDB 2.1 is out: high availability by coffeemug on Tuesday August 11, 2015 @02:35PM (#10043371)
Thanks! I'd definitely give RethinkDB a try, I think you'd be pleasantly surprised at how nice it can be for this. You'll also find that you might want to run ad-hoc queries on JSON documents (e.g. for analytics/exploratory analysis, etc.) and having ReQL at your disposal will be great for that.

IMO picking a KV store makes the most sense if you have insane performance requirements (e.g. millions of ops/second) where you need to squeeze every last drop of performance and the query layer gets in the way.

(Also if you have any questions and don't want to share more info publicly, feel free to shoot me an email -- [email protected])

Re:RethinkDB 2.1 is out: high availability by mikegioia on Tuesday August 11, 2015 @03:19PM (#10043643)
Thanks, Slava I appreciate you taking the time here.
Re:RethinkDB 2.1 is out: high availability by tracker1 on Tuesday August 11, 2015 @07:23PM (#10045060)
RethinkDB could definitely handle your load.. the advantage over CouchDB being you can do a bit more than just your value, and get indexing on other fields in your data structures. At your data load and growth, I'd be surprised if a small cluster couldn't handle your load for 8-10 years without issue... Since you're using JSON structures being able to query your data beyond keys is really nice... A document database is probably a more flexible option than a straight kv store.

If you wanted to stay closer to key/value with nice clustering and scaling options, I might suggest cassandra. To be honest, that would be overkill as a relatively small RethinkDB cluster would likely handle your load for several years without issue.

Re:RethinkDB 2.1 is out: high availability by hendzen on Tuesday August 11, 2015 @10:27PM (#10045671)
For traffic that low, you could use basically anything.
Re:RethinkDB 2.1 is out: high availability by jchrisa on Tuesday August 11, 2015 @02:27PM (#10043315)
If you like the general style of CouchDB but want scale and availability that's been proven in mission critical user facing deployments for years, we just did a blog post about moving to Couchbase http://blog.couchbase.com/2015/august/moving-couch
Re:RethinkDB 2.1 is out: high availability by mikegioia on Tuesday August 11, 2015 @02:33PM (#10043353)
That's funny, I just installed that over the weekend and was testing it out. It's really good but what sort of through me off was the high $/node licensing fee if you want the Enterprise edition. It basically starts at $5k/year/node and that's just too oppressive.

Do you use the Community Edition and if so is it generally stable / suits your needs? I didn't read your article but I'll check it out tonight.

Re:RethinkDB 2.1 is out: high availability by jchrisa on Tuesday August 11, 2015 @03:19PM (#10043640)
I'm a cofounder of Couchbase. Almost all our code is Apache 2.0, and we make the Community builds available for everyone. Enterprise builds are free to use for a small test cluster.

Unless you are a business where $5k/node looks reasonable to pay for peace of mind, you are probably fine with the Community Edition. A lot of the customers paying for Enterprise Edition are moving to Couchbase from Oracle, so they are paying less per node and running fewer nodes than they used to.

Re:RethinkDB 2.1 is out: high availability by WaltPurvis on Tuesday August 11, 2015 @05:51PM (#10044645)
As far as I can tell the Community Edition lags far behind the Enterprise Edition in stability and improvements. The latest available Community Edition is v3.0.1, released in October 2014. Since then, there has been a v3.0.2 edition released in December 2014, and a v3.0.3 released in March 2015, both of which had "critical bug fixes" according to the release notes, plus a new version, 3.1.0, released in July 2015. None of these post-3.0.1 versions are available as a Community Edition, they're only available to Enterprise customers -- is that correct?

The Couchbase web site says: "Bug fixes and new features are eventually integrated with the Community Edition (CE), but this typically takes several weeks." But from what I can tell it's not "several weeks" -- it's at least 10 months.

Am I misunderstanding something?

Re:RethinkDB 2.1 is out: high availability by cihangirb on Wednesday August 12, 2015 @01:25AM (#10046169)
Hi, it seems we missed correcting this page. It takes months not weeks to release updates to CE. The releases after 3.0.1 (3.0.2 and others) are maintenance releases with bug fixes. 3.1 is a recent release and it does contain features. We would normally push a community edition version or 3.1 in several months after the release but we are close to pushing out 4.0 and that incorporates 3.1 enhancements and more. I am expecting that we will get a 4.0 community edition out that will supersede the 3.1 release and will deliver these features to you soon.
Re:RethinkDB 2.1 is out: high availability by jchrisa on Tuesday August 11, 2015 @11:19PM (#10045847)
If you want to use the latest features without waiting for a CE build, it's getting easier to build Couchbase Server all the time. This readme is where our new hires start: https://github.com/couchbase/manifest
Re:RethinkDB 2.1 is out: high availability by tracker1 on Tuesday August 11, 2015 @07:30PM (#10045078)
Thanks for pointing this out... I don't have any experience with CouchBase/CouchDB. But I do appreciate open-source database options, especially those where the open version closely matches the commercially supported options.
Re:RethinkDB 2.1 is out: high availability by ahachete on Wednesday August 12, 2015 @03:41AM (#10046595)
If bug fixes take weeks to get to the CE, as one post below quoted from Couchbase's website, how is it possible that you say that the CE is probably fine?

I'd rather say it's pretty useless. I wouldn't run anything where a bug fix (which could be a data corruption issue, a crash...) may take weeks to be fixed.

Unless I'm missing something, my opinion is: either use the commercial version or use a different product. Please correct me if I'm wrong.

Re:RethinkDB 2.1 is out: high availability by cihangirb on Monday August 17, 2015 @11:59AM (#10073872)
Hi, if you are experiencing corruption of data with the community edition, please let us know. We will take a look at that immediately.

The paid version of the software funds the community edition for Couchbase. I cannot say our system is perfect and I am certainly happy to hear feedback on how you'd like to see community vs enterprise edition configured. Posting here is fine or I am at - [email protected]. thanks -cihan

Re:RethinkDB 2.1 is out: high availability by mikegioia on Tuesday August 11, 2015 @04:04PM (#10043967)
Ah, I apologize 'oppressive' isn't the right word. I really meant 'outside of our budget', but I'll certainly be test-driving the CE this month. Thanks again.