CouchDB 1.1.0 - Hackdot

Re:CouchDB 1.1.0 by rb2k_ on Monday June 06, 2011 @11:50AM (#2625106)

I wish CouchDB would implement internal compaction. I'd love to use CouchDB and Elastic Search with the CouchDB River plugin. This would give me a nice REST infrastructure with a schemaless store (couchDB) and the ability to do complex queries in real time (elastic search).

Sadly my data is too write/update-heavy and just keeps on growing and growing. This means that I'll have to use compaction if I don't want to run out of space sooner or later. Starting compaction will kill performance over several hours and depending on the amount of written data might not even be able to finish :(

[ Parent | on HN ]

Re:CouchDB 1.1.0 by jchrisa on Monday June 06, 2011 @12:19PM (#2625233)

We are working on auto compaction. The Couchbase alpha already supports it. This should help, but it will help even more on a cluster as each shard can be compacted independently.

[ Parent | on HN ]

Re:CouchDB 1.1.0 by rb2k_ on Monday June 06, 2011 @12:25PM (#2625268)

does "auto compaction" mean that the compaction process is just automatically triggered?

[ Parent | on HN ]

Re:CouchDB 1.1.0 by fdmanana on Monday June 06, 2011 @12:29PM (#2625285)

Yes, but only when certain configurable conditions are met (fragmentation level, time period). There's some user level documentation in the default.ini config file:

https://github.com/couchbase/couchdb/blob/preview/etc/couchd...

[ Parent | on HN ]

Re:CouchDB 1.1.0 by rb2k_ on Monday June 06, 2011 @02:58PM (#2625907)

ok, that would still lead to a situation where my server crawls to a halt for hours and might never finish if I don't basically take it offline :(

[ Parent | on HN ]