Re:Asynchronous filesystem replication with FUSE and rsync
by andyidsinga on Thursday December 11, 2014 @10:26AM
(#8735211)
for newly built applications, why not setup a ceph or swift cluster ..then use an s3 interface for access to files/objects?
total an minimum replicas can be configured... so you will get something like eventual consistency if you use small min than total.
[ Parent
| on HN ]
Re:Asynchronous filesystem replication with FUSE and rsync
by Lethalman on Thursday December 11, 2014 @10:45AM
(#8735350)
That's true. I've tried ceph, swift and riakcs.
Our requirements were two servers, the storage is several terabytes, and losing data because of an unknown bug in the filesystem wasn't an option.
Such filesystems are quorum-based and certainly need more than two servers with terabytes of data. More than what we could afford. Also if you lose quorum, the system hangs to ensure atomicity. But we don't need such properties.
Also after some testing, those filesystem resulted about 5-10% slower than traditional filesystems, with few nodes of course. They are designed to scale with many nodes.
Re:Asynchronous filesystem replication with FUSE and rsync
by andyidsinga on Thursday December 11, 2014 @03:19PM
(#8736853)
Thank you