News for hackers. Stuff that matters.
Re:How Discord Stores Billions of Messages Using Cassandra by beck5 on Friday January 20, 2017 @03:01AM (#13442336)
Serious question, how do you backup a casandra database of that size. Do you even back it up or just rely on the sharing to prevent dataloss?
Re:How Discord Stores Billions of Messages Using Cassandra by Vishnevskiy on Friday January 20, 2017 @03:34AM (#13442426)
Cassandra has a snapshat command that creates a directory by symlinking files that hold data (this is safe cause Cassandra files are immutable). Then you just upload them to your backup storage. This is obviously for recovery scenarios that are catastrophic.

Normally though since the data is replicated on 3 nodes, you can technically loose a node completely and rebuild it from the other nodes.

Re:How Discord Stores Billions of Messages Using Cassandra by manigandham on Friday January 20, 2017 @11:41PM (#13448848)
Cassandra natively supports multi-cluster replication - so you can run an entirely separate cluster that also has a copy of the entire dataset (which itself has configurable replication within a cluster) which can be used as an online fully-active backup.

We run 3 geo-distributed clusters with no offline backups because of this.