News for hackers. Stuff that matters.
Re:How Discord Stores Billions of Messages Using Cassandra by maktouch on Thursday January 19, 2017 @09:15PM (#13441263)
It's really interesting to see that you're using Cassandra for this. IIRC, Cassandra was created by Facebook for their messaging, and realized that eventual consistency was a bad model for chat, so they moved to HBase instead. (source: http://highscalability.com/blog/2010/11/16/facebooks-new-rea...)

The tombstone issue was really interesting ! Thanks for sharing.

Re:How Discord Stores Billions of Messages Using Cassandra by Vishnevskiy on Thursday January 19, 2017 @09:34PM (#13441365)
They did make the original and the core model is the same, but Cassandra in 2017 is quite different from what they open sourced in features, usability and stability.

I guess everyone makes their own tradeoffs though. This has been working wonderfully for us.

Re:How Discord Stores Billions of Messages Using Cassandra by jjirsa on Thursday January 19, 2017 @10:49PM (#13441612)
You can have strong consistency in Cassandra - ING gave a talk at Cassandra summit 2015 on their multi-DC Strongly consistent use cases

Cassandra let's you choose - per query - how many replicas must ack the query. Strong consistency is just a query parameter away.

Re:How Discord Stores Billions of Messages Using Cassandra by nvarsj on Friday January 20, 2017 @04:50PM (#13447253)
Need to be careful about the wording, "strong consistency". I dislike that datastax uses that in their documentation, because it's misleading and really confuses people. There is no commit protocol in place - Cassandra is still an AP db under the hood, so even having multiple replicas acknowledge doesn't mean the data is consistent. For that you need paxos or something similar. This becomes very obvious if you are doing updates from multiple sources to the same key.
Re:How Discord Stores Billions of Messages Using Cassandra by jjirsa on Friday January 20, 2017 @10:46PM (#13448635)
You do realize that Cassandra implements paxos and has a CAS system right?