News for hackers. Stuff that matters.
Re:How Discord Scaled Elixir to 5M Concurrent Users by Vishnevskiy on Tuesday July 11, 2017 @06:36PM (#14748673)
The messages struggles have been sadly due to issues with Cassandra and GC pauses caused by bugs within it. We have been trying to work with the Cassandra developers to resolve these.

Voice issues should not be happening. Please contact our support with more information and we will gladly investigate.

Re:How Discord Scaled Elixir to 5M Concurrent Users by joonoro on Tuesday July 11, 2017 @06:50PM (#14748748)
Thanks for the response, it's good to know what's causing the problems with messages and that it's being worked on. I'll try to contact support next time I have voice issues with my group.
Re:How Discord Scaled Elixir to 5M Concurrent Users by Vishnevskiy on Tuesday July 11, 2017 @07:11PM (#14748843)
:) np

We love Cassandra, and hate it at the same time.

Check out this nasty bug we got. https://issues.apache.org/jira/browse/CASSANDRA-13004

Re:How Discord Scaled Elixir to 5M Concurrent Users by jjirsa on Tuesday July 11, 2017 @10:19PM (#14749703)
Two things are true about Cassandra:

It is by far the best at doing what it does

It has plenty of room for improvement

Re:How Discord Scaled Elixir to 5M Concurrent Users by Vishnevskiy on Tuesday July 11, 2017 @11:33PM (#14749965)
You are 100% right that it is the best at what it does.

And thank you again with helping us with that bug :) we really appreciate it.

Re:How Discord Scaled Elixir to 5M Concurrent Users by tormeh on Wednesday July 12, 2017 @03:40PM (#14755896)
I'm currently far down the database rabbit-hole and have to ask: What's so great about Cassandra that you can't get with CouchDB or other AP (yeah, I know...) databases?
Re:How Discord Scaled Elixir to 5M Concurrent Users by jjirsa on Wednesday July 12, 2017 @09:46PM (#14758191)
Solid ingestion story. Very very good write throughout. Linear scaling. Easy expansion / contraction. Complete flexibility in consistency vs availability tradeoff.

And most importantly:

It actually works at scale. Huge scale. Thousand node cluster and hundreds of thousands of instances scales.

Because a good chunk of the active maintainers actually run this shit in prod.

Re:How Discord Scaled Elixir to 5M Concurrent Users by lpgauth on Tuesday July 11, 2017 @09:41PM (#14749562)
You might want to have a look at ScyllaDB.
Re:How Discord Scaled Elixir to 5M Concurrent Users by Vishnevskiy on Tuesday July 11, 2017 @11:34PM (#14749970)
We are currently in the process of testing ScyllaDB with double writes for our fixed data clusters. It is very scary to transition to something so new :)

Our message storage clusters have a very large set of data that keeps increasing and using Scylla without incremental repair will suck so we are waiting on that.