Re:How We Built r/Place
by josephg on Saturday April 15, 2017 @04:02AM
(#14119869)
Complete and working. I haven't tested the load for real, but judging by the performance numbers it should be able to handle 100k connections fine with 2 beefy backend servers. (40% of one of my laptop's cores handles 15k connections with 400 edits per second. So about 8 cores should handle 100k users no sweat.) The bottleneck is fanout, so until kafka starts hitting subscribe limits it should scale linearly with frontend servers. (And kafka is a long way from hitting that limit because I've added write coalescing.)
I'll post a writeup about it all once I've eaten some real food and had a rest. But for now, enjoy!
I'll post a writeup about it all once I've eaten some real food and had a rest. But for now, enjoy!