News for hackers. Stuff that matters.
Re:Freenode has blocked the Mibbit client permanently. by sho on Friday June 19, 2009 @01:54PM (#665586)
Are you saying that in your real-world experience, Twisted can handle over 360K simultaneous connections?
Re:Freenode has blocked the Mibbit client permanently. by abstractbill on Friday June 19, 2009 @02:02PM (#665607)
Not on a single box, no - we run these machines in a cluster. Each chat machine scales up to a bit more than 80k simultaneous connections (each machine runs 8 processes, each of which can do about 10k simultaneous). There's some amount of IPC between all the chat processes in the cluster, but not too much, which means we can pretty much scale linearly just by adding hardware at this point.
Re:Freenode has blocked the Mibbit client permanently. by sho on Friday June 19, 2009 @02:23PM (#665636)
Hm. Still, 80k per box is nothing to sniff at, especially with Python.

I've been using Ruby's EventMachine, I can get it up to about C20k before it blows up, but that's local only, remains to be seen what proper connections will do. Haven't tried multiple processes yet. As for IPC I just dump everything into AMQP, whose fanout exchanges seem practically designed for IRC : D

Hm, anyway, thanks for the info. Really cool to hear python stretching that far.