News for hackers. Stuff that matters.
Re:Scaling Disqus (YC S07) by endlessvoid94 on Tuesday September 07, 2010 @11:56PM (#1670971)
This is invaluable, thanks for sharing. We're running into some really interesting problems building Djangy.com - this slideshow is a goldmine.
Re:Scaling Disqus (YC S07) by kfool on Tuesday September 07, 2010 @11:01PM (#1670878)
How do you deal with schema changes? Do they force you to switch into a read-only mode?
Re:Scaling Disqus (YC S07) by kingkilr on Tuesday September 07, 2010 @07:34PM (#1670478)
The talk was recorded, and the video will be made available (once it's ready).
Re:Scaling Disqus (YC S07) by xtacy on Tuesday September 07, 2010 @07:27PM (#1670454)
For such web services, what is the average/peak load on the network? Is it a bottleneck at all? Are the networks over provisioned?
Re:Scaling Disqus (YC S07) by riffer on Tuesday September 07, 2010 @08:02PM (#1670552)
The article says peak is 17k req/sec ... (I'm impressed)
Re:Scaling Disqus (YC S07) by xtacy on Tuesday September 07, 2010 @08:16PM (#1670594)
Yes, I presume that's incoming 17k req/sec. Each incoming request can then lead to many database queries/memcached queries/etc. It would be more insightful if request/response sizes were also known.
Re:Scaling Disqus (YC S07) by michaelfairley on Wednesday September 08, 2010 @01:13AM (#1671106)
There was no mention of MongoDB in this presentation, but Disqus is listed on the MongoDB Production Deployments page: http://www.mongodb.org/display/DOCS/Production+Deployments
Re:Scaling Disqus (YC S07) by okeumeni on Wednesday September 08, 2010 @01:46AM (#1671145)
I guess it’s nice to mention Disqus a using for MongoDb folks. They are not the first company to mislead on the internet.
Re:Scaling Disqus (YC S07) by danielha on Wednesday September 08, 2010 @05:00AM (#1671393)
Disqus also uses MongoDB amongst many other tools not mentioned. Those fine folks aren't misleading anyone.
Re:Scaling Disqus (YC S07) by patrickaljord on Wednesday September 08, 2010 @12:48AM (#1671064)
I thought they were using mongodb, any idea why they switched to pgsql?
Re:Scaling Disqus (YC S07) by bdr on Wednesday September 08, 2010 @01:09AM (#1671102)
Disqus has used Postgres since the beginning. They also use mongodb.
Re:Scaling Disqus (YC S07) by orlandu63 on Tuesday September 07, 2010 @10:26PM (#1670808)
Can we get a direct link to the PDF?
Re:Scaling Disqus (YC S07) by ronnier on Tuesday September 07, 2010 @10:35PM (#1670827)
Re:Scaling Disqus (YC S07) by sr3d on Wednesday September 08, 2010 @02:07AM (#1671184)
How many HAProxy server is being used? Just a main one with heartbeat for failover?
Re:Scaling Disqus (YC S07) by siculars on Wednesday September 08, 2010 @12:27AM (#1671028)
nice starcraft2 pitch at the end ;)
Re:Scaling Disqus (YC S07) by technoweenie on Wednesday September 08, 2010 @12:46AM (#1671060)
I see someone playing Starcraft most of the time while I pass by their office (ours is right above theirs).
Re:Scaling Disqus (YC S07) by ohashi on Wednesday September 08, 2010 @08:10AM (#1671595)
Strategical Thinking Practice.
Re:Scaling Disqus (YC S07) by amccloud on Thursday September 09, 2010 @03:48AM (#1674710)
Probably dcramer
Re:Scaling Disqus (YC S07) by thedz on Wednesday September 08, 2010 @01:21AM (#1671117)
It's true :/
Re:Scaling Disqus (YC S07) by mdg on Wednesday September 08, 2010 @08:51AM (#1671672)
Why is emailing an exception bad (Slide 48)? Can a small site get away with it ?
Re:Scaling Disqus (YC S07) by tkaemming on Wednesday September 08, 2010 @11:54AM (#1672240)
A possible disaster scenario: connection issues with the SMTP server are causing the initial exception, resulting in webserver connections that are open for excessively long periods of time (unless you're sending the emails asynchronously), since the process is blocked first on the failed SMTP connection, then again on the exception email attempt (and you're still not getting any notification that something is broken, unless you're doing some other kind of monitoring!)
Re:Scaling Disqus (YC S07) by simonw on Wednesday September 08, 2010 @11:49AM (#1672209)
It's fine for small sites. You'll know when your site is too big for that feature from the pain in your inbox.