Re:Ask HN: Please stress-test the arc server for my latest p...
by kylec on Thursday April 29, 2010 @11:54PM
(#1307149)
Um, I think I DOSed you. Sorry. I ran ab to stress-test your server, and I guess it didn't handle it all that well. I wonder how HN handles excessive traffic?
[ Parent
| on HN ]
Re:Ask HN: Please stress-test the arc server for my latest p...
by akkartik on Friday April 30, 2010 @02:54AM
(#1307447)
Lol, I'd upvote you twice if I could. Can you send me your commandline args to ab?
To answer how HN handles it: the arc webserver has code to detect abusive crawlers. I should look into why that failed to kick in.
I'm glad readwarp didn't run into you until it had peaked on the front page :)
Re:Ask HN: Please stress-test the arc server for my latest p...
by kylec on Friday April 30, 2010 @03:05AM
(#1307466)
I don't have the exact parameters, but I think it was something like
ab -c 100 -n 10000 http://readwarp.com/<somethinghere>
I don't remember what <somethinghere> was, it was one of the JS fetch links I think. I was trying to flood your site with a bunch of traffic and I did think it might slow down for a bit, but I wasn't expecting to knock it offline. I, too, am glad that everyone else was able to see how your site was supposed to look before I took it down.
Re:Ask HN: Please stress-test the arc server for my latest p...
by akkartik on Friday April 30, 2010 @03:23AM
(#1307487)
Yeah, -c 100 is nothing I haven't tried before. My server knows to disable abuse detection for localhost, but it should have throttled your requests fairly quickly.
I have a nanny to restart the server if it dies, but on this occasion it just got wedged. That happens sometimes because PLT scheme uses atomic operations to enforce consistency. Like I said, thanks for uncovering this.