News for hackers. Stuff that matters.
Re:Ask HN: Please stress-test the arc server for my latest p... by akkartik on Friday April 30, 2010 @02:54AM (#1307447)
Lol, I'd upvote you twice if I could. Can you send me your commandline args to ab?

To answer how HN handles it: the arc webserver has code to detect abusive crawlers. I should look into why that failed to kick in.

I'm glad readwarp didn't run into you until it had peaked on the front page :)

Re:Ask HN: Please stress-test the arc server for my latest p... by kylec on Friday April 30, 2010 @03:05AM (#1307466)
I don't have the exact parameters, but I think it was something like

    ab -c 100 -n 10000 http://readwarp.com/<somethinghere>
I don't remember what <somethinghere> was, it was one of the JS fetch links I think. I was trying to flood your site with a bunch of traffic and I did think it might slow down for a bit, but I wasn't expecting to knock it offline. I, too, am glad that everyone else was able to see how your site was supposed to look before I took it down.
Re:Ask HN: Please stress-test the arc server for my latest p... by akkartik on Friday April 30, 2010 @03:23AM (#1307487)
Yeah, -c 100 is nothing I haven't tried before. My server knows to disable abuse detection for localhost, but it should have throttled your requests fairly quickly.

I have a nanny to restart the server if it dies, but on this occasion it just got wedged. That happens sometimes because PLT scheme uses atomic operations to enforce consistency. Like I said, thanks for uncovering this.