News for hackers. Stuff that matters.
Re:A Note on the Recent GitHub Outages by jrockway on Thursday February 04, 2010 @11:44PM (#1102744)
Imagine you have to write a computer program to visit every page of every website on the entire Internet.

Sometimes you are going to make a mistake, and someone on the Internet is going to notice.

Re:A Note on the Recent GitHub Outages by timdorr on Friday February 05, 2010 @01:22AM (#1102882)
Except this has been going on for months, has happened a number of times, and occurs in violation of standards, like robots.txt, that were created to prevent it from happening. I'd expect it from an individual or startup, but not a large company that's been doing spidering for a long time.