News for hackers. Stuff that matters.
Re:Robots.txt is a suicide note by derpy on Tuesday May 10, 2011 @03:13AM (#2531686)
If it's public, it's public. Don't put private stuff up in public.
Re:Robots.txt is a suicide note by smosher on Tuesday May 10, 2011 @03:52AM (#2531762)
It's not about that. Explicitly so. Did you read the thread you're responding to?