News for hackers. Stuff that matters.
Re:What one may find in robots.txt by psykovsky on Monday May 18, 2015 @07:07AM (#9563725)
Curiosity killed the cat, or so they say.
Re:What one may find in robots.txt by gpvos on Monday May 18, 2015 @07:32AM (#9563805)
As long as the block lasts not more than a few days, as he says in a nearby comment, I don't think it's much of a problem.
Re:What one may find in robots.txt by psykovsky on Monday May 18, 2015 @09:40AM (#9564321)
Oh, believe me they only last a few days at most. I don't use an infinite IP blocklist. It has like 100 IP's or so. When one goes in, one must come out. And lets just say there are enough badly behaved bots around that it doesn't take much time for 100 IP's to rotate.
Re:What one may find in robots.txt by beaumartinez on Monday May 18, 2015 @07:16AM (#9563752)
"But satisfaction brought him back."