News for hackers. Stuff that matters.

A comment on Nordstrom's robots.txt. Parent comment

Re:Nordstrom's robots.txt by ashmud on Friday February 27, 2015 @08:27PM (#9122395)
I have had to do that before. The URLs in that case seemed to have a more random distribution than most of these.
[ Parent | on HN ]

There are no comments on this comment yet.