News for hackers. Stuff that matters.

prokizzle

prokizzle on Hacker News

Re:Nordstrom's robots.txt on Saturday February 28, 2015 @02:46AM (#9123104)
Screenshot of original robots.txt for when the changes get pushed to production:

http://imgur.com/8zkK8w2

Re:Nordstrom's robots.txt on Friday February 27, 2015 @05:29PM (#9121777)
Also, in

   Disallow: /sr/mattress* Disallow: /sr/mattresses*
Doesn't A imply B?
Re:Nordstrom's robots.txt on Friday February 27, 2015 @05:09PM (#9121681)
maybe, but why would THAT be the honey pot? it could be any phrase, really.
Re:Nordstrom's robots.txt on Friday February 27, 2015 @04:52PM (#9121592)
Maybe that was their intention, but that's not how it's done.