Re:Nordstrom's robots.txt
by prokizzle on Friday February 27, 2015 @05:09PM
(#9121681)
maybe, but why would THAT be the honey pot? it could be any phrase, really.
[ Parent
| on HN ]
Re:Nordstrom's robots.txt
by IgorPartola on Friday February 27, 2015 @05:14PM
(#9121709)
Well, you'd want them to try to crawl it. Perhaps there was a bot crawling their site for such links and they wanted to identify specifically that one. It seems most likely that such URL's never existed, but this would be a decent way to identify a bot that's otherwise not distinguishable.