News for hackers. Stuff that matters.
Re:What's the hidden secret of the review for ASIN B0069IY63Y? by andyjohnson0 on Tuesday November 06, 2012 @10:32AM (#4748796)
I don't get it. The link points to www.amazon.com/robots.txt.
Re:What's the hidden secret of the review for ASIN B0069IY63Y? by wimplash on Tuesday November 06, 2012 @12:54PM (#4749533)
if you look in the file you'll see a Disallow entry for /product-reviews/B0069IY63Y.
Re:What's the hidden secret of the review for ASIN B0069IY63Y? by wimplash on Tuesday November 06, 2012 @10:30AM (#4748784)
honeypot entry to ensure that crawlers are complying with robots.txt?