woonord
Re:Nordstrom's robots.txt
on Friday February 27, 2015 @06:06PM (#9121947)
kinda sorta maybe
Re:Nordstrom's robots.txt
on Friday February 27, 2015 @06:04PM (#9121938)
Update!
offending term we rank on "extra small teen porn" - offending page /sr/petite-extra-small. Robots updated (live tomorrow)! Asked Google to remove the URL.
Re:Nordstrom's robots.txt
on Friday February 27, 2015 @05:26PM (#9121764)
impossible to do more research on this at work.
Re:Nordstrom's robots.txt
on Friday February 27, 2015 @05:22PM (#9121749)
thanks! I have some inside knowledge!
Re:Nordstrom's robots.txt
on Friday February 27, 2015 @05:16PM (#9121720)
Hi!
The robots file is not a text file. I know!
Products blocked due to possible copyright infringement. A lot are disputes over product name or t-shirt slogan.
We were ranking for some terms we did not want to be associated with so we added the offending search result page to the file. Not sure how it ever got indexed in the first place.
Peace!