Re:Nordstrom's robots.txt
by hurin on Friday February 27, 2015 @05:55PM
(#9121904)
I'm not up to date on how google's current search indexing algorithm works. Supposing someone has a lot of bots that post links to `extra-small-teen-pony` or some other /sr query on nordstrom.com from other sites - would google index that?
[ Parent
| on HN ]