Re:More than 1MM Facebook accounts exposed
by Evbn on Friday November 02, 2012 @10:16AM
(#4732672)
Robots.txt is about fetching content, it has noting do to with indexing URLs or anything which is part of the content at non-robots.txt restricted locations.
[ Parent
| on HN ]
There are no comments on this comment yet.