Re:Facebook's robots.txt
by viana007 on Friday November 29, 2013 @06:32PM
(#6821504)
http://www.google.com/robots.txt
[ Parent
| on HN ]
Re:Facebook's robots.txt
by joshguthrie on Saturday November 30, 2013 @08:16AM
(#6823056)
Chrome user here. When I open it, the tab is automatically closed.
Tried to curl it, exact content, no 302 towards a "<script>window.close</script>",... Got anything?
Re:Facebook's robots.txt
by easy_rider on Friday November 29, 2013 @07:36PM
(#6821679)
/* would have sufficed
Re:Facebook's robots.txt
by darkmighty on Friday November 29, 2013 @08:08PM
(#6821786)