Re:What one may find in robots.txt
by werid on Monday May 18, 2015 @07:02AM
(#9563707)
Now it's indexed by search engines?
[ Parent
| on HN ]
Re:What one may find in robots.txt
by icebraining on Monday May 18, 2015 @07:43AM
(#9563835)
https://www.google.com/search?q=inurl%3Arobots.txt
Not that I agree it should be further divulged, mind you.