Re: French journalist "hacks" govt by inputting correct URL,...
by tripzilch on Tuesday February 11, 2014 @09:32AM
(#7217743)
Yes but links can leak in the most accidental fashions. Google seems to find a lot of stuff that makes me wonder how Googlebot ever found such links. Part of the explanation might be referer logs, and such.
Anyway, the point is, it's smarter to be explicit and also opt-out using robots.txt or something similar.
Anyway, the point is, it's smarter to be explicit and also opt-out using robots.txt or something similar.