Re:What one may find in robots.txt
by allendoerfer on Monday May 18, 2015 @01:20PM
(#9565635)
French law would then be different than German law, where the ground the intended audience is on matters. Of course it is much harder to prosecute someone, when the server is in a country that does not cooperate.
Also, showing the link but not the content is a smart move because it doesn't prove that the author looked for the content of these documents, when the robots.txt is obviously a file you should be able to consult.