News for hackers. Stuff that matters.

A comment on Google's robots.txt. Parent comment

Re:Google's robots.txt by aw3c2 on Sunday February 23, 2014 @10:37AM (#7286149)
Do you get a different file than me? No-one but ia_archiver is allowed, see https://pastee.org/zpjsa
[ Parent | on HN ]

There are no comments on this comment yet.