News for hackers. Stuff that matters.
Re:The joys and sorrows of maintaining a personal website by jrochkind1 on Friday May 06, 2022 @07:06PM (#31290472)
Odd, I have always seen the google bot respect the robots.txt. If I disallowed it, it disappeared from my traffic.

Of course, generally people do not want to do this, as they want to appear in google.

There are no comments on this comment yet.