News for hackers. Stuff that matters.
Re:Google to Explore Alternatives to Robots.txt by floomk on Saturday July 08, 2023 @12:27PM (#36645928)
It's funny how everyone on HN is all like "your bot is a bad bot if you don't obey robots.txt"! But then the bigcorps are like "let's shake it up" and suddenly it's fine and in fact the best thing since sliced bread.

There are no comments on this comment yet.