Re:Google to Explore Alternatives to Robots.txt
by floomk on Saturday July 08, 2023 @12:27PM
(#36645928)
It's funny how everyone on HN is all like "your bot is a bad bot if you don't obey robots.txt"! But then the bigcorps are like "let's shake it up" and suddenly it's fine and in fact the best thing since sliced bread.
[ Parent
| on HN ]
There are no comments on this comment yet.