News for hackers. Stuff that matters.

A comment on I was wrong about robots.txt. Parent comment

Re:I was wrong about robots.txt by paulddraper on Thursday July 17, 2025 @10:51AM (#44594059)
Yes. That’s a lot of bandwidth, depending on the content of course.
[ Parent | on HN ]

There are no comments on this comment yet.