News for hackers. Stuff that matters.

A comment on Nike.com's robots.txt. Parent comment

Re:Nike.com's robots.txt by comonoid on Friday February 11, 2022 @11:55AM (#30303688)
Sane implementations do not read more than 500KiB of robots.txt contents.
[ Parent | on HN ]

There are no comments on this comment yet.