News for hackers. Stuff that matters.

A comment on Nike.com's robots.txt.

Re:Nike.com's robots.txt by Yeri on Friday February 11, 2022 @07:20AM (#30300540)
Cloudflare: https://www.cloudflare.com/robots.txt

Google, facebook and bbc's are surprisingly boring :)

[ Parent | on HN ]
Re:Nike.com's robots.txt by M4tze on Friday February 11, 2022 @09:52AM (#30302109)
I bet that was done by JGC
[ Parent | on HN ]