News for hackers. Stuff that matters.

A comment on Only Google is really allowed to crawl the web. Parent comment

Re:Only Google is really allowed to crawl the web by tyingq on Friday March 26, 2021 @09:01PM (#26598825)
https://diff.wikimedia.org/2021/03/16/introducing-the-wikime...

Discussed not long ago: https://news.ycombinator.com/item?id=26484080

[ Parent | on HN ]
Re:Only Google is really allowed to crawl the web by plumeria on Saturday March 27, 2021 @12:41AM (#26599977)
Thanks
[ Parent | on HN ]