News for hackers. Stuff that matters.

A comment on Only Google is really allowed to crawl the web. Parent comment

Re:Only Google is really allowed to crawl the web by samuelizdat on Friday March 26, 2021 @12:30PM (#26594024)
That depends, would Google let us know?
[ Parent | on HN ]
Re:Only Google is really allowed to crawl the web by rijoja on Friday March 26, 2021 @03:25PM (#26595911)
not if they could avoid it
[ Parent | on HN ]