News for hackers. Stuff that matters.

A comment on Yahoo is making a return to search. Parent comment

Re:Yahoo is making a return to search by utopcell on Tuesday January 31, 2023 @05:42AM (#34593576)
GitHub would not be happy with Google cloning all repos, and many of them at a high frequency, in order to circumvent a robots.txt restriction.
[ Parent | on HN ]
Re:Yahoo is making a return to search by kadoban on Tuesday January 31, 2023 @07:54AM (#34594466)
They're clever people, they could just do partial updates (pull instead of clone). I doubt it'd be that much of a strain.
[ Parent | on HN ]