News for hackers. Stuff that matters.

A comment on CNET is deleting old articles to try to improve its Google Search ranking. Parent comment

Re:CNET is deleting old articles to try to improve its Googl... by npunt on Thursday August 10, 2023 @01:15AM (#37072236)
no I didn't see that in there, I just agree that robots.txt makes sense for web crawlers but not archival purposes
[ Parent | on HN ]

There are no comments on this comment yet.