News for hackers. Stuff that matters.

A comment on CNET is deleting old articles to try to improve its Google Search ranking. Parent comment

Re:CNET is deleting old articles to try to improve its Googl... by TRiG_Ireland on Thursday August 10, 2023 @07:43AM (#37074862)
Google still needs to crawl them to see the noindex tag. And when Google is crawling a lot of pages on your site, it'll be slow.
[ Parent | on HN ]
Re:CNET is deleting old articles to try to improve its Googl... by weird-eye-issue on Thursday August 10, 2023 @09:40AM (#37076048)
This is only an issue if you have millions of pages

Also, it will slow down the crawl frequency if you noindex it

So it's a non problem

[ Parent | on HN ]
Re:CNET is deleting old articles to try to improve its Googl... by mrguyorama on Thursday August 10, 2023 @01:48PM (#37079349)
>This is only an issue if you have millions of pages

You know, like a news website that's been on the internet since the 90s

[ Parent | on HN ]
Re:CNET is deleting old articles to try to improve its Googl... by weird-eye-issue on Thursday August 10, 2023 @09:40PM (#37084078)
> Also, it will slow down the crawl frequency if you noindex it

Eventually Google stops crawling noindexed pages.

[ Parent | on HN ]