News for hackers. Stuff that matters.
Re:CNET is deleting old articles to try to improve its Googl... by weird-eye-issue on Thursday August 10, 2023 @09:40AM (#37076048)
This is only an issue if you have millions of pages

Also, it will slow down the crawl frequency if you noindex it

So it's a non problem

Re:CNET is deleting old articles to try to improve its Googl... by mrguyorama on Thursday August 10, 2023 @01:48PM (#37079349)
>This is only an issue if you have millions of pages

You know, like a news website that's been on the internet since the 90s

Re:CNET is deleting old articles to try to improve its Googl... by weird-eye-issue on Thursday August 10, 2023 @09:40PM (#37084078)
> Also, it will slow down the crawl frequency if you noindex it

Eventually Google stops crawling noindexed pages.