The more Google helps you get ahead, the more you end up dominating the search results. The more you dominate the results, the more people will start thinking to come straight to you. The more people come straight to you, the more people never use Google. The less people use Google, the less revenue Google generates.
This is a possible outcome but there are people that type in google.com and then the name of their preferred news site, their bank, etc, every day.
The site with the name they search dominates that search but they keep searching it.
But the vast majority are morons, grifters, and cargo culters.
The Google guidance is generally good and mildly informative but there’s a lot of depth that typically isn’t covered that the SEO industry basically has to black box test to find out.
Google has a vested interest in creating a good web experience. Consultants have an interest in making their clients money.
Link building is a classic example where good consultants deliver value. (There are bad consultants than good ones though)
That's because websites' goals and Google's goals are not aligned.
Websites want people to engage with their website, view ads, buy products, or do something else (e.g. buy a product, vote for a party). If old content does not or detracts from those goals, they and SEO experts say, it should go because it's dragging the rest down.
Google wants all the information and for people to watch their ads. Google likes the long tail; Google doesn't care if articles from the 90's are outdated because people looking at it (assuming the page runs Google ads) or searching for it (assuming they use Google) means impressions and therefore money for them.
Google favors quantity over quality, websites the other way around. To oversimplify and probably be incorrect.