Re:Australia to make Facebook, Google pay for news
by thirdsun on Tuesday August 04, 2020 @03:36AM
(#24047613)
They don't even need a paywall. If they don't want to be listed on Google they can always use robots.txt.
We've been through this in Germany. Publishers demanded to be paid for Google usage of results and news snippets. Google thankfully didn't give in to such a ridiculous demand and gave publishers the option to de-index them or keep listing them for free. Obviously all of them opted for the latter.
Block it by a paywall. But they wouldn't do that because they would stop showing up in search engines. Google is providing a free service by directing traffic to these companies.
Reminds me of the LinkedIn case about bots crawling their website.