Re:Google may shut down its news service in Europe
by tannhaeuser on Wednesday November 21, 2018 @08:27AM
(#18502475)
The publisher can control how much content is exposed via RSS (typically just the lede), whereas with presenting scraped content by third party news aggregators, the user will never need to visit the origin site.
[ Parent
| on HN ]
Re:Google may shut down its news service in Europe
by Andrex on Wednesday November 21, 2018 @05:50PM
(#18506723)
The publisher can also control how much is shared with third party aggregators, either through robots.txt or a paywall method.
Which has been the case since search engines became a thing.
Re:Google may shut down its news service in Europe
by tannhaeuser on Thursday November 22, 2018 @02:06AM
(#18508392)
That isn't the same at all. A publisher cannot use robots.txt, and much less paywalls, to indicate a part of text that can be shared in syndication.
Re:Google may shut down its news service in Europe
by Andrex on Thursday November 22, 2018 @10:12AM
(#18510396)
A paywall can. The page displays the snippet the publication is allowing to be shared, while the paywall hides the rest. I believe this is what a few of the bigger US newspapers are doing right now.
Re:Google may shut down its news service in Europe
by tannhaeuser on Thursday November 22, 2018 @10:58AM
(#18510694)
Ok, but that would require regular readers to have credentials for the paywall. I understood the discussion to be about scraping publicly accessible sites.