Re:Introducing the Wikimedia Enterprise API
by notatoad on Tuesday March 16, 2021 @09:20PM
(#26485409)
if you post information publicly on the internet, google is entitled to scrape it. you've opted in by publishing it.
if you want to specifically exclude one entity from accessing information that you've posted for anybody to see, i'm not sure how there's a way that could be "opt-in"
Re:Introducing the Wikimedia Enterprise API
by tobylane on Wednesday March 17, 2021 @05:58AM
(#26488813)
Google is entitled to scrape it, but are they entitled to display the content on their site, the results pages? Everything in the instant answers is content that deserves to be displayed on its creators page, along with whatever monetisation the creator chooses.
Re:Introducing the Wikimedia Enterprise API
by watchdogtimer on Tuesday March 16, 2021 @10:53PM
(#26485961)
You could do this using a robots.txt file (assuming the scraper obeys it, of course).
Re:Introducing the Wikimedia Enterprise API
by theamk on Tuesday March 16, 2021 @10:30PM
(#26485821)
> And I agree that this will be a dampener on any competition, I think the era of "ask for forgiveness, rather then permission" needs to stop.
Does this mean that you think there should be less competition for Google?
That being said, of all the sources, Wikipedia actively license their content in such a way that google are well within their rights to slurp it all down and serve it however they want.
Google is already effectively paying for links to news sites as part of the negotiations in Australia. And I agree that this will be a dampener on any competition, I think the era of "ask for forgiveness, rather then permission" needs to stop.