News for hackers. Stuff that matters.
Re:Only Google is really allowed to crawl the web by kelnos on Friday March 26, 2021 @03:14PM (#26595787)
Not sure why you're being downvoted; I completely agree with what you're saying (modulo questionable usage of "sponsor"). If Wikipedia were to try to charge for this use of their data, Google would likely make it a priority to drop the Wikipedia blurbs, either without replacement, or with data sourced elsewhere.
Re:Only Google is really allowed to crawl the web by will4274 on Friday March 26, 2021 @06:43PM (#26597889)
> Google would likely make it a priority to drop the Wikipedia blurbs, either without replacement, or with data sourced elsewhere.

That's an odd way of phrasing things. If Wikipedia were to take away free access to their data, Google wouldn't be dropping Wikipedia, Wikipedia would be dropping Google. This line of thinking "you took this when I was giving it away for free, but now I want to charge for it, so you are expected to keep paying for it" is incorrect.

Re:Only Google is really allowed to crawl the web by zdragnar on Friday March 26, 2021 @03:59PM (#26596261)
Given the scale that google already operates at, I don't doubt that they would just take a copy of thr content and rebrand it as a google service, complete with user contribution.

Then, after two or five years, let it fester then abandon it. Nobody gets promoted for keeping well oiled machines running.

Re:Only Google is really allowed to crawl the web by dmitriid on Friday March 26, 2021 @05:44PM (#26597331)
Remember Knol? https://en.wikipedia.org/wiki/Knol?wprov=sfti1

It was actually good for writing stuff when I tried it. Never brought in enough traffic. Killed.