News for hackers. Stuff that matters.
Re:Only Google is really allowed to crawl the web by lelanthran on Friday March 26, 2021 @05:55PM (#26597446)
> And I don't think Google will realize what the problem is until they start accidentally killing off large swaths of the actual sources of this content by taking the audience away.

What makes you think they care? Killing off the sources of content might even be there goal. If they kill off sources of content, they'd be more than happy to create an easier-to-datamine replacement.

Hypothetically, if they killed off wikipedia, they are best placed to use the actual wikipedia content[1] in a replacement, which they can use for more intrusive data-mining.

Google sells eyeballs to advertisers; being the source of all content makes them more money from advertisers while making it cheaper to acquire each eyeball.

[1] AFAIK, wikipedia content is free to reuse.

Re:Only Google is really allowed to crawl the web by tyingq on Friday March 26, 2021 @09:04PM (#26598855)
I'm not suggesting it's illegal. There are a great many practices that are legal that I dislike.