News for hackers. Stuff that matters.
Re:Common Crawl by neura on Friday March 26, 2021 @04:44PM (#26596710)
This... I couldn't get past the irony of the comment. Basically, the problem is that sites only let google and friends index them. The solution? Site should only send index data to google and friends.

I mean, I get it, then sites can send to any number of indexers, but let's be honest, like you say, any new search engine has to get sites to push data out to them. That's just not. going. to. happen.

There are no comments on this comment yet.