News for hackers. Stuff that matters.

A comment on Two Upstart Search Engines Are Teaming Up to Take on Google. Parent comment

Re:Two Upstart Search Engines Are Teaming Up to Take on Google by LunaSea on Wednesday November 13, 2024 @08:43AM (#42126021)
A single CommonCrawl dump might be 100TB but that represents less than 1% of the Internet. CommonCrawl crawls news parts of the Internet every month / trimester and there is little overlap between crawl dumps.
[ Parent | on HN ]

There are no comments on this comment yet.