News for hackers. Stuff that matters.

A comment on Show HN: Open-source search engine with 2bn-page index. Parent comment

Re:Show HN: Open-source search engine with 2bn-page index by jahewson on Tuesday September 13, 2016 @01:14PM (#12490285)
If you're looking for an open source web crawl, commoncrawl.org has billions of pages.
[ Parent | on HN ]
Re:Show HN: Open-source search engine with 2bn-page index by greglindahl on Tuesday September 13, 2016 @08:17PM (#12493340)
... and Common Search made an index of the homepages, too.
[ Parent | on HN ]