News for hackers. Stuff that matters.
Re:Show HN: Open-source search engine with 2bn-page index by amirouche on Tuesday September 13, 2016 @01:33PM (#12490475)
Did you think about database dump of popular services like HN, SO or Wikipedia to speed up crawling and revelance?
Re:Show HN: Open-source search engine with 2bn-page index by deusu on Tuesday September 13, 2016 @01:41PM (#12490541)
Yes. I have downloaded several data dumps, but haven't gotten around to import them yet.