Re:Show HN: Open-source search engine with 2bn-page index
by outpan on Tuesday September 13, 2016 @05:57PM
(#12492611)
Awesome job!
For the life of me I can't figure out how you manage to crawl over a billion web pages (even in 2-3 months), index the data and run the server with €300 per month. Especially the crawler part...
For the life of me I can't figure out how you manage to crawl over a billion web pages (even in 2-3 months), index the data and run the server with €300 per month. Especially the crawler part...