Re:Show HN: Open-source search engine with 2bn-page index
by hyperpape on Tuesday September 13, 2016 @09:32AM
(#12488017)
Interesting that if this were a parsing problem (i.e. https://news.ycombinator.com/item?id=12478538), folks would immediately suggest accepting known good output, instead of trying to blacklist specific problems. The analogue in search would be something that looks more like a directory than an internet wide search engine.
Of course what killed directories in the early web is that they had no hope of scaling.
Of course what killed directories in the early web is that they had no hope of scaling.