Re:Ask HN: How difficult is a search engine MVP that just wo...
by bluu00 on Tuesday September 29, 2020 @12:23PM
(#24629757)
> gorillafind.com
Interesting. (゚ヮ゚) You seem to know well that search is beyond ranking and retrieval. [1]
> I’d start off with not doing state of the art because it’s overkill for an “MVP”.
Can a search engine "MVP" sustain without using sota methods/practices?
What should be the initial scale for a search MVP for which it just works? In the modern realm.
[1] : https://medium.com/startup-grind/what-every-software-enginee...
just a note (you can ignore) : I am actually a believer of iterations in development and incremental optimisations. But even a minimum viable product should be able to work.
I’d start off with not doing state of the art because it’s overkill for an “MVP”. And if you don’t need proper browser rendering of pages, there’s open source crawlers out there like Nutch that might work. If you’re making one yourself, the outdated academic papers and presentations by search companies are a good resource as the basic ideas of crawling and indexing haven’t changed too much (even if ranking and other components have changed a lot). A search engine is really a set of related components and there are many examples out there to use as inspiration for your MVP.