Startpage – private search engine

Re:Startpage – private search engine by greglindahl on Sunday January 29, 2017 @03:30PM (#13516420)

All of the things that look like search engines get their results from Google, Bing, or (occasionally) Yandex. Building your own big search index is not something you can raise $1 million and just go do.

[ Parent | on HN ]

Re:Startpage – private search engine by deusu on Sunday January 29, 2017 @03:48PM (#13516546)

You can do your own search-index with 2.3 billion pages for about €300/month:

https://deusu.org

[ Parent | on HN ]

Re:Startpage – private search engine by greglindahl on Sunday January 29, 2017 @06:11PM (#13517374)

I think your project is great for how it does so much with so few resources, but most big search engines have an index which is more than 1,000X as large as yours (per document), in order to improve results.

[ Parent | on HN ]

Re:Startpage – private search engine by pbhjpbhj on Monday January 30, 2017 @05:50AM (#13520030)

>Building your own big search index ... //

The guy who started DDG [https://news.ycombinator.com/user?id=epi0Bauqu] shared a lot of his solo search engine creation here. At one point at least he was running his own crawlers/index (but not IIRC exclusively). It might be instructive to search over past posts and find the details.

I don't think he was using anything like $1 million as, again IIRC, it was self funded. But this was a few years (10?) ago now.

[ Parent | on HN ]

Re:Startpage – private search engine by AznHisoka on Sunday January 29, 2017 @06:43PM (#13517552)

Moz, ahrefs , majestic.. They all have built their own search index. It's not trivial but it's not Google-hard either.

[ Parent | on HN ]

Re:Startpage – private search engine by greglindahl on Sunday January 29, 2017 @06:47PM (#13517572)

All of these provide lists of backlinks. That's a bit different from providing high-quality search results. Also, I don't think that any of them have a budget as small as $1 million.

[ Parent | on HN ]