News for hackers. Stuff that matters.
Re:ZincSearch – lightweight alternative to Elasticsearch wri... by francoismassot on Thursday September 22, 2022 @11:03AM (#32939831)
(disclaimer: I'm one of the cofounder of Quickwit.io, we are doing log search)

(edited to add vector search category and add manticore)

When looking at OSS search projects, it's nice to have a rough ideas of the different use cases, here is the list I have in mind:

- user facing search (think algolia): elasticsearch[1]/opensearch[2], meilisearch[3], typesense[4]

- enterprise search: elasticsearch/opensearch

- log search: elasticsearch/opensearch, loki[5], quickwit[6], zincsearch[7]

- vector search: Milvus[8], Qdrant[9], Vald[10] Weaviate[11]

Vespa.ai[12] is great but I don't really know in which category to put them, user facing and enterprise search seems to work well with them.

It's interesting to note that Elasticsearch and Opensearch are general purpose search engine, Solr as well. They are all powered by Lucene, the popular and performant search engine library.

Another general purpose search engine is Manticore search[13].

I would love to see some benchmarks by category :)

Note: I don't know well ZincSearch and put it in the log search as said on their front page.

[1]: https://github.com/elastic/elasticsearch

[2]: https://github.com/opensearch-project/OpenSearch

[3]: https://github.com/meilisearch/meilisearch/

[4]: https://github.com/typesense/typesense

[5]: https://github.com/grafana/loki

[6]: https://github.com/quickwit-oss/quickwit

[7]: https://github.com/zinclabs/zinc

[8]: https://github.com/milvus-io/milvus

[9]: https://github.com/qdrant/qdrant

[10]: https://github.com/vdaas/vald

[11]: https://github.com/semi-technologies/weaviate

[12]: https://github.com/vespa-engine/vespa

[13]: https://github.com/manticoresoftware/manticoresearch

Re:ZincSearch – lightweight alternative to Elasticsearch wri... by snikolaev on Thursday September 22, 2022 @11:37AM (#32940422)
> It's interesting to note that Elasticsearch and Opensearch are general purpose search engine, Solr as well. They are all powered by Lucene, the popular and performant search engine library.

Another search engine which can be considered general, is not based on Lucene and is not less powerful than Elasticsearch/Solr is Manticore Search [1]

[1]: https://github.com/manticoresoftware/manticoresearch

> I would love to see some benchmarks by category :)

I'd love too. We started this work on db-benchmarks [2] , hopefully we'll have resources to continue it. Contributions are very welcome. It's 100% opensource [3]

[2]: https://db-benchmarks.com/ [3]: https://github.com/db-benchmarks/db-benchmarks

Re:ZincSearch – lightweight alternative to Elasticsearch wri... by jabo on Thursday September 22, 2022 @12:12PM (#32940990)
I would put Vespa and also Weaviate in a new category called "Vector Search".

We're also actively working on adding Vector search to Typesense: https://news.ycombinator.com/item?id=32851894

Re:ZincSearch – lightweight alternative to Elasticsearch wri... by fzliu on Thursday September 22, 2022 @12:41PM (#32941371)
As an Yahoo internal project, Vespa actually started out very similar to Elastic in that it was meant for fast text search. The team then added ANN search capabilities later on.

Vector search infrastructure is overall still fairly new (https://milvus.io/docs/text_search_engine.md), but up and coming for sure. Disclaimer: I'm a part of the Milvus community.

Re:ZincSearch – lightweight alternative to Elasticsearch wri... by andre-z on Thursday September 22, 2022 @12:25PM (#32941184)
Right, it's a separate category. There are also Vald, Milvus and Qdrant https://github.com/qdrant/qdrant
Re:ZincSearch – lightweight alternative to Elasticsearch wri... by drcongo on Thursday September 22, 2022 @11:50AM (#32940647)
I've worked with MeiliSearch a little and found it to be a great experience - the exact opposite of working with Elasticsearch.
Re:ZincSearch – lightweight alternative to Elasticsearch wri... by rsdbdr203 on Thursday September 22, 2022 @12:17PM (#32941047)
No Splunk[1]? They're the defacto enterprise log platform.

[1]: https://www.splunk.com/

Re:ZincSearch – lightweight alternative to Elasticsearch wri... by francoismassot on Thursday September 22, 2022 @12:23PM (#32941146)
Yes Splunk is well known of course, I restricted myself to OSS projects.