News for hackers. Stuff that matters.

Neural search library in Python for medium-sized corpora

https://github.com/raphaelsty/cherche

Cherche (search in French) allows you to create a neural search pipeline using retrievers and pre-trained language models as rankers. Cherche is meant to be used with small to medium sized corpora. Cherche's main strength is its ability to build diverse and end-to-end pipelines.

( 4 comments | 4 points | on HN )
Re:Neural search library in Python for medium-sized corpora by fermigier on Sunday January 09, 2022 @06:26AM (#29862335)
Interesting.

1) Why do you need both lunr and elasticsearch as dependencies?

2) You shouldn't pin the exact versions of your dependencies in setup.py. Otherwise it makes it very hard to integrate.

Re:Neural search library in Python for medium-sized corpora by raphaelty on Sunday January 09, 2022 @10:57AM (#29864352)
Hi,

1) The dependency on the Elasticsearch python client allows Elasticsearch to be used as a retriever. The same goes for Lunr. It might be interesting to separate the different dependencies.

2) Of course I'll update it.

Re:Neural search library in Python for medium-sized corpora by antman on Saturday January 08, 2022 @08:14AM (#29851355)
It is better if you submit and put your text as a comment. How do you define mid sized corpora? Comparison with other solutions?
Re:Neural search library in Python for medium-sized corpora by raphaelty on Sunday January 09, 2022 @10:50AM (#29864267)
I'm more used to reading than posting on Hacker News. I'll do better next time. :)