News for hackers. Stuff that matters.
Re:An almost-complete list of LLMOps tools for developers by janalsncm on Friday August 11, 2023 @02:58AM (#37085896)
For vector search I noticed most of the names I’ve heard about in the past missing. Faiss, Annoy, hnswlib, vespa. Hell, if you have less than a a million vectors you can probably even just use the sentence transformers lib: https://www.sbert.net/examples/applications/semantic-search/...

Optimize for retrieval metrics first, then speed. Recall and coverage. If those suck, it’s because your embeddings are trash and it won’t matter how fast you serve them.

Re:An almost-complete list of LLMOps tools for developers by jkb79 on Friday August 11, 2023 @06:07AM (#37086949)
Very good point, plus that if you introduce approximate search instead of exact search, you can only loose quality and in some cases the loss is so significant that it becomes worse than plain simple techniques.
Re:An almost-complete list of LLMOps tools for developers by gaocegege on Saturday August 12, 2023 @12:25AM (#37097047)
Yeah, I think in many cases you just need a vector search lib, instead of a DB.

And in some other cases, you may want postgres vector extension e.g. https://github.com/tensorchord/pgvecto.rs instead of a specialized vector db.

Re:An almost-complete list of LLMOps tools for developers by lagrange77 on Friday August 11, 2023 @07:35AM (#37087518)
This cambrian explosion is crazy.
Re:An almost-complete list of LLMOps tools for developers by budadre75 on Saturday August 12, 2023 @12:01PM (#37101534)
I want to build a LLM that can look through my own documents, what tools do I need here?
Re:An almost-complete list of LLMOps tools for developers by kerzs on Saturday August 12, 2023 @12:30PM (#37101804)
https://github.com/khoj-ai/khoj

might be a good place to start