Vald: A Highly Scalable Distributed Vector Search Engine

Re:Vald: A Highly Scalable Distributed Vector Search Engine by rkt08 on Friday April 09, 2021 @09:15AM (#26750132)

Any search domain is good for vector search if your method for producing vectors is good! Seems like it should be possible with Recipes.Are you performing search based on recipe text? It shouldn't take long to try out a simple POC with standard text embedding models like (Glove,BERT etc) and observe vectors via tSNE or just using a vector index.

PS: I work at Pinecone and you can see if any of the examples here help you : https://www.pinecone.io/docs/examples/

[ Parent | on HN ]

Re:Vald: A Highly Scalable Distributed Vector Search Engine by jka on Friday April 09, 2021 @09:27AM (#26750272)

The vectors I have in mind could include (or perhaps be inferred from) recipe text, but they may also include things like nutritional content and corresponding freshest-in-kitchen-ingredients (maybe an ingredient x time-since-purchase vector?) to nearest-match-recipes.

The examples are helpful and well documented, thank you. I'd mention that I'm constraining the technology options to self-hostable and FLOSS software, and with a strong bias towards concepts that are already well-understood by most software engineers, but I'll keep a look out for Pinecone.

[ Parent | on HN ]

Re:Vald: A Highly Scalable Distributed Vector Search Engine by rkt08 on Friday April 09, 2021 @12:15PM (#26752420)

That is definitely an interesting use case. You can look for methods that combine multiple vectors to create a combined vector or you may want to filter on metadata and vectors both. Who knows maybe you might be able to come with something very unique for your example!

[ Parent | on HN ]