News for hackers. Stuff that matters.

Ask HN: Seeking advice on open source end user distributed vector database

Hello Everyone,

I'm developing an open-source vector search engine for macOS. The project involves creating a Swift client app that operates a decentralized vector database, such as Milvus, which can be made publicly accessible via the vector db network.

Initially, we'll support the network through hosted Milvus instances. As we advance, we aim to transition to a user-driven model where app users host nodes on their systems, activated only during network search requests.

I'm reaching out for guidance on integrating Milvus into my Swift application and ensuring effective network communication. Any advice, resources, or suggestions would be greatly appreciated.

Thank you for your time and potential contributions.

( 3 comments | on HN )
Re:Ask HN: Seeking advice on open source end user distribute... by tomhamer on Sunday July 16, 2023 @08:07PM (#36752665)
Marqo will generate embeddings for you as well as run on a mac/in the cloud. https://github.com/marqo-ai/marqo
Re:Ask HN: Seeking advice on open source end user distribute... by andre-z on Monday July 17, 2023 @02:45AM (#36754880)
Qdrant, is the most popular, high-performance native vector db, written in Rust

https://github.com/qdrant/qdrant

(disclaimer: part of the team)

Re:Ask HN: Seeking advice on open source end user distribute... by akshayshinde7 on Monday July 17, 2023 @07:13AM (#36756560)
I've been looking at quadrant for a while. But I'm unable to understand the following

1. Can I package it inside a swift app? 2. Can I scale it decent rally using a network of peer-to-peer nodes?