Ask HN: In-Browser Vector DB?
I'm looking to develop a retriever-augmented LLM Q&A app that will call out to an API for the LLM (this will be the only allowed type of API call [other than a fileserver], it's internal and no data can leave the firewall). I plan to ship the chunked, preprocessed document store as embeddings with the app (~100MB, can be read as files from a fileserver).
Is there any way to ship a vector DB implementation in-browser?
Other research:
* I know that Chroma can use DuckDB under the hood, and DuckDB has a WASM port, but Chroma itself doesn't?
* Weaviate and Qdrant do not have a WASM target?
(
6 comments
| 2 points
| on HN
)
For this enterprise use-case, I am looking to ship a web app that will run off of IT-managed fileservers and IT-managed LLM APIs, on user desktops and laptops without privileged access to install software.