News for hackers. Stuff that matters.
Re:Storing OpenAI embeddings in Postgres with pgvector by txtai on Monday February 06, 2023 @06:13PM (#34685922)
You might want to check out txtai (https://github.com/neuml/txtai). It's default configuration is a FAISS index paired with a SQLite database for filtering.

Also worth mentioning that there are plenty of other vector models to try outside of OpenAI. Many open-source and much smaller than 1536 dimensions. Check out the Hugging Face Hub (https://hf.co/models). For example this model (https://huggingface.co/sentence-transformers/all-MiniLM-L6-v...) works great in many cases and is only 384 dimensions. Runs great locally and is FOSS.

There are no comments on this comment yet.