Re:Embeddings are a good starting point for the AI curious a...
by _bramses on Thursday April 18, 2024 @02:19AM
(#40073477)
neat! one thing i’d really love tooling for: supporting multi user apps where each has their own siloed data and embeddings. i find myself having to set up databases from scratch for all my clients, which results in a lot of repetitive work. i’d love to have the ability one day to easily add users to the same db and let them get to embedding without having to have any knowledge going in
[ Parent
| on HN ]
Re:Embeddings are a good starting point for the AI curious a...
by kiwicopple on Thursday April 18, 2024 @03:22AM
(#40073801)
This is possible in supabase. You can store all the data in a table and restrict access with Row Level Security
You also have various ways to separate the data for indexes/performance
- use metadata filtering first (eg: filter by customer ID prior to running a semantic search). This is fast in postgres since its a relational DB
- pgvector supports partial indexes - create one per customer based on a customer ID column
- use table partitions
- use Foreign Data Wrappers (more involved but scales horizontally)