Re:RAG at scale: Synchronizing and ingesting billions of tex...
by vimota on Tuesday October 10, 2023 @09:26PM
(#37839913)
Similar to you, for polling you only see new data not the deletion events so I can't delete embeddings unless I keep track of state and do a diff. To properly support that you/I would need effectively CDC, which gets more complex for arbitrary / self-serve databases.
[ Parent
| on HN ]
There are no comments on this comment yet.