Re:Accidental prompt injection against RAG applications
by simonw on Thursday June 06, 2024 @01:12PM
(#40599878)
Ooh that's an interesting idea.
Another way to do this could be to calculate the "average" of all of the embeddings of documents in the index, then try to figure out if the query embeds to a point that's a significant distance from that average. Maybe figure out that distance through experimentation?
Another way to do this could be to calculate the "average" of all of the embeddings of documents in the index, then try to figure out if the query embeds to a point that's a significant distance from that average. Maybe figure out that distance through experimentation?