Re:Gemini Embedding: Powering RAG and context engineering
by stillpointlab on Thursday July 31, 2025 @02:33PM
(#44748661)
> the embeddings can be reused by the model
I can't find any evidence that this is possible with Gemini or any other LLM provider.
Re:Gemini Embedding: Powering RAG and context engineering
by yazaddaruvala on Thursday July 31, 2025 @02:42PM
(#44748743)
Yeah given what your saying is true and continues to be,
Seems the embeddings would just be useful for a “nice corpus search” mechanism for some regular RAG.
Re:Gemini Embedding: Powering RAG and context engineering
by ivape on Thursday July 31, 2025 @07:56PM
(#44751573)
LLMs can’t take embeddings (unless I’m really confused). Even if it could take embeddings, the embeddings would have lost all word sequence and structure (wouldn’t make sense to the LLM).
Re:Gemini Embedding: Powering RAG and context engineering
by d4rkp4ttern on Friday August 01, 2025 @06:53AM
(#44755168)
This can’t be what they mean. Even if this was somehow possible, Embeddings lose information and are not reversible, I.e embeddings do not magically compress actual text into a vector in a way that a model can implicitly recover the source text from the vector.
I believe this is what they mean.
In practice, how fast will the model change (including tokenizer)? how fast will the vector db be fully backfilled to match the model version?
That would be the “cache hit rate” of sorts and how much it helps likely depends on some of those variables for your specific corpus and query volumes.