Memorilla: Latent Semantic Memory for LLMs

Re:Memorilla: Latent Semantic Memory for LLMs by NaiveEmpiricist on Friday November 06, 2026 @03:55PM (#50398396)

It looks like another difference with RAGs is that instead of reranking the doc vectors and taking the top 5 or so, this paper mixes all the docs (weighted by relevance) into a fixed number of "memory tokens".

It looks like this helps avoid a problem I've had with RAG - when a fact isn't local to a single patch of text.

[ Parent | on HN ]

Re:Memorilla: Latent Semantic Memory for LLMs by CharlieDigital on Friday November 06, 2026 @05:37PM (#50399431)

    > ...a problem I've had with RAG - when a fact isn't local to a single patch of text

Is this a problem, though? Vector similarity should surface the relevant, related patches.

[ Parent | on HN ]

Re:Memorilla: Latent Semantic Memory for LLMs by mastry on Friday November 06, 2026 @06:56PM (#50400161)

But only in documents that make it through RAG’s hard cutoff. There’s an explanation of this on the related Stanford site at https://memory.stanford.edu/ (see “How MEMORILLA differs from RAG”)

[ Parent | on HN ]