Re:Letta: Letta is a framework for creating LLM services wit...
by jxjnskkzxxhx on Saturday March 08, 2025 @04:55AM
(#43298902)
What's an "LLM with memory"? Is it an agent that knows how to insert into, and query, a database?
[ Parent
| on HN ]
Re:Letta: Letta is a framework for creating LLM services wit...
by pacjam on Saturday March 08, 2025 @12:53PM
(#43301992)
In Letta that's referring to an LLM agent that has persistent memory (eg keep running the agent far beyond its context window limit, but maintain some persistent state to avoid derailment / enable indefinite use / learning over long horizons).
If you implement this persistent memory via tool use, then it's related to inserting/querying databases, because some agent has to read/write to a data store (potentially backed by a database) to maintain memories.
-charles from letta