News for hackers. Stuff that matters.
Re:Letta: Letta is a framework for creating LLM services wit... by jxjnskkzxxhx on Saturday March 08, 2025 @04:55AM (#43298902)
What's an "LLM with memory"? Is it an agent that knows how to insert into, and query, a database?
Re:Letta: Letta is a framework for creating LLM services wit... by blooalien on Saturday March 08, 2025 @05:04AM (#43298941)
Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:53PM (#43301992)
In Letta that's referring to an LLM agent that has persistent memory (eg keep running the agent far beyond its context window limit, but maintain some persistent state to avoid derailment / enable indefinite use / learning over long horizons).

If you implement this persistent memory via tool use, then it's related to inserting/querying databases, because some agent has to read/write to a data store (potentially backed by a database) to maintain memories.

-charles from letta