News for hackers. Stuff that matters.
Re:Letta: Letta is a framework for creating LLM services wit... by jxjnskkzxxhx on Saturday March 08, 2025 @04:55AM (#43298902)
What's an "LLM with memory"? Is it an agent that knows how to insert into, and query, a database?
Re:Letta: Letta is a framework for creating LLM services wit... by blooalien on Saturday March 08, 2025 @05:04AM (#43298941)
Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:53PM (#43301992)
In Letta that's referring to an LLM agent that has persistent memory (eg keep running the agent far beyond its context window limit, but maintain some persistent state to avoid derailment / enable indefinite use / learning over long horizons).

If you implement this persistent memory via tool use, then it's related to inserting/querying databases, because some agent has to read/write to a data store (potentially backed by a database) to maintain memories.

-charles from letta

Re:Letta: Letta is a framework for creating LLM services wit... by rcarmo on Saturday March 08, 2025 @05:35AM (#43299098)
I find it somewhat amusing that Lethe was the river of forgetfulness, and that the new name for the project is so close to that.
Re:Letta: Letta is a framework for creating LLM services wit... by teleforce on Saturday March 08, 2025 @07:39AM (#43299760)
Thanks for the info, never heard of Lethe before [1].

Fun facts in Arabic, "insan" meaning human being or mankind. This word takes its root from the word "nisyan", which literally means “forgetfulness”.

[1] Lethe:

https://en.wikipedia.org/wiki/Lethe

[2] Arabic for forgetfulness:

https://arabic.fi/words/3766

Re:Letta: Letta is a framework for creating LLM services wit... by andsoitis on Saturday March 08, 2025 @10:26AM (#43300926)
> This word takes its root from the word "nisyan", which literally means “forgetfulness”.

There are two linguistic theories: the one you mention, and the other which is from “uns” (أنس) which means “companionship” or “affection.”

While both explanations have historical significance, the stronger linguistic evidence points to the latter explanation (companionship or sociability) by Classical Arabic linguists. The former (forget) is a more recent interpretation linked to philosophical and theological discussions rather than libguistic roots.

Re:Letta: Letta is a framework for creating LLM services wit... by Xmd5a on Sunday March 09, 2025 @10:39AM (#43309378)
Man, mind, to remain, to remind: they all originate from the same intertwined proto-indo-european roots "men" (thinking) and "mon/man" (human).

Edit: just found this etymological trail for insan:

>From Proto-Semitic *ʔināš- (“man, person”). Has the form of a verbal noun , as if from أَنِسَ (ʔanisa, “to sense (visually or auditorily)”).

Re:Letta: Letta is a framework for creating LLM services wit... by chrisvalleybay on Saturday March 08, 2025 @08:21AM (#43300048)
I didn't find any thing on Letta and MCP. Any thoughts on integrating MCP into the platform?
Re:Letta: Letta is a framework for creating LLM services wit... by anon373839 on Saturday March 08, 2025 @09:17AM (#43300432)
Totally serious question: is MCP basically an in-joke right now? I mean, I know what it is. I just don’t know why I’m seeing it everywhere in the last 3 days?
Re:Letta: Letta is a framework for creating LLM services wit... by chrisvalleybay on Saturday March 08, 2025 @09:29AM (#43300512)
Probably people are excited about the prospect of having this problem be solved so that we can focus more on getting the agents to work rather than all be reimplementing the same data fetchers/parsers etc.
Re:Letta: Letta is a framework for creating LLM services wit... by anon373839 on Saturday March 08, 2025 @09:41AM (#43300609)
Sure, but I mean why so suddenly? This has been out a while...
Re:Letta: Letta is a framework for creating LLM services wit... by _neil on Saturday March 08, 2025 @10:50AM (#43301101)
I think it’s just reached critical mass (and has been picked up by the hype peddlers). It’s been gaining momentum for months.
Re:Letta: Letta is a framework for creating LLM services wit... by Fabricio20 on Saturday March 08, 2025 @11:20AM (#43301292)
Interesting question, I personally first saw it because jetbrains now has a plugin for it on all their IDEs.
Re:Letta: Letta is a framework for creating LLM services wit... by imtringued on Saturday March 08, 2025 @09:28AM (#43300507)
Maybe this will help you figure it out:

https://github.com/modelcontextprotocol/servers

Re:Letta: Letta is a framework for creating LLM services wit... by yard2010 on Saturday March 08, 2025 @01:36PM (#43302325)
Thank you for the mind-blowing 2 hr rabbit hole. I'm going to use this in my personal helper bot.
Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:48PM (#43301939)
I'm also not really sure what's going on with the hype wave atm (people like having things to hype?) since MCP has also been around for a bit, seems like a bit of a meme.

IMO, the main value (as an agent / AI developer) that you get from MCP is another style of tool repository. Similar to how it's nice to have pre-made tools (eg Composio), MCP servers are another repo of tools to pull from (you just need to add MCP client functionality to your agent loop). So if a ton of energy is going into building MCP servers, might as well add MCP client support so that you can take advantage of the additional tools.

-charles from letta

Re:Letta: Letta is a framework for creating LLM services wit... by irickt on Saturday March 08, 2025 @01:12PM (#43302134)
Tangential cultural reference ...

  https://en.wikipedia.org/wiki/List_of_Tron_characters#Master_Control_Program

  The Master Control Program (MCP) ... is the main digital antagonist of the first Tron film.
Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:45PM (#43301912)
We're working on it, I'm hoping we can get an integration in sometime next week! If you want to track progress on it would recommend joining our Discord.

To clarify - by "it", I mean making Letta agents an MCP client, so that you can easily connect to MCP servers as tools (not the other way around, where Letta itself is an MCP server - if you want that, someone in the community already made one: https://github.com/oculairmedia/Letta-MCP-server)

-charles from letta

Re:Letta: Letta is a framework for creating LLM services wit... by redwood on Saturday March 08, 2025 @08:30AM (#43300108)
This was the berkeley team that previously released MemGPT
Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:49PM (#43301950)
indeed - hello there
Re:Letta: Letta is a framework for creating LLM services wit... by dangbeetle on Saturday March 08, 2025 @12:40PM (#43301879)
My father is suffering from increasingly bad short term memory. This has been a slow process that has taken many decades. My mom was worried about his memory 20 years ago. Now he lives alone and has nobody to help remind him of things.

He is highly functional, able to multiply two digit numbers in his head and run heavy equipment on his farm. But he'll ask you the same question, five minutes after he asked it the last time. He'll forget what neighbor just visited him the day before, or whether he called the gas company to refill his propane barrel.

I believe that a voice interactive LLM with memory could be extremely helpful to him and to other elderly people. He could use it as a daily log, telling it things that have occurred, and then interrogate it later. In truth, who among us could not benefit from such a system, even in our younger years?

This framework looks interesting to use for such a project. Are there any other people working on similar things?

Re:Letta: Letta is a framework for creating LLM services wit... by pacjam on Saturday March 08, 2025 @12:42PM (#43301894)
> "voice interactive LLM with memory"

Our team has been working really hard on a low-latency voice integration that enables (open source) "advanced voice mode", but with long-term memory!

If you're interested definitely hop in our Discord to keep track of dev progress (you can also monitor our docs). It's all OSS of course, so you can use it with any model you want and run it all locally (your agent data stays on device).

Once available you can definitely use Letta for this usecase - basically provision a stateful Letta agent for your dad, with instructions / prompting that your dad has memory loss issues, and the agent should be proactive in recording memories (and potentially jogging your dad's memory too). All the memory/state will be stored in postgres, so you can expose it to other tools as well, eg could even collate the memories into a nextjs/mobile app where you dad can browse them.

-charles from letta