Re:MemGPT: Towards LLMs as Operating Systems
by pacjam on Monday October 16, 2023 @02:33AM
(#37896486)
Thanks for your feedback @skrebbel. We called it MemGPT - in reference to teaching LLMs how to manage their own memory hierarchy. The idea and title evolved when we realized we were teaching the LLM to read/write, and this enabled perpetual chatbots, doc QA, etc. Various capabilities by a few simple abstractions, inspired by the original unix paper's 4 key abstractions - read/write/open/close. Further, in the title we say "Towards", indicating a qualified step in that direction.
[ Parent
| on HN ]
Re:MemGPT: Towards LLMs as Operating Systems
by __void on Monday October 16, 2023 @02:49AM
(#37896553)
still this is not an "operating system" nor does it in any way related to them;
please use the right words when you have to communicate, otherwise you just sound like scammers who want to sell pots with holes by passing them off as colanders
Re:MemGPT: Towards LLMs as Operating Systems
by skrebbel on Monday October 16, 2023 @02:49AM
(#37896558)
Perpetual chatbots are a super cool achievement but I fail to see how that resembles an OS, a thing that handles files and lets you run programs, in any way. If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention. It seems to me that limited context windows are one of the key roadblocks to wider real-world LLM applicability, beyond demos that do well on Twitter I mean.
Re:MemGPT: Towards LLMs as Operating Systems
by selestify on Monday October 16, 2023 @05:11AM
(#37897361)
> If MemGPT is as spectacular as you suggest then I think an honest, down to earth title would have gotten you a lot more attention.
The fact that the current title got onto the HN front page suggests otherwise when it comes to incentives for picking submission titles.
Re:MemGPT: Towards LLMs as Operating Systems
by abdellah123 on Monday October 16, 2023 @02:59AM
(#37896612)
> we were teaching the LLM to read/write
Very interesting.
Re:MemGPT: Towards LLMs as Operating Systems
by ludwik on Monday October 16, 2023 @03:00AM
(#37896617)
I think a title like "MemGPT: Operating System inspired memory management for LLMs" would be okay. The current title makes it seem as if you are building an OS based on the LLM technology, which is quite misleading.