Show HN: Claude Memory – Long-term memory for Claude

Re:Show HN: Claude Memory – Long-term memory for Claude by imranq on Thursday September 05, 2024 @04:06PM (#41459994)

Nice. I think in the future this could be way better if everything was local and didn't require a API key. As far as I can tell mem0 is a fancy retrieval system. It could probably work pretty well locally with simpler models

[ Parent | on HN ]

Re:Show HN: Claude Memory – Long-term memory for Claude by deshraj on Thursday September 05, 2024 @04:31PM (#41460167)

Yes, you can run Mem0 locally since we have open sourced it but would need some more work to have a server up and running to be able to interact with Claude. GitHub: https://github.com/mem0ai/mem0

[ Parent | on HN ]

Re:Show HN: Claude Memory – Long-term memory for Claude by Eisenstein on Thursday September 05, 2024 @05:11PM (#41460444)

I think you misunderstood what the parent commenter meant. I believe they were talking about running the AI locally, like with llamacpp or koboldcpp or vllm.

I checked your documentation and the only way I can find to run mem0 is with a hosted model. You can use the OpenAI API, which many local backends can support, but I don't see a way to point it at localhost. You would need to use an intermediary service to intercept OpenAI API calls and reroute them to a local backend unless I am missing something.

[ Parent | on HN ]

Re:Show HN: Claude Memory – Long-term memory for Claude by deshraj on Thursday September 05, 2024 @05:15PM (#41460473)

Ah I see. We do support running Mem0 locally with Ollama. You can checkout our docs here: https://docs.mem0.ai/examples/mem0-with-ollama

[ Parent | on HN ]