How can you emulate learning when LLMs have no way to update their weights? LLMs don't even know what they do and don't know (hence hallucinations), so how would they even realize that something was new in the first place?
I could maybe see chatbots storing everything you ever said in a vector database for future lookup, but that's just memory.
Re:Claude's Character
by falcor84 on Monday June 10, 2024 @08:19PM
(#40640863)
There's nothing stopping you as an LLM system designer from having it "go to sleep" once a day and use that downtime to consolidate the memory in the vector database into fine-tuning of the weights.
I could maybe see chatbots storing everything you ever said in a vector database for future lookup, but that's just memory.