News for hackers. Stuff that matters.
Re:MemGPT – LLMs with self-editing memory for unbounded context by amelius on Monday October 16, 2023 @06:55PM (#37907806)
Regarding the vanishing gradient problem, has anyone tried to train using only a randomly chosen set of independent parameters in each iteration? (Updating only the weights in a small random independent set).
Re:MemGPT – LLMs with self-editing memory for unbounded context by jdthedisciple on Tuesday October 17, 2023 @02:49AM (#37911448)