Re:MemGPT – LLMs with self-editing memory for unbounded context
by amelius on Monday October 16, 2023 @06:55PM
(#37907806)
Regarding the vanishing gradient problem, has anyone tried to train using only a randomly chosen set of independent parameters in each iteration? (Updating only the weights in a small random independent set).
[ Parent
| on HN ]
Re:MemGPT – LLMs with self-editing memory for unbounded context
by jdthedisciple on Tuesday October 17, 2023 @02:49AM
(#37911448)
Are you referring to Regularization?
https://www.kaggle.com/code/sid321axn/regularization-techniq...