Re:PMET: Precise Model Editing in a Transformer
by jpfed on Monday August 28, 2023 @12:24PM
(#37296562)
The most promising work along these lines centers around augmenting LLMs with an external data store ("retrieval-augmented LLM"s). I think this started with Facebook's KNN-LLM ( https://arxiv.org/pdf/1911.00172.pdf ). Legal conflict may force the industry to move towards vector DBs as the predominant method by which facts are "stored" rather than model parameters ( https://arxiv.org/pdf/2308.04430.pdf ) , with the happy side effect of update-ability over time.
[ Parent
| on HN ]
There are no comments on this comment yet.