Re:Internal representations of LLMs encode information about...
by stoniejohnson on Wednesday October 30, 2024 @04:06PM
(#41999617)
While those are good reasons to keep the weights static from a business perspective, they are not the only reasons, especially when serving SOTA models at the scale of some of the major shops today.
Continual/online learning is still an area of active research.
Continual/online learning is still an area of active research.