News for hackers. Stuff that matters.

A comment on Internal representations of LLMs encode information about truthfulness. Parent comment

Re:Internal representations of LLMs encode information about... by ben_w on Wednesday October 30, 2024 @03:11PM (#41999019)
The main reason for keeping AI static is to allow them to be certified or rolled back (and possibly that the companies can make more money selling fine tuning) — it's not an innate truth of the design or the maths.
[ Parent | on HN ]
Re:Internal representations of LLMs encode information about... by stoniejohnson on Wednesday October 30, 2024 @04:06PM (#41999617)
While those are good reasons to keep the weights static from a business perspective, they are not the only reasons, especially when serving SOTA models at the scale of some of the major shops today.

Continual/online learning is still an area of active research.

[ Parent | on HN ]