Re:Self-Adapting Language Models
by free_bip on Friday June 13, 2025 @06:18PM
(#44272799)
The most obvious problem is alignment. LLM finetuning is already known to be able to get rid of alignment, so any form of continuous fine tuning would in theory be able to as well.
[ Parent
| on HN ]
Re:Self-Adapting Language Models
by notnullorvoid on Friday June 13, 2025 @06:36PM
(#44272916)
What kind of alignment are you referring to? Of course more fine-tuning can disrupt earlier fine-tuning, but that's a feature not a bug.