News for hackers. Stuff that matters.
Re:Language Models Are Super Mario: Absorbing Abilities from... by a_wild_dandan on Saturday April 06, 2024 @01:48PM (#39954071)
Summary: Fine tune a foundation model for a task. How did all weights change? That's called the "parameter delta." These changes are highly redundant. You can carefully (use DARE to) revert like 80% of them, yet maintain fine-tuned task accuracy! But only if the tuned weights didn't shift much. Otherwise DARE fails. Maybe you can make an LM polymath by melting together many fine-tunes of some base model. No GPU needed.

There are no comments on this comment yet.