Re:Language Models Are Super Mario: Absorbing Abilities from...
by a_wild_dandan on Saturday April 06, 2024 @01:48PM
(#39954071)
Summary: Fine tune a foundation model for a task. How did all weights change? That's called the "parameter delta." These changes are highly redundant. You can carefully (use DARE to) revert like 80% of them, yet maintain fine-tuned task accuracy! But only if the tuned weights didn't shift much. Otherwise DARE fails. Maybe you can make an LM polymath by melting together many fine-tunes of some base model. No GPU needed.
[ Parent
| on HN ]
There are no comments on this comment yet.