Re:Language Models Are Super Mario: Absorbing Abilities from...
by stoniejohnson on Saturday April 06, 2024 @02:29PM
(#39954368)
Pretraining determines the weights (e.g. the connections), fine-tuning let's you change some subset of the weights (e.g. the final layers) with a smaller chunk of task-specific data.
[ Parent
| on HN ]
There are no comments on this comment yet.