News for hackers. Stuff that matters.
Re:Language Models Are Super Mario: Absorbing Abilities from... by stoniejohnson on Saturday April 06, 2024 @02:29PM (#39954368)
Pretraining determines the weights (e.g. the connections), fine-tuning let's you change some subset of the weights (e.g. the final layers) with a smaller chunk of task-specific data.

There are no comments on this comment yet.