News for hackers. Stuff that matters.
Re:Creativity Has Left the Chat: The Price of Debiasing Lang... by djohnston on Monday June 17, 2024 @05:17AM (#40703763)
They aren’t exactly the same process though. Pre training produces a model whose outputs are a reflection of the training data. The fine tuning is a separate process that tries to map the outputs to the owners desired traits. These could be performance based but as we saw with Google’s black Nazis, it’s often a reflection of the owners moral inclinations.

There are no comments on this comment yet.