Re:Creativity Has Left the Chat: The Price of Debiasing Lang...
by djohnston on Monday June 17, 2024 @05:17AM
(#40703763)
They aren’t exactly the same process though. Pre training produces a model whose outputs are a reflection of the training data. The fine tuning is a separate process that tries to map the outputs to the owners desired traits. These could be performance based but as we saw with Google’s black Nazis, it’s often a reflection of the owners moral inclinations.
[ Parent
| on HN ]
There are no comments on this comment yet.