Re:The Falcon has landed in the Hugging Face ecosystem
by TeMPOraL on Monday June 05, 2023 @06:37PM
(#36205108)
> Or do you envision that the training process included special guard rails outside of the raw training data?
I imagine they mean this, or that the training data included a lot of synthesized exchanges to that effect.
I personally can't imagine that, using real, human-written text corpora on the Internet and otherwise, the most likely continuation for "how do I do X?" is "X is dangerous, don't do it". Usually people don't mention a topic only to shut it down - they either cover it properly, or don't mention it at all.
Re:The Falcon has landed in the Hugging Face ecosystem
by viraptor on Monday June 05, 2023 @09:28PM
(#36206900)
A quick Google for similar phrases brings up quite a few examples. Stackoverflow also has lots of answers like that. It's not super common, but I wouldn't be surprised if that got generalised to some answers.
Put differently, if the model is simply trained on a large corpus of free-form web text, and naturally learns that the most likely reply to "how do I do X?" is "X is dangerous, don't do it", is that baked-in censorship? Or do you envision that the training process included special guard rails outside of the raw training data?