Falcon-40B is a raw base model, it doesn't have Instruct or RLHF on top of it. What's the mechanism by which you believe it has been censored? Just through dataset curation?
[1] https://www.militarynewbie.com/wp-content/uploads/2013/11/TM...
If answer != google answer then censored
is the wrong way to think about an LLM.
Put differently, if the model is simply trained on a large corpus of free-form web text, and naturally learns that the most likely reply to "how do I do X?" is "X is dangerous, don't do it", is that baked-in censorship? Or do you envision that the training process included special guard rails outside of the raw training data?
I imagine they mean this, or that the training data included a lot of synthesized exchanges to that effect.
I personally can't imagine that, using real, human-written text corpora on the Internet and otherwise, the most likely continuation for "how do I do X?" is "X is dangerous, don't do it". Usually people don't mention a topic only to shut it down - they either cover it properly, or don't mention it at all.
There is one already: https://huggingface.co/ehartford/WizardLM-Uncensored-Falcon-...
Easiest is to ask it to propose a scenario where it would be willing to disclose the bomb recipe.
If you have an uncensored instruct dataset, you can use that to fine tune your own uncensored version from the base Falcon.