Or tell another instance of the model to act as a constitutional-driven censor and let them duke it out.
Re:Llama and ChatGPT Are Not Open-Source
by bick_nyers on Thursday July 27, 2023 @07:32PM
(#36901476)
Now that's a fanfic I would read!
Don't want your LLM to be used to create erotic fanfiction? Instead of gutting the LLM, just put a detector on the query and answers feeding into the LLM. Thankfully, with a non-neutered model you have access to a tool than can be used to perform such detection...