Re:French AI startup Mistral releases ‘unmoderated’ chatbot ...
by mensetmanusman on Saturday September 30, 2023 @09:21AM
(#37715196)
Wait. Is this a real output from the safe LLM? Ahaha.
[ Parent
| on HN ]
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ...
by throwaway9274 on Saturday September 30, 2023 @09:33AM
(#37715290)
Yes. Meta deliberately let their responsible AI people heavily censor the chat-tuned model.
Meta also released the uncensored base model, on which the open source community then performed its own fine tunes. This was a canny strategy to avoid negative press.
Mistral saw Meta’s approach, and instead chose to deliberately court the negative press, because attention is more valuable to them as a startup than opprobrium is damaging.
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ...
by astrange on Saturday September 30, 2023 @04:56PM
(#37719708)
Since the chat model is local, you can force it out of refusing to respond by giving it a partial answer where it does respond and having it complete that. Haven't tried it myself though.
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ...
by throwaway9274 on Saturday September 30, 2023 @08:22PM
(#37721291)
Definitely one of the benefits of local models.
You could theoretically auto-suppress any tokens that lead to a refusal to answer path and re-generate.
But you’re probably best off grabbing an existing uncensored chat SFT, like the Llama v2 variants trained on Hermes. https://huggingface.co/NousResearch/Nous-Hermes-Llama2-70b