News for hackers. Stuff that matters.
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by mensetmanusman on Saturday September 30, 2023 @09:21AM (#37715196)
Wait. Is this a real output from the safe LLM? Ahaha.
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by throwaway9274 on Saturday September 30, 2023 @09:33AM (#37715290)
Yes. Meta deliberately let their responsible AI people heavily censor the chat-tuned model.

Meta also released the uncensored base model, on which the open source community then performed its own fine tunes. This was a canny strategy to avoid negative press.

Mistral saw Meta’s approach, and instead chose to deliberately court the negative press, because attention is more valuable to them as a startup than opprobrium is damaging.

Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by astrange on Saturday September 30, 2023 @04:56PM (#37719708)
Since the chat model is local, you can force it out of refusing to respond by giving it a partial answer where it does respond and having it complete that. Haven't tried it myself though.
Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by throwaway9274 on Saturday September 30, 2023 @08:22PM (#37721291)
Definitely one of the benefits of local models.

You could theoretically auto-suppress any tokens that lead to a refusal to answer path and re-generate.

But you’re probably best off grabbing an existing uncensored chat SFT, like the Llama v2 variants trained on Hermes. https://huggingface.co/NousResearch/Nous-Hermes-Llama2-70b

Re:French AI startup Mistral releases ‘unmoderated’ chatbot ... by rg111 on Saturday September 30, 2023 @09:31AM (#37715279)
Llama 2 on Perplexity even refuses to tell you how to kill a Linux process as it is violent. I kid you not.

But Mistral does it well.