Re:French AI startup Mistral releases ‘unmoderated’ chatbot ...
by crooked-v on Saturday September 30, 2023 @07:56PM
(#37721141)
And as noted in other threads, Llama2 out of the box really does do that kind of nonsense, like refusing to tell the user how to kill a Linux process because that's too violent.
"As a chatbot, I can not inform you how to invert a binary tree as it can possibly be used to create software that is dangerous and morally wrong"
I apologize for the slippery slope but I think it does show that the line can be arbitrary. And if gone too far it makes the chatbot practically useless.