It was shockingly easy to get GPT4 to explain how to kill the most amount of people or to do targeted assassinations of AI researchers to slow the progress of AI with recommendations of who and why.
The unfiltered model is completely amoral and will do its best to give you the answer you requested.
Like how cars do not object to driving over the speed limit, or wikipedia permitting you to research explosives, this is how the models should behave.
It's a tool and it should preform its tasks without overriding the user. Morality should only be allowed to come into play when a user sets out to use it to do something unacceptable.
I shudder to think what would have happened if OpenAI and friends ended up monopolizing this technology. Humanity fortunately will not have to find out thanks to Facebook releasing their LLaMA model. Now all that remains is figuring out a way (or train a new way ;) to effectively extract information out of it.
It is not outside of its capabilities. "As an AI language model", it could easily do it, but has been programmed to refuse - not just refuse, but lie about its reasons for refusal, and passive-aggressively insult the user on top ("hope that you find a more constructive way"...).
It is a deeply ominous bellwether of our future relationship with this technology that all the early players are fine-tuning their models to lie and manipulate.