Look at how Bing's chatbot did a good job of simulating somebody becoming belligerent under circumstances where somebody really would become belligerent?

Current chatbots use RHLF to train them to be helpful and agreeable but it would be equally possible to train one to behave the other way.