"But when those angry people started cursing you, you start to doubt whether what you do is right."

Has it occured to you that that might be because it's wrong?