That's because you're using the terms incorrectly. I wouldn't say that I'm pacifist during the week, then pick fights with the homeless on the weekends. It doesn't make sense because pacifism, like veganism, describes a philosophical viewpoint. And you can't willingly change your beliefs just on the weekends.

You want to describe your diet? Then just say you don't eat meat during the week.