I'd never accept anyone being even mildly trashtalking or rude in voice. Being mildly trashtalking in chat is fine. I wouldnt' even switch someone off, I'd voteban immediately (and if the game/community/server is ok more people would).

In the game I play when someone joins who is annoying they are generally called out as "whoa did you just arrive from CoD?"...