I don't see why the mods ever have to know the names of those who upvoted (or downvoted) to be able to ban them. A message would be sent out to those who were banned, letting them know why, and if they choose to reveal themselves as having made the bad vote... no one's doxxing them except themselves.