Are you familiar with the phrase "even the appearance of impropriety"?

Societies run on faith. Anything that causes people to question the legitimacy of the system we use to transfer power gives others an opportunity to seize it (incrementally of course). Points where one could game the voting system are dangerous to us the same way having a bunch of bastard children is bad for a king.