Voting should of course be anonymous, just like it is here. The effect of this would be that votes would be a good measure of reputation because there are no politics involved in the voting, only opinion on whether the answer is good or bad.