This suggestion may seem a little odd, but how about only enabling the up arrow once the URL has been visited? (via that javascript visited link colour trick, perhaps) It won't stop deliberate thoughtless upvoting, but nothing will.