True. The reason is that voting and downvoting semantic is perceived differently, and people’s ego. The easiest, although imperfect, solution I think would be that downvoting costs you some karma (both the downvotee and the downvoter).