Mute is fine if you personally don't want to hear from someone. Downvote is to prevent an outsized influence of bad actors on the platform as a whole.