Yes. It would be a good way to fix misclicks. However, I would recommend a quick time-delayed lockout similar to that present for comment editing (or is that lockout related to child comments? It's never been clear to me). That would reduce dog-piling effects and would keep votes permanent from a semantic perspective.