This seems like the perfect application for zk-snarks. (i.e. prove that a valid vote occurred, but not where the vote came from).