Really we're talking about public key encryption. In an ideal scenario, every voter would have a public and a private key. The government would have a list of public keys to determine who is eligible to vote. Each voter would hold their own private keys. Each vote is signed with their private key and then published to an immutable ledger that everyone can audit.