Among other things, pg and anyone with physical access to the HN server should have the capability to determine which users voted on a given comment, since the server needs to store that so it knows to not let you vote twice.