Downvoting on old comments was disabled. You can still upvote them though.
Re:Ask PG: Is voting on HN anonymous?
by huhtenberg on Saturday July 18, 2009 @11:28AM
(#711821)
> PG confirmed that it was one user that had done all the downvoting
This is trivial to deduce from the webserver log alone.
So yes, PG can see what you voted. I'm pretty sure he won't use it against you though ;-)