Also anyone who downvoted without commenting should have their hn-name displayed on the right side or below in a list of silent downvoters. It should of course adapt if you comment later or remove your comment, by removing or adding your name to the downvoters list.