I can think of one way doing it. Maybe if its implemented anonymously with several different reasons of multi-choice boxes. Somewhat the way you report youtube-video abuse. Then attach those votes on why the comment got downvoted to be visible when it's clicked on item id, with appropriate chart presented.