It's never particularly bothered me to see posts get downmodded with no explanation, but I like the basic idea. This lets both the poster know and other readers.

This may cause a problem where we get a bunch of comments that say the same thing. It would probably be better if a reply could be upmodded instead of adding another comment.