I don't think most downvotes are about agreement.
An honest opinion need not be an opinion worth reading. I want to read honest, informed, insightful, and justified opinions especially when I disagree, not honest, but knee-jerk opinions, even if I agree.
Just because you disagree is no reason to downvote, especially since HN fades the text until it's near impossible to read, making discussion harder.