Could be rewritten as "I never downvote, to avoid the possibility of sometimes misinterpreting the tone of a non native speaker."

Ei incumbit probatio qui dicit, non qui negat

I am not sure I follow what you mean.