There’s a karma requirement. If I recall correctly I gained the downvote when I passed 500, but I could be wrong of course. My impression of this site is that they don’t do blacklists, they’d probably warn you straight up if they had a problem.