With power comes responsibility. The flip side of suffrage is responsibility. Abstaining from (or casting a blank ballot in) an election or referendum is, practically, dividing your vote amongst those who show up.

(Someone who is not eligible to vote is not really one of a country's people. They're its visitors, children, felons, what have you.)