If voters are concerned with the plight of non-voters, then the plight of non-voters is by definition of concern to voters.

Asking voters to be concerned with what their government does to non-voters should never be discouraged. It may be futile, but it should not be discouraged.