Every taxpayer pays for things others consume and pays for things that they don't like. That's the way it works. It isn't like you won't benefit from it as it would completely eliminate a lot of bureaucratic overhead and probably benefit society in the same ways that uplifting the poor does.

EDIT: I'll add that you also pay for things others consume (and steal and ruin!). You do this every time you pay for medical care, groceries, and other things. As a member of society, you cannot escape this.