There are some "right wing" ideologies that basically align with non-interventionist decriminalization: don't fuck with me I won't fuck with you sort of individualistic thinking. Using violence such as taxation to solve it has parallels in some minds to the druggy coming up and robbing you. They don't want either, just the option to defend theyself or possibly engage in voluntary charity/assistance.