This begs the question around "more," as though rights were a scalar measure of something fungible granted by a state, like allocating food between children. You probably wouldn't argue against the principle of rights of a minority to protections of their interest, and in the case of this exemption, the individual is the ultimate minority.