The details make this more complicated, so we're never going to agree.

Just like most people agreeing that alcohol okay, but heroin isn't, we'd have to decide what's "free from pollution"? Exactly how many lead atoms/day is okay? And are smokers violating your human rights?

Endless arguments :-/

It's all about quantity, and balancing the conflicting freedoms of individuals. Your right to breathe perfectly clean air goes against my right to produce energy and heat myself or go places.

Likewise, there's a general consensus that the state can detain you temporarily. It's an affront to the freedom of the person detained, but most individuals agree that it's necessary to preserve their freedom to go about safely and without fear of violence.

There's a process around it, to try and balance the rights on both sides. It's all in the details and the implementation.