I agree that having other people smoking nearby can be unpleasant, but you might find some comfort in Sir Richard Doll's opinion on second hand smoke - that the risks were politically and publicly exaggerated beyond what the epidemiological evidence clearly supported.

Personally - aside from the smell - I have no concerns about people smoking near me outdoors or even in very well ventilated areas. I understand though that for some people (such as asthmatics) it can be a real problem that goes beyond simply being unpleasant.