Last year, when working at my old job, it was so bad that if somebody smoke 100M upwind from me, I'd start coughing and have to grab my inhaler - usually wondering wtf was going on, because the attack would usually start before I had become enough to actually smell it!
After the "attack" was over, it would leave me coughing up phlegm for about 4-6 hours afterwards.
It made going shopping at the supermarket or in the town centre and absolute nightmare!
Thankfully, since changing jobs, I haven't had to use my inhaler once and I visited a friend of mine last week, who is a chain smoker, and, although I felt a severe restriction in my chest, I didn't need my inhaler or an anti-histamine afterwards.
Which is why smokers should have the common courtesy of not smoking around non-smokers... I think shops and companies aren't doing themselves any favours with letting/making people smoke outside the main door to their premises! It would certainly put me off going to visit them. Not because they employ smokers, but because I think it is absolutely disgusting to force visitors to your business premises to have to walk through a cloud of smoke - even if nobody is currently smoking, the ashtray stinks out to a range of several metres, especially if it has been in use for a long time (emptying won't get rid of the smell, you need to thoroughly clean it with a chemical cleaner to get rid of the stink).
I think we are back to your extreme sports being dangerous to the health as well... A mountain climber doesn't stand on the mountain and throw large lumps of rock down the mountain at people who happen to be walking past! That is what a smoker does to everybody in range - and the range the smoke can travel and still be noticeable is much larger than people think - as I said, the amount of smoke drifting downwind from a smoker 100M away was enough to set off one of my attacks!
Somebody eating a packet of crisps, a triathlete, a bungee jumper etc. aren't going to affect me with their activities, unless the athlete runs into me or the bungee jumper didn't take precautions and landed on my head. A drinker won't affect me, unless he starts breathing in my face (or if he has really drunk a lot, when I come within about 2-3M of him... Cigarette smoking, unfortunately, has a much wider area of affect than any of the other examples you've given. The smoke can travel 10s of metres and still be noticeable, somebody who has smoked can walk into a room and within seconds, even standing on the other side of a room, you can smell that they have been smoking, and it isn't a pleasant smell.
I think this is where your argument falls down. It has nothing to do with non-smokers thinking not smoking is superior. It is that the smoke smells disgusting and can cause problems for non-smokers. It has nothing to do with superiority, it has everything to do with being courteous when around other people.
Around here, it is more likely to be every time you go to town, you will be subjected to second hand smoke every 50 metres or so.
I do have a smoker next door and when I go out in the morning to leave for work, if it isn't windy, I can usually tell whether he has left for work, before I have left my door! Luckily there is a garage and a fence between him and our garden, so hopefully we won't notice it in summer - and the patio is on the other side of the house, which is open to the street. The wind should also, generally, come from the other direction.
I don't think this is any different to the banning of cars "dirty" cars in city centres in Germany - some large cities only allow Euro 4 cars in, others only 3 and 4.
(A diesel can only get an E4 rating if it has a particle filter. I paid about 800€ to get my Mondeo upgraded, so that I don't have any problems going in, but a lot of bigger and older diesels (Audis and VWs being particularly affected) only get an E2 or E3 classification. All of the taxi fleets around the large cities have had to get their vehicles upgraded - either renewing the fleet or getting particle filters installed - as well as the bus fleets. Delivery vehicles are also affected.)
Italy has such a bad smog problem, that they have days where only 4s are allowed on the roads (anywhere) and when the smog is bad, they have dispari-pari days (odd and even days), where only E4s and cars with either odd or even numbered licence plates are allowed into the towns and cities. Many couples arrange it so that, when they have 2 cars, one is odd and one is even, so that at least one of them can use the car on dispari or pari days.
On Sundays no lorries are allowed on the roads (including motorways), unless they have an exemption (E.g. perishable goods or fuel).
Given that the city centres are being pedestrianised and "dirty" vehicles are being banned from cities, cigarette smoke is ever more noticeable as a pollutant.