There's this social norm where you don't cause discomfort such as noise or pollution for other people. Some people overdo it with way too much perfume; those are equally annoying.
The difference however is that although such might over-sensitise someone with e.g. (undiagnosed) autism your example is not proven to be harmful for the lungs, nor does it make you stoned.