My city has a big NG facility downtown that pipes heated water to a bunch of buildings, and it is surrounded by condos. I've never heard anything about it impacting the air (other than CO2 which is a global and not local issue).
Every building here (except for those connected to district heating systems), large and small, has a natural gas boiler or furnace. We have also several NG plants generating electricity within city limits. Again, localized pollution is not what concerns people about these things. Coal plants, on the other hand, tended to be way outside the city when they were still in operation.