I don’t know if it’s a stigma but it’s arguably a myth. Having lived both in areas where 40C is normal day after day in the summer and other areas where 0C (or below) is normal day after day in the winter, I can tell you which of heating and cooling is optional. In the extreme heat, as long as you drink enough water, you’re usually fine without air conditioning (but very uncomfortable). In extreme cold, blankets only go so far and you risk dying if the heat goes off. In my view one is definitely a luxury and the other is not.
Actually curious: is there anywhere on earth that the heat (by itself, assuming proper hydration) will kill you like the places on earth where the cold will kill you?