It really sucks. I have similar problems with room temperature. If I'm too hot or sweaty it's extremely difficult to focus on work.
The worst part is that my air temperature tolerance isn't, like, coherent. In the summer I'm far too hot at 72 degrees and have to run the AC more than is reasonable. Then during the winter I am far too cold at 72 degrees. It's very silly. I tend to forget how much this affects me, and delay turning on the heat in the fall for too long, and just kind of struggle for a while without realizing it.