That sounds like you're either running your HVAC at extreme temps or have very poor insulation.
Also note that, at least in my case, I've got a cubicle farm at work. I can't just up the temperature for my 64 sqft cube; I have to up it for an entire quadrant of the floor.