If you don't have electricity does your natural gas furnace work? The fan wouldn't work.
Also if it gets too cold for the heat pump to pump enough heat the air handler can be fitted with a restive heater that will kick in when it is too cold (below -30 C here).