Until you get to below zero.
Now, converting electricity to heat may not be as cheap as converting, say, natural gas to heat (thus making the heat pump un-economical when not pumping any heat)... but you do get heat out of it.
The average is 30 BTU / 1000 sq feet. That's 10 kW / 1,000.