It needs to be really cold. Like -15°C and some go as low as -40°C. They degrade in efficiency but are still better than a space heater. In the worst case they are exactly as efficient as a space heater.
As I understand most heat pumps in cold climates are usually installed with "backup heat" sources for this reason.