Heat Pumps can run in very cold temperatures, but it's just not worth it, economically, because their efficiency drops and gas becomes a cheaper option.
Also, I know you likely didn’t mean to exclude this, but in cases where gas service might be cheaper in the short term that’s only because it’s effectively heavily subsidized and many of the costs are externalized.