No, no ductless magic without mini splits. I feel like a lot of people refer to heat pump systems interchangeably with ductless mini splits, so I wanted to clarify that. Maybe that's just an issue with the people I speak with, though.
If the furnace is a serviceable natural gas unit, keep it. It makes a better backup than strip heat.