Noise could be a problem, but it is often the result of a bad installation. I'd be curious how much was the quote for the heat pump vs the oil heater.