It seems like the higher taxes should be applied to non primary residences, along with perhaps some kind of penalty built in for holding the property for only a short period of time.