Tax proportionately to the footprint of the property, growing non-linearly.
Tax non-primary-residence units at at least 5X the rate; tax unoccupied units at 10X the rate.
Then there's an incentive to build up, while not screwing over existing residents.