Empty homes attract crime, necessitating more policing resources, empty homes do not support local businesses but drive up prices, making the area less affordable for residents and less lucrative for businesses.
The 'payment' for living in an urban environment goes beyond just the normal local taxes, it involves a participation because the resident who lives in a home in that environment contributes to the environment.
No house is an island in an urban environment (except maybe in Venice).