It seems like if it's zoned as a single-family home or residential or whatever and you're not a single family it's hording. I'm willing to be talked out of that. Seems wrong to have to compete with a corporation to buy a house.
If I were in charge of the world I'd force every apartment building in New York to magically add a couple of floors to help with that. But I don't think it's the ONLY factor, and if we keep building out other problems pop up (like less wealthy people that can't afford to live in the city proper losing hours of their lives every day to get to work, etc.)