It's not really the size of the building, it's the size of the parking lot and the resulting traffic. That's what *everyone* hates.

With parking minimums of 2 spots per unit, your standard 800 sq ft apartment requires another 600 sq ft of parking. And units can be stacked relatively cheaply, parking can't.