I really don't understand why this bothers the others in the city. If they do not own where they live (and chose to rent) then they don't OWN their home and in turn have no right to live there. Rather, it makes much more sense that they should live somewhere within their means. If they are angry about that, it seems to me that they are just throwing a fit.
I personally am from Chicago, and I know there is a similar situation there. Most of the city (even for high paying jobs) commute in because there is a fairly decent train system, but also the prices are 10 times higher per square foot in the city. The people who do live in the city are wealthy or homeless. Though San Francisco's rent is twice as high as Chicago's on average, no one near Chicago wants to waste their money living in the city unless they want to be in the heart of the city and enjoy the scene. If you can't afford that, then perhaps you didn't make very good choices in your life (aka didn't make enough money to obtain what you want) and you should try and find a way to achieve that goal without inflicting pain (stress, wasted time, etc.) on others.