Manhattan is an outlier, but other cities have no reason for being as expensive as they are. Not everyone needs or wants a four bedroom single family home, but in many cities this is all that is available.
On top of that, we need to invest in better public transit and infrastructure outside of the core of our cities, so that more people can live where they work.