Politics is a huge factor in the lack of affordable housing. Both legislation and concerns by citizen about how new housing will "change" a neighbor make it next to impossible to build higher density housing.
Watch this video - it's eye opening https://www.youtube.com/watch?v=ExgxwKnH8y4