If the wrong people (investors rather than residents) are buying the houses then building more may only stoke a bubble.
The demand for housing covers both people who need a place to live and the countless other reasons people buy houses (an apartments/condos etc). They are a place to invest or park money. So when a bringing more supply online you have to be careful that it targets the correct demand.