New housing is always relatively "luxury" because newness is itself a luxury. Much of what is relatively affordable now was relatively "luxury" when it was built. But if you stop building anything new it would be like trying to keep the price of cars down by banning new cars – what will happen after a decade or two if you did that?