remember that the rate of return in property investment has two components: the rent, offsets against tax for the maintenance of costs, and the capital gain. the show isn't over until the deal is done and like gambling you have to know when to hold 'em and know when to fold them into somebody else's property portfolio.
also, social housing is "good" for reasons which can go to longer term investment outcome. What if holding cheap housing stock in your portfolio also prevents competition setting up closer to your other valuable investment?