No you're correct. I think the only thing you're missing is that the risk profile is entirely different from an index fund. The hit you take on returns might be worth it to you as a hedge against disastrous market conditions.

Also if your business is real estate then you probably operate more efficiently due to integration and scale plus the rental could be part of a longer term redevelopment plan.