If this were true, then when the colonists from "core" countries left a colonized area, then that area should have seen an increase in wealth because those rent monies would have remained in the colony. The history of numerous areas, such as Haiti, Kinshasa, and Zimbabwe say that this did not happen.
The wealth of the upper class comes from courage, determination, intelligence, organization, and productive use of time.
Furthermore, following your rule, Mark Zuckerberg, who is formerly a long time renter, should be less rich than his former landlords.