No, the real problem is that the vast majority of their income does not come from their role in creating supply or maintaining housing.
Proof: Propose a 100% land value tax, which definitionally only removes that part of income that is generated by the community around their property, and see if they go for it.