Of course size is not the only factor, which makes it complicated. Land or property value is probably a good proxy. If you house is >$1M it probably means you are wealthy.
Now you get one of two things in each individual case: Either people downsizing (good, frees up property for other people) or people paying tax (good for society).
And being forced to sell to some degree is by design. One elderly lady hogging the land that could house 100 apartment dwellings in the middle of a city for example.
“Owning Land” is a human construct.
And it would be no worse than compulsory purchases by government for infrastructure.
Or someone leasing where the landlord wants more rent so they get kicked out.
The other side of every "family was forced to sell" is "another family was very happy to move in".
There is a point where I think it's okay to factor an unexpected large housing market increase into the equation. To raise a community's property tax unrealistically because a mass influx of buyers are willing to overextend their credit doesn't make much sense to me.
Also, I think this applies even more to our current situation and the fact that a lot of these communities had nothing to do with the politically charged economic decisions our politicians made with close to zero debate, and ultimately, the economic fallout it has created.
In my home state in the Midwest I have always thought a better way to go about it in the future would be to factor median salary and wages into the mix. That, along with an unrealistic housing market increase. I'm not sure what unrealistic would be defined as, but median value increasing 2x in five years is definitely unrealistic. At the very least things like this should be debated.