How do you envision goods being delivered to people then?
There are some interesting real estate issues such that you'd essentially be implementing feudalism where a peasant comes with the land and cannot leave it for other employment. Or the parasitic FIRE sector would have to back off a bit so housing is more of a commodity. Either way isn't happening without much unhappiness.