Those areas cover probably max 0.1% of total land area in the USA.

Since these are some of the most sought after real estate areas, it seems these areas would be the preserve of the top 0.1%, or 1%. Back of the napkin maths here I'll admit.

The good news is there's still a huge chunk of the country where you would be considered wealthy by land value prices.