That's also not how taxes work on capital gains.
I live in a wonderful house I bought for $220,000 with 20% down. I could downgrade if I need in the future but I like the space right now. The P+I of my mortgage is $750/month, taxes $400, utilities $250, insurance $145. I live in an average neighborhood, I don't live in an upper income neighborhood because I don't like upper income neighborhoods, they are too far away from everything. I also don't live in a 'hood. I live on the coast 2 miles from the beach and waking distance to plenty of places. I doubt my town is somehow unique in that respect.
If your spending is less than your capital gains and dividends you never have to worry about money again.
I was replying to "$5-10M is probably the low bar for living a kick-ass non-tied-to-employment lifestyle in the US." I have a kick-ass lifestyle (to me) for much less than $5-10M so I disagree. I don't think living where you have to drive 20 minutes minimum to go anywhere is "kick-ass." I don't find joy in buying new gadgets to impress my neighbors. I ran the numbers and Kick-Ass is at a million and a quarter to me.