The only way I can think of to preserve the wilderness without any isolated homes for the wealthy is for the government to buy up the land. I'd probably support that, if we could get it done, but it does mean that if the money for it comes out of the general fund, then you probably have average people paying for more of it, instead of mostly the wealthy.
This is also a massive problem in BC; the ALR exists to do exactly this. There's lots of land available, it's just illegal to build anything other than a farm on it, and the real estate market is as a consequence as usurious as you'd expect it to be.
Of course, none of this is new. Enclosure predates the Romans.
In theory it's possible to reverse but in practice it requires something like standing on one foot, holding your breath, and reciting the entire bible.
People desperately need housing and even in bum fuck nowhere where I live they are desperate to build a little homestead just so they can have something, and then you have this insanity with people creating covenants that basically have dead people in their graves reaching out to smite living people.
C.f. https://en.m.wikipedia.org/wiki/Rule_against_perpetuities
You don't even have to be particularly rich, you just have to be willing to live in the country.
I was moderately interested in a property in the middle of nowhere that had about 8 acres buildable (with two structures on it already) and about 220 acres of forest and a lake under a very strict conservation easement. It would have been the only property of that size and type I could even dream of affording. It was still expensive, but less than a million dollars where if that 230 acres had not been under conservation easement in the same area it'd have sold for over 10.
And it's not like indefinite means forever forever. If the next generation 4 generations from now decides these easements are not in their best interest they will be repealed. It's just a piece of paper in the end.
Mega-corps building cookie cutter subdivisions or commercial space obviously pay less because they're vertically integrated and highly streamlined.
Some small scale 1-4 unit stuff (single structure here and there) is exempted, unless it's too close to water of course.