Living off the land in a small unit is an incredibly inefficient way to produce value.
Sure it wouldn't be as easy for many, but imagine a line below which folks who live in a currency-dependent economy would actually be better off to leave it. As more and more people fall below that line, the alternative way of life becomes more viable to sustain itself.
The thing that the wealthiest folks don't seem to realize is it's in their best interest to ensure the little guy has money. When a significant percentage of the population loses incentive to accumulate wealth you lose value on a global scale.